-- Logs begin at Mon 2022-05-16 18:09:35 UTC, end at Mon 2022-05-16 19:26:33 UTC. -- May 16 18:53:25.044247 dv-cinder-766064-6-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 16 18:53:25.052739 dv-cinder-766064-6-iscsi devstack@keystone.service[80007]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 16 18:53:25.054817 dv-cinder-766064-6-iscsi devstack@keystone.service[80007]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 16 18:53:25 2022] *** May 16 18:53:25.054817 dv-cinder-766064-6-iscsi devstack@keystone.service[80007]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 16 18:53:25.054817 dv-cinder-766064-6-iscsi devstack@keystone.service[80007]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 16 18:53:25.054817 dv-cinder-766064-6-iscsi devstack@keystone.service[80007]: nodename: dv-cinder-766064-6-iscsi May 16 18:53:25.054817 dv-cinder-766064-6-iscsi devstack@keystone.service[80007]: machine: x86_64 May 16 18:53:25.054817 dv-cinder-766064-6-iscsi devstack@keystone.service[80007]: clock source: unix May 16 18:53:25.054817 dv-cinder-766064-6-iscsi devstack@keystone.service[80007]: pcre jit disabled May 16 18:53:25.054817 dv-cinder-766064-6-iscsi devstack@keystone.service[80007]: detected number of CPU cores: 4 May 16 18:53:25.054817 dv-cinder-766064-6-iscsi devstack@keystone.service[80007]: current working directory: / May 16 18:53:25.054817 dv-cinder-766064-6-iscsi devstack@keystone.service[80007]: detected binary path: /usr/bin/uwsgi-core May 16 18:53:25.054817 dv-cinder-766064-6-iscsi devstack@keystone.service[80007]: your processes number limit is 47680 May 16 18:53:25.055383 dv-cinder-766064-6-iscsi devstack@keystone.service[80007]: your memory page size is 4096 bytes May 16 18:53:25.055383 dv-cinder-766064-6-iscsi devstack@keystone.service[80007]: detected max file descriptor number: 2048 May 16 18:53:25.055383 dv-cinder-766064-6-iscsi devstack@keystone.service[80007]: lock engine: pthread robust mutexes May 16 18:53:25.055383 dv-cinder-766064-6-iscsi devstack@keystone.service[80007]: thunder lock: enabled May 16 18:53:25.055383 dv-cinder-766064-6-iscsi devstack@keystone.service[80007]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 16 18:53:25.055383 dv-cinder-766064-6-iscsi devstack@keystone.service[80007]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 16 18:53:25.099808 dv-cinder-766064-6-iscsi devstack@keystone.service[80007]: Python main interpreter initialized at 0x5578dced79c0 May 16 18:53:25.099808 dv-cinder-766064-6-iscsi devstack@keystone.service[80007]: python threads support enabled May 16 18:53:25.099808 dv-cinder-766064-6-iscsi devstack@keystone.service[80007]: your server socket listen backlog is limited to 100 connections May 16 18:53:25.099808 dv-cinder-766064-6-iscsi devstack@keystone.service[80007]: your mercy for graceful operations on workers is 90 seconds May 16 18:53:25.100199 dv-cinder-766064-6-iscsi devstack@keystone.service[80007]: mapped 403077 bytes (393 KB) for 2 cores May 16 18:53:25.100275 dv-cinder-766064-6-iscsi devstack@keystone.service[80007]: *** Operational MODE: preforking *** May 16 18:53:25.100509 dv-cinder-766064-6-iscsi devstack@keystone.service[80007]: *** uWSGI is running in multiple interpreter mode *** May 16 18:53:25.100509 dv-cinder-766064-6-iscsi devstack@keystone.service[80007]: spawned uWSGI master process (pid: 80007) May 16 18:53:25.100713 dv-cinder-766064-6-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 16 18:53:25.101559 dv-cinder-766064-6-iscsi devstack@keystone.service[80007]: spawned uWSGI worker 1 (pid: 80021, cores: 1) May 16 18:53:25.101660 dv-cinder-766064-6-iscsi devstack@keystone.service[80007]: spawned uWSGI worker 2 (pid: 80022, cores: 1) May 16 18:53:25.105594 dv-cinder-766064-6-iscsi devstack@keystone.service[80007]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 16 18:53:30.745905 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 18:53:30.745905 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: from cryptography.utils import int_from_bytes May 16 18:53:30.747455 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 18:53:30.747455 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: from cryptography.utils import int_from_bytes May 16 18:53:30.756166 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 18:53:30.756166 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: from cryptography.utils import int_from_bytes May 16 18:53:30.769813 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 18:53:30.769813 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: from cryptography.utils import int_from_bytes May 16 18:53:30.797007 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 18:53:30.797222 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 18:53:30.797377 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] command line args: [] {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 18:53:30.797669 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 18:53:30.797847 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ================================================================================ {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 18:53:30.798104 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] admin_token = **** {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.798342 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] config_dir = [] {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.798528 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.798710 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] config_source = [] {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.798888 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] debug = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.799084 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.800852 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.801038 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.801298 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.801578 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.801893 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] list_limit = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.801991 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] log_config_append = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.802162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.802334 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] log_dir = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.802537 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] log_file = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.802747 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.802994 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.803238 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.803481 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.803671 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.803760 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 18:53:30.803823 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.803890 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 18:53:30.804092 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.804286 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] command line args: [] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 18:53:30.804480 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.804588 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 18:53:30.804588 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ================================================================================ {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 18:53:30.805039 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.805256 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] admin_token = **** {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.805439 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.805670 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] config_dir = [] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.805863 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.806055 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.806166 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.806321 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] config_source = [] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.806484 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.806551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] debug = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.806724 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.806798 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.806798 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.806927 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.807132 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.807132 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.807253 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.24/identity {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.807320 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.807379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] publish_errors = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.807442 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] list_limit = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.807499 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.807566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] log_config_append = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.807629 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.807874 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.808017 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.808150 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] log_dir = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.808150 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] log_file = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.808395 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.808523 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.808656 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.808788 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.808913 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] standard_threads = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.809086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.809225 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.809382 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.809569 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.809701 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.809842 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.809976 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.810104 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] use_journal = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.810104 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] use_json = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.810357 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.810496 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] use_stderr = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.810625 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.810758 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] use_syslog = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.810890 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.811021 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.811146 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.811348 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.811484 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.811610 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.811800 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.811929 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.812053 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.812178 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.812326 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.812457 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.812588 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.812713 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.812713 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.812955 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.24/identity {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.813080 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.813210 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] publish_errors = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.813342 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.813478 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.813647 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.813774 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.813774 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.814018 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.814018 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.814267 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.814267 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.814511 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.814641 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] standard_threads = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.814771 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.814901 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.815037 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.815162 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.815291 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.815423 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.815547 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.815680 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] use_journal = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.815680 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] use_json = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.815999 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.816124 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] use_stderr = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.816255 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.816380 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] use_syslog = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.816504 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.816640 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:53:30.816765 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.816888 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.817018 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.817143 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.817266 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.817398 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.817573 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.817792 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.817934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.818062 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.818201 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.818336 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.818467 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.818593 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.818718 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.818843 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.818966 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.819099 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.819224 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.819359 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.819484 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.819615 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.819740 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.819881 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.820007 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.820131 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.820255 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.820379 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.820511 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.820649 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.820776 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.820900 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.820900 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.821145 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.821145 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.821388 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.821513 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.821690 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.821817 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.821940 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.822064 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.822267 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.822418 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.822642 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.822802 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.822930 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.823064 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.823198 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.823323 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.823448 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.823572 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.823696 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.823831 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.823957 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.824081 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.824205 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.824329 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.824453 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.824586 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.824712 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.824846 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.824971 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.825102 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.825227 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.825363 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.825494 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.825660 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.825787 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.825918 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.826045 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.826179 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.826310 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.826441 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.826802 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.826934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.827060 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.827194 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.827319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.827521 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.827710 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.827894 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.828079 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.828273 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.828466 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.828722 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.828924 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.829087 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.829291 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.829484 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.829741 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.829926 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.830111 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.830331 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.830501 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.830695 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.830882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.831066 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.831252 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.831437 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.831621 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.831621 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.832002 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.832189 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.832385 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.832543 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.832671 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.832828 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.832966 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.833128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.833260 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.833386 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.833510 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.833665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.833665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.833665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.833665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.833665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.834303 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.834430 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.834563 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.834695 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.834822 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.834958 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.835085 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.835238 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.835238 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.835490 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.835626 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.835752 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.835876 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.836006 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.836140 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.836268 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.836394 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.836518 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.836644 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.836774 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.836977 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.837105 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.837230 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.837355 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.837491 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.837663 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.837834 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.837991 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.838120 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.838253 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.838379 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.838508 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.838642 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.838769 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.838894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.839019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.839019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.839271 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.839407 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.839534 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.839659 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.839784 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.839910 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.840035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.840168 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.840303 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.840447 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.840583 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.840746 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.840875 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.841001 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.841137 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.841137 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.841385 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.841516 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.841677 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.841803 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.841938 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] auth.external = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.842074 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.842200 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.842325 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.842450 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.842577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.842710 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.842848 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.842984 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] auth.password = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.843110 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.843234 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] auth.token = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.843359 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.843492 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.843624 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.843750 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.843875 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.844000 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.844125 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.844257 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.844410 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.844545 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.844691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.844819 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.844945 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.845073 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.845199 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.845324 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] credential.caching = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.845458 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.845620 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.845749 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] auth.external = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.845899 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.846029 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.846163 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.846290 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.846418 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.846555 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.846680 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.846806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] auth.password = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.846941 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.847069 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] auth.token = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.847270 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.847422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.847551 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.847677 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.847812 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.847941 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.848074 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.848207 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.848344 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.848479 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.848615 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.848743 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.848743 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.848982 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.849109 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] credential.caching = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.849234 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.849369 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.849495 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.849652 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.849780 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] federation.caching = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.849905 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.850032 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.850181 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.850310 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.850442 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.850589 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.850717 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.850844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.850979 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.851107 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.851107 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.851347 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.851347 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.851586 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.851586 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.851850 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.851978 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.852110 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.852238 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.852373 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.852577 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.852706 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.852833 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] identity.caching = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.852959 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.853091 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.853219 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.853354 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.853481 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] federation.caching = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.853644 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.853783 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.853911 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.854037 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.854175 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.854304 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.854432 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.854557 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.854683 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.854810 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.854945 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.855072 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.855198 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.855325 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.855461 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.855587 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.855722 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.855849 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.855975 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.856107 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.856233 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.856369 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.856497 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.856624 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity.caching = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.856750 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.856876 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.857003 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.857138 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.857138 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.857398 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.857525 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.857699 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.857826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.857968 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.858096 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.858223 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.858349 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.858475 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.858602 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.858737 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.858864 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.859000 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.859127 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.859253 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.859379 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.859514 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.859642 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.859768 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.859895 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.860027 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.860154 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.860289 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.860422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.860558 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.860686 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.860824 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.860952 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.861090 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.861090 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.861335 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.861335 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.861609 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.861741 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.861878 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.862007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.862140 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.862267 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.862393 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.862518 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.862663 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.862790 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.862916 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.863043 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.863169 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.863295 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.863430 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.863558 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.863691 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.863817 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.863943 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.864070 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.864205 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.864343 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.864469 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.864597 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.864724 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.864850 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.864988 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.865116 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.865241 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.865367 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.865493 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.865674 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.865817 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.865946 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.866072 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.866208 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.866334 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.user = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.866459 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.866593 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.866721 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.866864 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.867070 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.867229 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.867359 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.867494 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.867622 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.867747 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.867874 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.868000 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.868138 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.868273 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.868406 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.868532 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.868658 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.868784 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.868918 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.869045 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.869170 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.869295 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.869422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.869564 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.869708 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.869846 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.869974 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.870100 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.870226 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.870351 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.870494 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.870623 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.870749 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.870876 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.871002 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.871128 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.871262 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.871389 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.871515 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.871652 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.871778 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.871904 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.872105 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.872234 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.872360 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.872486 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.872613 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.872739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.872873 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.873000 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.873127 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.873253 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.873389 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.873516 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.873726 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.873871 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.874000 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.874126 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.874253 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.874379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.874514 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.874641 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.874767 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.874893 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.875019 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.875145 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.875294 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.875294 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.875540 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.875668 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.875795 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.875922 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.876056 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.876184 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.876310 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] resource.caching = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.876436 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.876562 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.876688 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.876823 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.876951 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.877086 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.877213 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.877340 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.877466 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.877707 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.877840 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.877967 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.878093 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.878225 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.878353 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.878488 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.878615 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.878741 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.878867 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.879009 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] role.caching = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.879137 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.879271 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] role.driver = sql {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.879400 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.879526 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.879652 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] resource.caching = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.879779 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.879904 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.880039 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.880167 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.880293 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.880425 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.880563 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.880714 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.880850 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.880978 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.881104 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.881230 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.881356 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.881483 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.881667 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.881796 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.881923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.882050 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.882177 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.882303 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] role.caching = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.882440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.882580 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] role.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.882707 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.882834 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.882960 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.883095 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.883095 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.883335 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.883462 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.883589 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.883716 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.883850 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.883979 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.884106 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.884242 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.884369 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.884496 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.884632 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.884759 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.884891 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.885018 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.885145 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.885271 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.885406 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.885548 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.885682 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.885809 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.885946 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.886073 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.886211 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.886211 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.886450 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.886576 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.886702 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.886829 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.886964 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.887092 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.887218 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.887344 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.887492 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.887635 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.887771 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.887899 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.888025 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.888151 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] token.caching = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.888276 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.888403 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.888538 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.888665 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.888791 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.888918 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.889045 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.889045 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.889292 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.889429 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.889583 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.889715 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.889842 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.889980 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.890109 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.890242 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.890369 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.890504 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.890639 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.890774 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.890902 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.891029 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.891155 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.891292 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] token.caching = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.891418 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.891552 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.891681 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.891807 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.891933 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.892059 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.892185 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.892320 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.892447 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.892573 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.892699 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.892824 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.892960 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] database.connection = **** {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.893101 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.893236 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.893371 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.893499 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.893702 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.893839 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.893967 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.894094 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.894229 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.894356 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.894482 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.894607 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.894734 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.894870 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.895005 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.895133 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.895259 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.895385 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.895512 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.895638 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.895773 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.895900 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.896027 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.connection = **** {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.896163 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.896299 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.896427 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.896553 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.896697 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.896825 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.896951 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.897078 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.897204 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.897330 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.897465 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.897628 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.897756 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.897883 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.898010 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 18:53:30.898137 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.898137 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.898137 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.898137 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.898137 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.898137 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.898137 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.898137 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.898137 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.899261 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.899261 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:53:30.899261 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 18:53:30.913345 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:30.913708 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:30.913870 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:30.914927 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:30.915152 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:30.915371 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:30.922928 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:30.924021 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:30.951107 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:30.951382 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:30.951734 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:30.951961 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.003877 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.004164 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.055227 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.055545 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.055814 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.056022 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.120663 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.120663 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.121109 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.121259 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.121423 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.121605 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.121768 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.121918 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.122057 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.122208 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.122349 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.122349 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.144263 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.144535 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.144707 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.144857 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.145010 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.145149 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.145285 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.145432 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.145598 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.145744 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.145881 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.146019 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.146156 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.146156 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.156765 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.157269 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.171975 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.172244 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.172397 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.172542 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.172680 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.172817 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.172964 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.173105 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.173241 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.173393 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.173556 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.173700 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.173850 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.173850 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:53:31.190337 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.190591 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 16 18:53:31.190741 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.190905 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.191047 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 16 18:53:31.191185 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 16 18:53:31.191338 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.191475 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.191612 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 16 18:53:31.191758 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.191897 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.192034 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.192170 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.192306 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.192452 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.192452 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.202983 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.203224 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.203401 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.203554 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.203715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.203857 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.203996 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.204133 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.211745 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:53:31.212224 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80022) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:53:31.215020 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:53:31.215296 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.215516 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80022) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:53:31.215626 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.215819 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.215966 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.216113 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.216258 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.216478 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.216562 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.216736 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.216816 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.216999 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.217082 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.217257 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.217348 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.217513 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.217626 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.217790 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.217871 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.218068 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.218329 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.244240 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.244808 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.245860 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:53:31.246133 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.246464 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80022) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:53:31.246739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.251428 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:53:31.251699 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.251979 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.252074 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80022) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:53:31.252318 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.252594 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.259360 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:53:31.259557 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.259958 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80022) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:53:31.260244 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.264200 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:53:31.264480 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.264716 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.264877 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80022) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:53:31.264980 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.265159 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.265240 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.265419 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.265500 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.265718 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.265791 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.265954 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.266040 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.266202 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.266492 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.266733 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.285267 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.285509 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.286761 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.287209 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.290412 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80022) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:53:31.292183 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:53:31.294148 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.294431 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.295836 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.296098 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.299389 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80022) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:53:31.301081 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:53:31.302971 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80022) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:53:31.304629 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:53:31.306697 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.306993 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.307281 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.307539 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.307835 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.308131 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.308287 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.308592 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.308874 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.309118 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.309434 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.309701 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.327375 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80022) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:53:31.327768 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.328064 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.328297 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.331793 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:53:31.332208 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.332445 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.332694 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.336445 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.338257 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.338511 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.340748 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.341607 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80022) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:53:31.341905 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.342160 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.342472 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.342676 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.342846 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.343040 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.345764 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:53:31.346016 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.346304 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.346552 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.346851 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.356120 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80022) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:53:31.356455 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.356752 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.357015 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.357309 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.357558 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.357870 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.360181 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:53:31.360422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.360719 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.360971 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.361267 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.361516 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.361831 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.375918 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80022) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:53:31.379187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80022) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:53:31.379728 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:53:31.382507 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.383067 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:53:31.384106 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.385743 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80022) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:53:31.386004 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.386316 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.386523 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.388003 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.393635 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:53:31.393860 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.394015 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.394264 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.395384 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80022) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:53:31.398644 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.398900 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.399204 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.399453 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.401807 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.403445 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:53:31.406697 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.406977 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.407264 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.407534 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.410432 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80022) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:53:31.410831 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.411209 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.417096 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:53:31.417395 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.417701 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.419981 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80022) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:53:31.420360 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.420736 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.421102 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.421471 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.421866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.422234 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.422612 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.422973 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.423418 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.423704 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.424073 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.424413 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.424791 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.425660 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:53:31.425936 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.426215 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.426488 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.426757 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.427043 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.427319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.427600 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.427868 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.428136 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.428403 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.428656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.428918 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.429183 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:53:31.464627 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5578dced79c0 pid: 80022 (default app) May 16 18:53:31.467999 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5578dced79c0 pid: 80021 (default app) May 16 18:53:31.468312 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9216786-1f69-4b92-b8b3-4cbba0823038 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:31.468669 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9216786-1f69-4b92-b8b3-4cbba0823038 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:31.469013 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9216786-1f69-4b92-b8b3-4cbba0823038 None None] PATH_INFO: `/v3` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:31.473314 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1/1] 10.222.0.24 () {50 vars in 791 bytes} [Mon May 16 18:53:31 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:53:39.331728 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0074c-d683-4960-ba75-5540f12921f8 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:39.332321 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0074c-d683-4960-ba75-5540f12921f8 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:39.332321 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0074c-d683-4960-ba75-5540f12921f8 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:39.336623 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1/2] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:53:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:53:39.342116 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec46a4f-cab4-4a0b-b269-85ee72b7ef84 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:39.342551 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec46a4f-cab4-4a0b-b269-85ee72b7ef84 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:39.342758 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec46a4f-cab4-4a0b-b269-85ee72b7ef84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:39.376419 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG oslo_db.sqlalchemy.engines [None req-6ec46a4f-cab4-4a0b-b269-85ee72b7ef84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80022) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 18:53:39.560484 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG passlib.handlers.bcrypt [None req-6ec46a4f-cab4-4a0b-b269-85ee72b7ef84 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80022) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 16 18:53:39.560918 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG passlib.handlers.bcrypt [None req-6ec46a4f-cab4-4a0b-b269-85ee72b7ef84 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80022) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 16 18:53:39.616151 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-6ec46a4f-cab4-4a0b-b269-85ee72b7ef84 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:53:39.617821 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-6ec46a4f-cab4-4a0b-b269-85ee72b7ef84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:53:39.744686 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 2/3] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:53:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 16 18:53:39.887448 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0074c-d683-4960-ba75-5540f12921f8 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:39.923491 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG oslo_db.sqlalchemy.engines [None req-8ab0074c-d683-4960-ba75-5540f12921f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80021) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 18:53:40.048125 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0074c-d683-4960-ba75-5540f12921f8 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:40.052816 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb23df-ee49-49d0-8f59-d0e53be9f6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:40.053481 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb23df-ee49-49d0-8f59-d0e53be9f6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:40.053794 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb23df-ee49-49d0-8f59-d0e53be9f6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:40.054068 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb23df-ee49-49d0-8f59-d0e53be9f6d0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:40.062534 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb23df-ee49-49d0-8f59-d0e53be9f6d0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:53:40.113946 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: WARNING keystone.common.rbac_enforcer.enforcer [None req-37fb23df-ee49-49d0-8f59-d0e53be9f6d0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 16 18:53:40.114277 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb23df-ee49-49d0-8f59-d0e53be9f6d0 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:53:40.124123 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 2/4] 10.222.0.24 () {58 vars in 1324 bytes} [Mon May 16 18:53:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 18:53:40.130503 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec46a4f-cab4-4a0b-b269-85ee72b7ef84 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:40.144868 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec46a4f-cab4-4a0b-b269-85ee72b7ef84 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:40.149676 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabef2f4-189b-45be-bf84-dc3bcfb6aed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:40.150825 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabef2f4-189b-45be-bf84-dc3bcfb6aed0 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:40.151438 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabef2f4-189b-45be-bf84-dc3bcfb6aed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:40.151711 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabef2f4-189b-45be-bf84-dc3bcfb6aed0 admin admin] PATH_INFO: `/v3/projects/1f43cb24f4194077b63c058f20af8f90` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:40.153302 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabef2f4-189b-45be-bf84-dc3bcfb6aed0 admin admin] RBAC: Authorizing `identity:get_project(project_id=1f43cb24f4194077b63c058f20af8f90)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:53:40.203498 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fabef2f4-189b-45be-bf84-dc3bcfb6aed0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 16 18:53:40.203823 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabef2f4-189b-45be-bf84-dc3bcfb6aed0 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:53:40.208496 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 3/5] 10.222.0.24 () {56 vars in 1207 bytes} [Mon May 16 18:53:40 2022] GET /identity/v3/projects/1f43cb24f4194077b63c058f20af8f90 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:53:42.411659 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206a265-f475-4080-ad6d-f64b28fef91f None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:42.412534 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206a265-f475-4080-ad6d-f64b28fef91f None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:42.412534 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206a265-f475-4080-ad6d-f64b28fef91f None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:42.419614 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 3/6] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:53:42 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:53:42.426247 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f54f28-b5cb-40c9-bd4b-817c6620251f None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:42.426712 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f54f28-b5cb-40c9-bd4b-817c6620251f None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:42.426816 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f54f28-b5cb-40c9-bd4b-817c6620251f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:42.456656 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-68f54f28-b5cb-40c9-bd4b-817c6620251f None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:53:42.458199 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-68f54f28-b5cb-40c9-bd4b-817c6620251f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:53:42.466570 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 4/7] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:53:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 16 18:53:42.488509 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206a265-f475-4080-ad6d-f64b28fef91f None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:42.508238 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206a265-f475-4080-ad6d-f64b28fef91f None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:42.514316 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5fc2f9-3d43-485a-acd0-b9dab610fb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:42.514947 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fc2f9-3d43-485a-acd0-b9dab610fb1a admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:42.515225 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fc2f9-3d43-485a-acd0-b9dab610fb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:42.515493 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fc2f9-3d43-485a-acd0-b9dab610fb1a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:42.526660 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5fc2f9-3d43-485a-acd0-b9dab610fb1a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:53:42.529095 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5fc2f9-3d43-485a-acd0-b9dab610fb1a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:53:42.540565 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 4/8] 10.222.0.24 () {58 vars in 1324 bytes} [Mon May 16 18:53:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 18:53:42.550034 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f54f28-b5cb-40c9-bd4b-817c6620251f None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:42.563471 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f54f28-b5cb-40c9-bd4b-817c6620251f None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:42.568374 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8940f-fb28-4a62-9c58-7e208926313a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:42.569260 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8940f-fb28-4a62-9c58-7e208926313a admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:42.569564 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8940f-fb28-4a62-9c58-7e208926313a admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:42.569833 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8940f-fb28-4a62-9c58-7e208926313a admin admin] PATH_INFO: `/v3/users/e70b26bfebd8410b8d3b2aa16cacd530` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:42.571285 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d8940f-fb28-4a62-9c58-7e208926313a admin admin] RBAC: Authorizing `identity:get_user(user_id=e70b26bfebd8410b8d3b2aa16cacd530)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:53:42.573128 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d8940f-fb28-4a62-9c58-7e208926313a admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:53:42.574816 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 5/9] 10.222.0.24 () {56 vars in 1198 bytes} [Mon May 16 18:53:42 2022] GET /identity/v3/users/e70b26bfebd8410b8d3b2aa16cacd530 => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:53:44.813882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06543449-45f0-4955-80aa-c550553ede80 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:44.814443 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06543449-45f0-4955-80aa-c550553ede80 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:44.814443 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06543449-45f0-4955-80aa-c550553ede80 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:44.815803 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 5/10] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:53:44.821064 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28013ec1-ecfd-4494-9a8a-d888f15bd2c3 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:44.821489 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28013ec1-ecfd-4494-9a8a-d888f15bd2c3 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:44.821716 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28013ec1-ecfd-4494-9a8a-d888f15bd2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:44.864350 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc388819-b2c4-4beb-8106-884a652c4e13 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:44.864591 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc388819-b2c4-4beb-8106-884a652c4e13 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:44.864892 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc388819-b2c4-4beb-8106-884a652c4e13 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:44.866305 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 6/11] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:53:44.872660 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dceeed5-7dc6-4ab0-b6e8-4367e8ae2baf None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:44.872897 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dceeed5-7dc6-4ab0-b6e8-4367e8ae2baf None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:44.873206 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dceeed5-7dc6-4ab0-b6e8-4367e8ae2baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:44.914836 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG passlib.handlers.bcrypt [None req-0dceeed5-7dc6-4ab0-b6e8-4367e8ae2baf None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80021) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 16 18:53:44.915249 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG passlib.handlers.bcrypt [None req-0dceeed5-7dc6-4ab0-b6e8-4367e8ae2baf None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80021) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 16 18:53:44.952683 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-28013ec1-ecfd-4494-9a8a-d888f15bd2c3 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:53:44.953954 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-28013ec1-ecfd-4494-9a8a-d888f15bd2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:53:44.961463 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-0dceeed5-7dc6-4ab0-b6e8-4367e8ae2baf None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:53:44.963034 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0dceeed5-7dc6-4ab0-b6e8-4367e8ae2baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:53:45.036041 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 6/12] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:53:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:53:45.059235 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28013ec1-ecfd-4494-9a8a-d888f15bd2c3 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:45.063074 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 7/13] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:53:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:53:45.084749 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dceeed5-7dc6-4ab0-b6e8-4367e8ae2baf None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:45.154631 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28013ec1-ecfd-4494-9a8a-d888f15bd2c3 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:45.184220 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dceeed5-7dc6-4ab0-b6e8-4367e8ae2baf None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:45.188242 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21dcc4-ac38-4947-bcff-8d9b3f913302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:45.189138 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21dcc4-ac38-4947-bcff-8d9b3f913302 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:45.189428 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21dcc4-ac38-4947-bcff-8d9b3f913302 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:45.189731 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21dcc4-ac38-4947-bcff-8d9b3f913302 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:45.200553 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b21dcc4-ac38-4947-bcff-8d9b3f913302 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:53:45.211755 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-9b21dcc4-ac38-4947-bcff-8d9b3f913302 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:53:45.211755 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:53:45.211755 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:53:45.211755 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:53:45.211755 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:53:45.211755 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:53:45.211755 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:53:45.211755 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:53:45.211755 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:53:45.211755 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:53:45.211755 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:53:45.211755 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:53:45.211755 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:53:45.211755 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:53:45.211755 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:53:45.211755 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:53:45.212923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:53:45.212923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:53:45.212923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:53:45.212923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:53:45.212923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:53:45.212923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:53:45.212923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:53:45.212923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:53:45.212923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:53:45.212923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:53:45.212923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:53:45.212923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:53:45.212923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:53:45.212923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:53:45.212923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:53:45.212923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:53:45.213809 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:53:45.213809 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:53:45.213809 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:53:45.213809 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:53:45.213809 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:53:45.213809 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:53:45.213809 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:53:45.213809 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:53:45.213809 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:53:45.213809 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:53:45.213809 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:53:45.213809 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:53:45.213809 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 7/14] 10.222.0.24 () {56 vars in 1096 bytes} [Mon May 16 18:53:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:53:45.218762 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21dcc4-ac38-4947-bcff-8d9b3f913302 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:45.218949 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce803b-64c8-4d11-930e-92ae622a13c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:45.219883 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce803b-64c8-4d11-930e-92ae622a13c1 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:45.220160 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce803b-64c8-4d11-930e-92ae622a13c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:45.220426 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce803b-64c8-4d11-930e-92ae622a13c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:45.285804 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce803b-64c8-4d11-930e-92ae622a13c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:53:45.287343 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce803b-64c8-4d11-930e-92ae622a13c1 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:53:45.313171 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21dcc4-ac38-4947-bcff-8d9b3f913302 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:45.346549 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d00dc5a-25db-4066-9357-797657c65c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:45.347145 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00dc5a-25db-4066-9357-797657c65c62 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:45.347421 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00dc5a-25db-4066-9357-797657c65c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:45.347693 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00dc5a-25db-4066-9357-797657c65c62 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:45.348444 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d00dc5a-25db-4066-9357-797657c65c62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:53:45.348751 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d00dc5a-25db-4066-9357-797657c65c62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:53:45.350192 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d00dc5a-25db-4066-9357-797657c65c62 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:53:45.361761 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 8/15] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:53:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:53:45.367396 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d00dc5a-25db-4066-9357-797657c65c62 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:45.383245 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 8/16] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:53:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:53:45.389663 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce803b-64c8-4d11-930e-92ae622a13c1 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:45.474122 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d00dc5a-25db-4066-9357-797657c65c62 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:45.510018 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076c5c7-7a11-43e6-b725-c930216fa3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:45.510937 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076c5c7-7a11-43e6-b725-c930216fa3a4 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:45.511214 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076c5c7-7a11-43e6-b725-c930216fa3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:45.511481 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076c5c7-7a11-43e6-b725-c930216fa3a4 None admin] PATH_INFO: `/v3/users/e70b26bfebd8410b8d3b2aa16cacd530` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:45.512784 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1076c5c7-7a11-43e6-b725-c930216fa3a4 None admin] RBAC: Authorizing `identity:get_user(user_id=e70b26bfebd8410b8d3b2aa16cacd530)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:53:45.514351 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1076c5c7-7a11-43e6-b725-c930216fa3a4 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:53:45.516003 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 9/17] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:53:45 2022] GET /identity/v3/users/e70b26bfebd8410b8d3b2aa16cacd530 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:53:45.521439 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076c5c7-7a11-43e6-b725-c930216fa3a4 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:45.606715 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce803b-64c8-4d11-930e-92ae622a13c1 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:45.615744 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076c5c7-7a11-43e6-b725-c930216fa3a4 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:45.641331 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe17be-0ba2-4b19-98d7-57366fab1f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:45.642161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe17be-0ba2-4b19-98d7-57366fab1f8e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:45.642438 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe17be-0ba2-4b19-98d7-57366fab1f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:45.642702 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe17be-0ba2-4b19-98d7-57366fab1f8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:45.650718 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc01005-cf08-458b-807d-9eeab47b93e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:45.651544 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc01005-cf08-458b-807d-9eeab47b93e4 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:45.651825 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc01005-cf08-458b-807d-9eeab47b93e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:45.652097 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc01005-cf08-458b-807d-9eeab47b93e4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:45.653283 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc01005-cf08-458b-807d-9eeab47b93e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:53:45.654853 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc01005-cf08-458b-807d-9eeab47b93e4 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:53:45.656455 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 10/18] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:53:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:53:45.661706 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe17be-0ba2-4b19-98d7-57366fab1f8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:53:45.662239 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc01005-cf08-458b-807d-9eeab47b93e4 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:45.663195 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe17be-0ba2-4b19-98d7-57366fab1f8e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:53:45.684422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-ddbe17be-0ba2-4b19-98d7-57366fab1f8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:53:45.684422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:53:45.684422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:53:45.684422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:53:45.684422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:53:45.684422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:53:45.684422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:53:45.684422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:53:45.684422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:53:45.684422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:53:45.684422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:53:45.684422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:53:45.684422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:53:45.684422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:53:45.684422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:53:45.685295 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:53:45.685295 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:53:45.685295 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:53:45.685295 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:53:45.685295 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:53:45.685295 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:53:45.685295 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:53:45.685295 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:53:45.685295 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:53:45.685295 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:53:45.685295 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:53:45.685295 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:53:45.685295 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:53:45.685295 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:53:45.685295 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:53:45.685295 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:53:45.685295 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:53:45.686457 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:53:45.686457 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:53:45.686457 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:53:45.686457 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:53:45.686457 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 9/19] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:53:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:53:45.693134 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe17be-0ba2-4b19-98d7-57366fab1f8e None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:45.763903 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc01005-cf08-458b-807d-9eeab47b93e4 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:45.786119 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe17be-0ba2-4b19-98d7-57366fab1f8e None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:45.797297 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e49e53-cee1-4953-b78a-bec97ab42bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:45.798006 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e49e53-cee1-4953-b78a-bec97ab42bfa None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:45.798284 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e49e53-cee1-4953-b78a-bec97ab42bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:45.798554 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e49e53-cee1-4953-b78a-bec97ab42bfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:45.799392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e49e53-cee1-4953-b78a-bec97ab42bfa None admin] RBAC: Adding query filter params (role.id=5a6e54e81bb24eceb618d9ffa67f488e, scope.domain.id=default, user.id=e70b26bfebd8410b8d3b2aa16cacd530) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:53:45.799696 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e49e53-cee1-4953-b78a-bec97ab42bfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:53:45.801138 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e49e53-cee1-4953-b78a-bec97ab42bfa None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:53:45.808157 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 11/20] 10.222.0.24 () {56 vars in 1322 bytes} [Mon May 16 18:53:45 2022] GET /identity/v3/role_assignments?user.id=e70b26bfebd8410b8d3b2aa16cacd530&scope.domain.id=default&role.id=5a6e54e81bb24eceb618d9ffa67f488e => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:53:45.820159 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418baf7-f57c-47ed-a3a7-2c0ca662fc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:45.820850 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418baf7-f57c-47ed-a3a7-2c0ca662fc67 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:45.821131 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418baf7-f57c-47ed-a3a7-2c0ca662fc67 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:45.821405 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418baf7-f57c-47ed-a3a7-2c0ca662fc67 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:45.822233 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c418baf7-f57c-47ed-a3a7-2c0ca662fc67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:53:45.822520 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c418baf7-f57c-47ed-a3a7-2c0ca662fc67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:53:45.823984 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c418baf7-f57c-47ed-a3a7-2c0ca662fc67 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:53:45.843852 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 10/21] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:53:48.178009 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4c059-a22f-46d5-b287-86d9e81a4b03 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:48.178472 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4c059-a22f-46d5-b287-86d9e81a4b03 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:48.178564 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4c059-a22f-46d5-b287-86d9e81a4b03 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:48.180263 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 12/22] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:53:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:53:48.185423 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a070d3-b5e2-4e09-8dd5-967c81a7710e None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:48.186266 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a070d3-b5e2-4e09-8dd5-967c81a7710e None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:48.186728 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a070d3-b5e2-4e09-8dd5-967c81a7710e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:48.206574 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-33a070d3-b5e2-4e09-8dd5-967c81a7710e None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:53:48.207770 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-33a070d3-b5e2-4e09-8dd5-967c81a7710e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:53:48.285699 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 11/23] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:53:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:53:48.320106 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4c059-a22f-46d5-b287-86d9e81a4b03 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:48.438535 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4c059-a22f-46d5-b287-86d9e81a4b03 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:48.478917 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7706f3-b5c6-466a-8f3c-6885bb8dd7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:48.480110 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7706f3-b5c6-466a-8f3c-6885bb8dd7d9 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:48.480591 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7706f3-b5c6-466a-8f3c-6885bb8dd7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:48.481160 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7706f3-b5c6-466a-8f3c-6885bb8dd7d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:48.495973 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7706f3-b5c6-466a-8f3c-6885bb8dd7d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:53:48.503984 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-2e7706f3-b5c6-466a-8f3c-6885bb8dd7d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:53:48.503984 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:53:48.503984 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:53:48.503984 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:53:48.503984 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:53:48.503984 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:53:48.503984 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:53:48.503984 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:53:48.503984 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:53:48.503984 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:53:48.503984 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:53:48.503984 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:53:48.503984 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:53:48.503984 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:53:48.503984 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:53:48.503984 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:53:48.504813 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:53:48.504813 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:53:48.504813 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:53:48.504813 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:53:48.504813 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:53:48.504813 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:53:48.504813 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:53:48.504813 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:53:48.504813 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:53:48.504813 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:53:48.504813 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:53:48.504813 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:53:48.504813 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:53:48.504813 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:53:48.504813 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:53:48.504813 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:53:48.505580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:53:48.505580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:53:48.505580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:53:48.505580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:53:48.505580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:53:48.505580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:53:48.505580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:53:48.505580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:53:48.505580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:53:48.505580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:53:48.505580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:53:48.505580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:53:48.508295 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 13/24] 10.222.0.24 () {56 vars in 1096 bytes} [Mon May 16 18:53:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:53:48.514091 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a070d3-b5e2-4e09-8dd5-967c81a7710e None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:48.624690 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93af51-1d5b-4a71-a965-67ce45497f7d None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:48.625335 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93af51-1d5b-4a71-a965-67ce45497f7d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:48.625869 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93af51-1d5b-4a71-a965-67ce45497f7d None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:48.628941 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 14/25] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:53:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:53:48.641399 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9bc821-49f5-41dc-bc69-af148c6584a2 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:48.641722 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9bc821-49f5-41dc-bc69-af148c6584a2 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:48.641984 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9bc821-49f5-41dc-bc69-af148c6584a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:48.670975 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a070d3-b5e2-4e09-8dd5-967c81a7710e None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:48.678768 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-dc9bc821-49f5-41dc-bc69-af148c6584a2 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:53:48.680034 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-dc9bc821-49f5-41dc-bc69-af148c6584a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:53:48.714389 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479ce79-29a0-4f7a-bdba-dd5817e52c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:48.715367 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479ce79-29a0-4f7a-bdba-dd5817e52c4c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:48.715655 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479ce79-29a0-4f7a-bdba-dd5817e52c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:48.715925 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479ce79-29a0-4f7a-bdba-dd5817e52c4c None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:48.716692 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479ce79-29a0-4f7a-bdba-dd5817e52c4c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:53:48.716995 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479ce79-29a0-4f7a-bdba-dd5817e52c4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:53:48.718449 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479ce79-29a0-4f7a-bdba-dd5817e52c4c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:53:48.735295 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 12/26] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:53:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:53:48.742036 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479ce79-29a0-4f7a-bdba-dd5817e52c4c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:48.844474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 15/27] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:53:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:53:48.846568 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479ce79-29a0-4f7a-bdba-dd5817e52c4c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:48.884174 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9bc821-49f5-41dc-bc69-af148c6584a2 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:48.884770 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ddbf7e-612e-469c-b1e1-b0fee08f0fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:48.885712 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddbf7e-612e-469c-b1e1-b0fee08f0fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:48.885998 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddbf7e-612e-469c-b1e1-b0fee08f0fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:48.886276 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddbf7e-612e-469c-b1e1-b0fee08f0fc3 None admin] PATH_INFO: `/v3/users/e70b26bfebd8410b8d3b2aa16cacd530` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:48.890409 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ddbf7e-612e-469c-b1e1-b0fee08f0fc3 None admin] RBAC: Authorizing `identity:get_user(user_id=e70b26bfebd8410b8d3b2aa16cacd530)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:53:48.891942 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ddbf7e-612e-469c-b1e1-b0fee08f0fc3 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:53:48.894160 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 13/28] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:53:48 2022] GET /identity/v3/users/e70b26bfebd8410b8d3b2aa16cacd530 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:53:48.901689 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ddbf7e-612e-469c-b1e1-b0fee08f0fc3 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:49.065253 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ddbf7e-612e-469c-b1e1-b0fee08f0fc3 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:49.088664 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9bc821-49f5-41dc-bc69-af148c6584a2 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:49.133236 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2ec36-52b5-4e0a-9c02-4eba89ad160a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:49.134097 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2ec36-52b5-4e0a-9c02-4eba89ad160a None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:49.134374 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2ec36-52b5-4e0a-9c02-4eba89ad160a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:49.134650 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2ec36-52b5-4e0a-9c02-4eba89ad160a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:49.135922 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2ec36-52b5-4e0a-9c02-4eba89ad160a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:53:49.137563 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2ec36-52b5-4e0a-9c02-4eba89ad160a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:53:49.139482 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 14/29] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:53:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:53:49.140427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c18917-d71a-49b7-a5a3-febcc3c8d96f None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:49.140714 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c18917-d71a-49b7-a5a3-febcc3c8d96f None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:49.140994 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c18917-d71a-49b7-a5a3-febcc3c8d96f None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:49.142565 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 15/30] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:53:49.144604 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c18917-d71a-49b7-a5a3-febcc3c8d96f None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:49.161853 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a6695-b5c8-4f9b-acdd-a75f5368c528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:49.162695 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a6695-b5c8-4f9b-acdd-a75f5368c528 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:49.162973 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a6695-b5c8-4f9b-acdd-a75f5368c528 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:49.163245 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a6695-b5c8-4f9b-acdd-a75f5368c528 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:49.181021 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a6695-b5c8-4f9b-acdd-a75f5368c528 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:53:49.182560 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a6695-b5c8-4f9b-acdd-a75f5368c528 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:53:49.216957 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-211a6695-b5c8-4f9b-acdd-a75f5368c528 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:53:49.216957 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:53:49.216957 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:53:49.216957 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:53:49.216957 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:53:49.216957 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:53:49.216957 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:53:49.216957 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:53:49.216957 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:53:49.216957 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:53:49.216957 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:53:49.216957 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:53:49.216957 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:53:49.216957 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:53:49.216957 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:53:49.218039 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:53:49.218039 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:53:49.218039 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:53:49.218039 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:53:49.218039 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:53:49.218039 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:53:49.218039 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:53:49.218039 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:53:49.218039 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:53:49.218039 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:53:49.218039 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:53:49.218039 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:53:49.218039 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:53:49.218039 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:53:49.218039 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:53:49.218039 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:53:49.218039 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:53:49.219024 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:53:49.219024 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:53:49.219024 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:53:49.219024 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:53:49.220925 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 16/31] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:53:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:53:49.222475 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b18a8e-8779-43d2-aa97-29c3689ede5f None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:49.222933 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b18a8e-8779-43d2-aa97-29c3689ede5f None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:49.223398 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b18a8e-8779-43d2-aa97-29c3689ede5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:49.250337 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-a7b18a8e-8779-43d2-aa97-29c3689ede5f None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:53:49.253515 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a7b18a8e-8779-43d2-aa97-29c3689ede5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:53:49.329205 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c18917-d71a-49b7-a5a3-febcc3c8d96f None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:49.351582 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 17/32] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:53:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:53:49.352731 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b18a8e-8779-43d2-aa97-29c3689ede5f None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:49.383179 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e17e77-6132-4ff0-b784-422dff3fcc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:49.383987 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e17e77-6132-4ff0-b784-422dff3fcc42 None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:49.384316 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e17e77-6132-4ff0-b784-422dff3fcc42 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:49.384531 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e17e77-6132-4ff0-b784-422dff3fcc42 None admin] PATH_INFO: `/v3/domains/default/users/e70b26bfebd8410b8d3b2aa16cacd530/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:49.386659 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e17e77-6132-4ff0-b784-422dff3fcc42 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=e70b26bfebd8410b8d3b2aa16cacd530, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:53:49.388244 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e17e77-6132-4ff0-b784-422dff3fcc42 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:53:49.460695 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b18a8e-8779-43d2-aa97-29c3689ede5f None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:49.500697 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8baa4d-705a-40c9-9fca-9a8bfaca81d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:49.501390 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8baa4d-705a-40c9-9fca-9a8bfaca81d7 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:49.501703 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8baa4d-705a-40c9-9fca-9a8bfaca81d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:49.501975 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8baa4d-705a-40c9-9fca-9a8bfaca81d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:49.502704 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8baa4d-705a-40c9-9fca-9a8bfaca81d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:53:49.503061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8baa4d-705a-40c9-9fca-9a8bfaca81d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:53:49.504513 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8baa4d-705a-40c9-9fca-9a8bfaca81d7 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:53:49.522660 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 18/33] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:53:49.524435 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a1e8a-f5a7-4ac7-8aed-2313f2939899 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:49.524723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a1e8a-f5a7-4ac7-8aed-2313f2939899 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:49.524995 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a1e8a-f5a7-4ac7-8aed-2313f2939899 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:49.526258 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 19/34] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:53:49.526991 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a1e8a-f5a7-4ac7-8aed-2313f2939899 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:49.536782 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 16/35] 10.222.0.24 () {58 vars in 1361 bytes} [Mon May 16 18:53:49 2022] PUT /identity/v3/domains/default/users/e70b26bfebd8410b8d3b2aa16cacd530/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:53:49.538342 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e17e77-6132-4ff0-b784-422dff3fcc42 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:49.637293 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a1e8a-f5a7-4ac7-8aed-2313f2939899 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:49.648633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e17e77-6132-4ff0-b784-422dff3fcc42 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:49.673367 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a5289-e895-4297-a32f-8c2ca32136a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:49.674091 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a5289-e895-4297-a32f-8c2ca32136a2 None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:49.674370 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a5289-e895-4297-a32f-8c2ca32136a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:49.674635 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a5289-e895-4297-a32f-8c2ca32136a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:49.675395 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a5289-e895-4297-a32f-8c2ca32136a2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:53:49.676898 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a5289-e895-4297-a32f-8c2ca32136a2 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:53:49.688523 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3331db-3a7b-46d6-91b9-de517e87cb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:49.689697 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3331db-3a7b-46d6-91b9-de517e87cb12 None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:49.690181 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3331db-3a7b-46d6-91b9-de517e87cb12 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:49.690701 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3331db-3a7b-46d6-91b9-de517e87cb12 None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:49.691672 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3331db-3a7b-46d6-91b9-de517e87cb12 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:53:49.693652 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3331db-3a7b-46d6-91b9-de517e87cb12 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:53:49.737032 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 17/36] 10.222.0.24 () {60 vars in 1141 bytes} [Mon May 16 18:53:49 2022] POST /identity/v3/projects => generated 301 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:53:49.738886 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a512d4-6cd7-4927-932d-af9009a6831c None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:49.739442 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a512d4-6cd7-4927-932d-af9009a6831c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:49.739962 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a512d4-6cd7-4927-932d-af9009a6831c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:49.786171 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-57a512d4-6cd7-4927-932d-af9009a6831c None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:53:49.788199 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-57a512d4-6cd7-4927-932d-af9009a6831c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:53:49.880450 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 20/37] 10.222.0.24 () {60 vars in 1131 bytes} [Mon May 16 18:53:49 2022] POST /identity/v3/roles => generated 219 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:53:49.904037 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 18/38] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:53:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:53:49.938152 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a5289-e895-4297-a32f-8c2ca32136a2 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:50.035582 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54117b48-d3b0-4fab-ae4b-3061704e04dc None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:50.035582 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54117b48-d3b0-4fab-ae4b-3061704e04dc None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:50.035999 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54117b48-d3b0-4fab-ae4b-3061704e04dc None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:50.037782 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 19/39] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:53:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:53:50.045767 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b67420-e438-4587-8bec-7c63de530ee7 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:50.046236 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b67420-e438-4587-8bec-7c63de530ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:50.046592 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b67420-e438-4587-8bec-7c63de530ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:50.068208 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a5289-e895-4297-a32f-8c2ca32136a2 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:50.077338 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-a5b67420-e438-4587-8bec-7c63de530ee7 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:53:50.078579 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a5b67420-e438-4587-8bec-7c63de530ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:53:50.104926 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d2110d-7494-478a-be04-14a60219afd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:50.105734 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2110d-7494-478a-be04-14a60219afd0 None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:50.106051 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2110d-7494-478a-be04-14a60219afd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:50.106329 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2110d-7494-478a-be04-14a60219afd0 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:50.107118 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d2110d-7494-478a-be04-14a60219afd0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:53:50.108702 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d2110d-7494-478a-be04-14a60219afd0 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:53:50.139653 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 21/40] 10.222.0.24 () {60 vars in 1131 bytes} [Mon May 16 18:53:49 2022] POST /identity/v3/roles => generated 225 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:53:50.141929 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445c363-a572-432c-89be-9205f4b3f3d5 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:50.142222 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445c363-a572-432c-89be-9205f4b3f3d5 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:50.142505 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445c363-a572-432c-89be-9205f4b3f3d5 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:50.143851 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 22/41] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:53:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:53:50.155286 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fce077-47d3-45c4-b325-2e0ad0f8205b None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:50.155571 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fce077-47d3-45c4-b325-2e0ad0f8205b None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:50.155767 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fce077-47d3-45c4-b325-2e0ad0f8205b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:50.194281 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 20/42] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:53:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:53:50.198960 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-55fce077-47d3-45c4-b325-2e0ad0f8205b None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:53:50.200630 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-55fce077-47d3-45c4-b325-2e0ad0f8205b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:53:50.221978 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b67420-e438-4587-8bec-7c63de530ee7 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:50.283696 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 23/43] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:53:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:53:50.306376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fce077-47d3-45c4-b325-2e0ad0f8205b None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:50.333588 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b67420-e438-4587-8bec-7c63de530ee7 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:50.369719 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b053d2a-c1ed-46cd-a886-8e965b1792fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:50.370623 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b053d2a-c1ed-46cd-a886-8e965b1792fd None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:50.370902 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b053d2a-c1ed-46cd-a886-8e965b1792fd None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:50.371359 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b053d2a-c1ed-46cd-a886-8e965b1792fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:50.373181 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b053d2a-c1ed-46cd-a886-8e965b1792fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:53:50.375270 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b053d2a-c1ed-46cd-a886-8e965b1792fd None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:53:50.377994 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 21/44] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:53:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:53:50.383958 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b053d2a-c1ed-46cd-a886-8e965b1792fd None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:50.410633 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fce077-47d3-45c4-b325-2e0ad0f8205b None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:50.451786 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc59f06-f593-4c66-beda-9cb9dc3e262b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:50.452952 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc59f06-f593-4c66-beda-9cb9dc3e262b None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:50.453459 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc59f06-f593-4c66-beda-9cb9dc3e262b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:50.453955 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc59f06-f593-4c66-beda-9cb9dc3e262b None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:50.455226 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc59f06-f593-4c66-beda-9cb9dc3e262b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:53:50.457574 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc59f06-f593-4c66-beda-9cb9dc3e262b None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:53:50.474468 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 24/45] 10.222.0.24 () {60 vars in 1131 bytes} [Mon May 16 18:53:50 2022] POST /identity/v3/roles => generated 223 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:53:50.491415 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b053d2a-c1ed-46cd-a886-8e965b1792fd None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:50.531661 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48df1c8-c0ef-4168-be01-c62c5b834619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:50.532341 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48df1c8-c0ef-4168-be01-c62c5b834619 None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:50.532619 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48df1c8-c0ef-4168-be01-c62c5b834619 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:50.533181 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48df1c8-c0ef-4168-be01-c62c5b834619 None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:50.533975 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48df1c8-c0ef-4168-be01-c62c5b834619 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:53:50.535475 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48df1c8-c0ef-4168-be01-c62c5b834619 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:53:50.569571 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 22/46] 10.222.0.24 () {60 vars in 1141 bytes} [Mon May 16 18:53:50 2022] POST /identity/v3/projects => generated 312 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:53:52.118614 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74d2e1-ea85-448d-ae7f-f2b5afb3291a None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:52.119194 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74d2e1-ea85-448d-ae7f-f2b5afb3291a None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:52.119194 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74d2e1-ea85-448d-ae7f-f2b5afb3291a None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:52.120683 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 25/47] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:53:52.126330 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50a75b-2e3f-4f92-9687-78e15ad77b8f None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:52.126749 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50a75b-2e3f-4f92-9687-78e15ad77b8f None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:52.126829 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50a75b-2e3f-4f92-9687-78e15ad77b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:52.143635 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-0c50a75b-2e3f-4f92-9687-78e15ad77b8f None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:53:52.144792 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0c50a75b-2e3f-4f92-9687-78e15ad77b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:53:52.209908 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 23/48] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:53:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:53:52.233178 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74d2e1-ea85-448d-ae7f-f2b5afb3291a None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:52.338369 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74d2e1-ea85-448d-ae7f-f2b5afb3291a None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:52.372097 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4988a8-926f-4503-ad4c-0ed54bcf5869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:52.372835 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4988a8-926f-4503-ad4c-0ed54bcf5869 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:52.373126 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4988a8-926f-4503-ad4c-0ed54bcf5869 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:52.373399 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4988a8-926f-4503-ad4c-0ed54bcf5869 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:52.383761 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4988a8-926f-4503-ad4c-0ed54bcf5869 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:53:52.391907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-6b4988a8-926f-4503-ad4c-0ed54bcf5869 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:53:52.391907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:53:52.391907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:53:52.391907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:53:52.391907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:53:52.391907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:53:52.391907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:53:52.391907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:53:52.391907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:53:52.391907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:53:52.391907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:53:52.391907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:53:52.391907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:53:52.391907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:53:52.391907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:53:52.391907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:53:52.392980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:53:52.392980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:53:52.392980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:53:52.392980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:53:52.392980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:53:52.392980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:53:52.392980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:53:52.392980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:53:52.392980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:53:52.392980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:53:52.392980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:53:52.392980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:53:52.392980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:53:52.392980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:53:52.392980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:53:52.392980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:53:52.393887 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:53:52.393887 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:53:52.393887 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:53:52.393887 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:53:52.393887 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:53:52.393887 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:53:52.393887 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:53:52.393887 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:53:52.393887 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:53:52.393887 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:53:52.393887 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:53:52.393887 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:53:52.393887 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 26/49] 10.222.0.24 () {56 vars in 1096 bytes} [Mon May 16 18:53:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:53:52.399178 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50a75b-2e3f-4f92-9687-78e15ad77b8f None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:52.498279 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50a75b-2e3f-4f92-9687-78e15ad77b8f None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:52.532274 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae4eba-3260-4419-81c7-2d3b0557148f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:52.532939 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae4eba-3260-4419-81c7-2d3b0557148f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:52.533215 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae4eba-3260-4419-81c7-2d3b0557148f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:52.533483 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae4eba-3260-4419-81c7-2d3b0557148f None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:52.534268 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae4eba-3260-4419-81c7-2d3b0557148f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:53:52.534566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae4eba-3260-4419-81c7-2d3b0557148f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:53:52.535986 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae4eba-3260-4419-81c7-2d3b0557148f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:53:52.544401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 24/50] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:53:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:53:52.550264 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4988a8-926f-4503-ad4c-0ed54bcf5869 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:52.652890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4988a8-926f-4503-ad4c-0ed54bcf5869 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:52.686687 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20f8bf-d61e-4908-b140-87df99d5e6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:52.687577 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20f8bf-d61e-4908-b140-87df99d5e6b2 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:52.687856 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20f8bf-d61e-4908-b140-87df99d5e6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:52.688127 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20f8bf-d61e-4908-b140-87df99d5e6b2 None admin] PATH_INFO: `/v3/users/e70b26bfebd8410b8d3b2aa16cacd530` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:52.689367 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20f8bf-d61e-4908-b140-87df99d5e6b2 None admin] RBAC: Authorizing `identity:get_user(user_id=e70b26bfebd8410b8d3b2aa16cacd530)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:53:52.690876 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20f8bf-d61e-4908-b140-87df99d5e6b2 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:53:52.692531 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 27/51] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:53:52 2022] GET /identity/v3/users/e70b26bfebd8410b8d3b2aa16cacd530 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:53:52.698315 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae4eba-3260-4419-81c7-2d3b0557148f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:52.788166 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e56abb-6bcc-4a1a-aaac-a7e44783658b None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:52.788513 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e56abb-6bcc-4a1a-aaac-a7e44783658b None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:52.789344 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e56abb-6bcc-4a1a-aaac-a7e44783658b None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:52.791368 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 28/52] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:53:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:53:52.797885 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06296347-012b-4cd1-9237-902bd9d7081a None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:52.798151 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06296347-012b-4cd1-9237-902bd9d7081a None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:52.798429 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06296347-012b-4cd1-9237-902bd9d7081a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:52.810092 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae4eba-3260-4419-81c7-2d3b0557148f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:52.815577 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-06296347-012b-4cd1-9237-902bd9d7081a None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:53:52.816767 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-06296347-012b-4cd1-9237-902bd9d7081a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:53:52.843097 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a4e98-0540-4ad2-9775-187ccc689e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:52.843902 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a4e98-0540-4ad2-9775-187ccc689e76 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:52.844182 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a4e98-0540-4ad2-9775-187ccc689e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:52.844432 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a4e98-0540-4ad2-9775-187ccc689e76 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:52.845686 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507a4e98-0540-4ad2-9775-187ccc689e76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:53:52.847109 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507a4e98-0540-4ad2-9775-187ccc689e76 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:53:52.848739 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 25/53] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:53:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:53:52.854576 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a4e98-0540-4ad2-9775-187ccc689e76 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:52.880783 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 29/54] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:53:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:53:52.903929 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06296347-012b-4cd1-9237-902bd9d7081a None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:52.949343 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a4e98-0540-4ad2-9775-187ccc689e76 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:52.981687 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c42da-6d54-45d6-9746-1bab8307b167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:52.982351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c42da-6d54-45d6-9746-1bab8307b167 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:52.982634 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c42da-6d54-45d6-9746-1bab8307b167 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:52.982908 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c42da-6d54-45d6-9746-1bab8307b167 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:52.983744 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81c42da-6d54-45d6-9746-1bab8307b167 None admin] RBAC: Adding query filter params (role.id=5a6e54e81bb24eceb618d9ffa67f488e, scope.domain.id=default, user.id=e70b26bfebd8410b8d3b2aa16cacd530) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:53:52.984056 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81c42da-6d54-45d6-9746-1bab8307b167 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:53:52.985498 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81c42da-6d54-45d6-9746-1bab8307b167 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:53:52.993305 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 26/55] 10.222.0.24 () {56 vars in 1322 bytes} [Mon May 16 18:53:52 2022] GET /identity/v3/role_assignments?user.id=e70b26bfebd8410b8d3b2aa16cacd530&scope.domain.id=default&role.id=5a6e54e81bb24eceb618d9ffa67f488e => generated 530 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:53:52.998966 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06296347-012b-4cd1-9237-902bd9d7081a None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:53.036812 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74481da-dd4e-4252-9c23-2b18a22e0bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:53.037687 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74481da-dd4e-4252-9c23-2b18a22e0bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:53.037963 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74481da-dd4e-4252-9c23-2b18a22e0bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:53.038236 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74481da-dd4e-4252-9c23-2b18a22e0bf7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:53.039895 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74481da-dd4e-4252-9c23-2b18a22e0bf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:53:53.041407 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74481da-dd4e-4252-9c23-2b18a22e0bf7 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:53:53.043096 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 30/56] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:53:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:53:53.049203 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c42da-6d54-45d6-9746-1bab8307b167 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:53.158636 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c42da-6d54-45d6-9746-1bab8307b167 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:53.195485 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1474aa-4f27-4d53-9ff2-faf0292f5fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:53.196134 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1474aa-4f27-4d53-9ff2-faf0292f5fbb None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:53.196414 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1474aa-4f27-4d53-9ff2-faf0292f5fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:53.196690 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1474aa-4f27-4d53-9ff2-faf0292f5fbb None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:53.197413 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1474aa-4f27-4d53-9ff2-faf0292f5fbb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:53:53.198922 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1474aa-4f27-4d53-9ff2-faf0292f5fbb None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:53:53.226856 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 27/57] 10.222.0.24 () {60 vars in 1140 bytes} [Mon May 16 18:53:53 2022] POST /identity/v3/projects => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:53:55.438288 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef07e3-a05f-4357-b57f-17216e96a0d5 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:55.438806 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef07e3-a05f-4357-b57f-17216e96a0d5 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:55.438806 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef07e3-a05f-4357-b57f-17216e96a0d5 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:55.440136 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 31/58] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:53:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:53:55.446652 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b94076-91f9-48aa-80c5-96848e98a9d7 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:55.447318 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b94076-91f9-48aa-80c5-96848e98a9d7 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:55.447615 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b94076-91f9-48aa-80c5-96848e98a9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:55.471394 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-f7b94076-91f9-48aa-80c5-96848e98a9d7 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:53:55.472621 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f7b94076-91f9-48aa-80c5-96848e98a9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:53:55.545146 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 28/59] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:53:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:53:55.578113 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef07e3-a05f-4357-b57f-17216e96a0d5 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:55.694155 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef07e3-a05f-4357-b57f-17216e96a0d5 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:55.731848 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112982e-db80-4f46-92a8-fac2470d0305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:55.732636 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112982e-db80-4f46-92a8-fac2470d0305 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:55.732922 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112982e-db80-4f46-92a8-fac2470d0305 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:55.733193 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112982e-db80-4f46-92a8-fac2470d0305 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:55.734461 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112982e-db80-4f46-92a8-fac2470d0305 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:53:55.735939 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112982e-db80-4f46-92a8-fac2470d0305 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:53:55.737559 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 32/60] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:53:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:53:55.743668 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b94076-91f9-48aa-80c5-96848e98a9d7 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:55.848916 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b94076-91f9-48aa-80c5-96848e98a9d7 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:55.882281 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d20920-be74-4866-b090-ef181a0746f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:55.882935 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d20920-be74-4866-b090-ef181a0746f8 None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:55.883213 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d20920-be74-4866-b090-ef181a0746f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:55.883483 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d20920-be74-4866-b090-ef181a0746f8 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:55.884200 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d20920-be74-4866-b090-ef181a0746f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:53:55.885673 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d20920-be74-4866-b090-ef181a0746f8 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:53:55.919089 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 29/61] 10.222.0.24 () {60 vars in 1132 bytes} [Mon May 16 18:53:55 2022] POST /identity/v3/users => generated 275 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:53:59.226174 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6af7cd-bd7e-470b-8407-33580ab22fd2 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:59.227184 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6af7cd-bd7e-470b-8407-33580ab22fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:59.227694 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6af7cd-bd7e-470b-8407-33580ab22fd2 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:59.229292 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 33/62] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:53:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:53:59.235401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc23bd0-caf4-4338-b726-cbb71f44eca1 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:59.235894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc23bd0-caf4-4338-b726-cbb71f44eca1 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:59.235966 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc23bd0-caf4-4338-b726-cbb71f44eca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:59.257874 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-3fc23bd0-caf4-4338-b726-cbb71f44eca1 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:53:59.259123 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3fc23bd0-caf4-4338-b726-cbb71f44eca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:53:59.343154 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 30/63] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:53:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:53:59.376169 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6af7cd-bd7e-470b-8407-33580ab22fd2 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:59.522014 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6af7cd-bd7e-470b-8407-33580ab22fd2 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:59.548276 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1a75b-c7cf-4f80-9cea-afa81367192f None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:59.548903 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1a75b-c7cf-4f80-9cea-afa81367192f None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:59.549372 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1a75b-c7cf-4f80-9cea-afa81367192f None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:59.551058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 31/64] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:53:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:53:59.558082 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3028ce8-f33d-4b1e-aa19-68940d7da9af None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:59.559081 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3028ce8-f33d-4b1e-aa19-68940d7da9af None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:59.560498 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3028ce8-f33d-4b1e-aa19-68940d7da9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:59.586684 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db1b10-4850-4d3a-99ca-e903460a3de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:59.587815 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db1b10-4850-4d3a-99ca-e903460a3de4 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:59.588267 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db1b10-4850-4d3a-99ca-e903460a3de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:59.588740 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db1b10-4850-4d3a-99ca-e903460a3de4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:59.593377 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-f3028ce8-f33d-4b1e-aa19-68940d7da9af None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:53:59.596712 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f3028ce8-f33d-4b1e-aa19-68940d7da9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:53:59.605543 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db1b10-4850-4d3a-99ca-e903460a3de4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:53:59.615842 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-b2db1b10-4850-4d3a-99ca-e903460a3de4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 18:53:59.615842 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:53:59.615842 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:53:59.615842 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:53:59.615842 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:53:59.615842 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:53:59.615842 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:53:59.615842 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:53:59.615842 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:53:59.615842 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:53:59.615842 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:53:59.615842 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:53:59.615842 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:53:59.615842 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:53:59.615842 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:53:59.615842 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:53:59.616723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:53:59.616723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:53:59.616723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:53:59.616723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:53:59.616723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:53:59.616723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:53:59.616723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:53:59.616723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:53:59.616723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:53:59.616723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:53:59.616723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:53:59.616723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:53:59.616723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:53:59.616723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:53:59.616723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:53:59.616723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:53:59.617595 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:53:59.617595 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:53:59.617595 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:53:59.617595 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:53:59.617595 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:53:59.617595 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:53:59.617595 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:53:59.617595 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:53:59.617595 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:53:59.617595 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:53:59.617595 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 18:53:59.617595 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:53:59.617595 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 34/65] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:53:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:53:59.618479 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44c70c-9706-436a-a4aa-a8704655330c None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:59.618908 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44c70c-9706-436a-a4aa-a8704655330c None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:59.619359 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44c70c-9706-436a-a4aa-a8704655330c None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:59.621028 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 35/66] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:53:59.627411 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44c70c-9706-436a-a4aa-a8704655330c None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:59.675875 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 32/67] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:53:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:53:59.682166 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41a89c-2d5d-4b7f-86a3-2434d584f1dd None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:59.682166 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41a89c-2d5d-4b7f-86a3-2434d584f1dd None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:59.682166 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41a89c-2d5d-4b7f-86a3-2434d584f1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:59.708073 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-5b41a89c-2d5d-4b7f-86a3-2434d584f1dd None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:53:59.709263 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5b41a89c-2d5d-4b7f-86a3-2434d584f1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:53:59.755772 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44c70c-9706-436a-a4aa-a8704655330c None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:59.773915 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 33/68] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:53:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:53:59.774995 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41a89c-2d5d-4b7f-86a3-2434d584f1dd None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:59.800878 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cab011-952f-40dd-9717-b5154e79e617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:59.802678 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cab011-952f-40dd-9717-b5154e79e617 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:59.802974 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cab011-952f-40dd-9717-b5154e79e617 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:59.803372 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cab011-952f-40dd-9717-b5154e79e617 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:59.804648 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cab011-952f-40dd-9717-b5154e79e617 None admin] RBAC: Adding query filter params (name=member) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:53:59.805324 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cab011-952f-40dd-9717-b5154e79e617 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:53:59.806934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cab011-952f-40dd-9717-b5154e79e617 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:53:59.817346 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 36/69] 10.222.0.24 () {56 vars in 1101 bytes} [Mon May 16 18:53:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:53:59.818540 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6ba5c-590a-4188-bf3c-a2f2c78c6424 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:59.818830 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6ba5c-590a-4188-bf3c-a2f2c78c6424 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:59.819112 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6ba5c-590a-4188-bf3c-a2f2c78c6424 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:59.820573 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 37/70] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:53:59.825152 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a6ba5c-590a-4188-bf3c-a2f2c78c6424 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:59.899917 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41a89c-2d5d-4b7f-86a3-2434d584f1dd None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:59.926693 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a6ba5c-590a-4188-bf3c-a2f2c78c6424 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:59.937562 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d4178-74c8-4690-a3b4-0a61011ef68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:59.938677 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d4178-74c8-4690-a3b4-0a61011ef68c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:59.938963 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d4178-74c8-4690-a3b4-0a61011ef68c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:59.939240 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d4178-74c8-4690-a3b4-0a61011ef68c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:59.959345 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d4178-74c8-4690-a3b4-0a61011ef68c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:53:59.965779 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7199121-103a-4d36-bb90-d997974543c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:59.966607 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7199121-103a-4d36-bb90-d997974543c8 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:59.966893 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7199121-103a-4d36-bb90-d997974543c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:59.967168 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7199121-103a-4d36-bb90-d997974543c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:59.968995 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-742d4178-74c8-4690-a3b4-0a61011ef68c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:53:59.968995 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:53:59.968995 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:53:59.968995 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:53:59.968995 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:53:59.968995 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:53:59.968995 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:53:59.968995 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:53:59.968995 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:53:59.968995 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:53:59.968995 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:53:59.968995 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:53:59.968995 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:53:59.968995 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:53:59.968995 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:53:59.968995 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:53:59.969848 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:53:59.969848 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:53:59.969848 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:53:59.969848 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:53:59.969848 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:53:59.969848 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:53:59.969848 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:53:59.969848 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:53:59.969848 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:53:59.969848 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:53:59.969848 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:53:59.969848 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:53:59.969848 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:53:59.969848 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:53:59.969848 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:53:59.969848 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:53:59.970570 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:53:59.970570 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:53:59.970570 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:53:59.970570 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:53:59.970570 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:53:59.970570 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:53:59.970570 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:53:59.970570 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:53:59.970570 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:53:59.970570 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:53:59.970570 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:53:59.970570 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:53:59.970570 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 34/71] 10.222.0.24 () {56 vars in 1114 bytes} [Mon May 16 18:53:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:53:59.971200 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d4178-74c8-4690-a3b4-0a61011ef68c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:59.978420 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7199121-103a-4d36-bb90-d997974543c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:53:59.986162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-a7199121-103a-4d36-bb90-d997974543c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:53:59.986162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:53:59.986162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:53:59.986162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:53:59.986162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:53:59.986162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:53:59.986162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:53:59.986162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:53:59.986162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:53:59.986162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:53:59.986162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:53:59.986162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:53:59.986162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:53:59.986162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:53:59.986162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:53:59.986162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:53:59.987184 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:53:59.987184 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:53:59.987184 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:53:59.987184 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:53:59.987184 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:53:59.987184 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:53:59.987184 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:53:59.987184 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:53:59.987184 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:53:59.987184 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:53:59.987184 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:53:59.987184 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:53:59.987184 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:53:59.987184 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:53:59.987184 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:53:59.987184 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:53:59.988537 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:53:59.988537 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:53:59.988537 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:53:59.988537 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:53:59.988537 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:53:59.988537 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:53:59.988537 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:53:59.988537 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:53:59.988537 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:53:59.988537 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:53:59.988537 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:53:59.988537 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:53:59.988537 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 38/72] 10.222.0.24 () {56 vars in 1096 bytes} [Mon May 16 18:53:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:53:59.988537 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bac46-412a-4864-a110-cea9aa3f4a73 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:59.989193 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bac46-412a-4864-a110-cea9aa3f4a73 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:59.989193 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bac46-412a-4864-a110-cea9aa3f4a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:00.004873 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-820bac46-412a-4864-a110-cea9aa3f4a73 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:00.006064 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-820bac46-412a-4864-a110-cea9aa3f4a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:00.068053 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 39/73] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:53:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:54:00.068771 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820bac46-412a-4864-a110-cea9aa3f4a73 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:00.073888 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d4178-74c8-4690-a3b4-0a61011ef68c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:00.106563 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb61daf-6c82-490d-a8b1-a4cbc0111b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:00.107442 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb61daf-6c82-490d-a8b1-a4cbc0111b7a None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:00.107726 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb61daf-6c82-490d-a8b1-a4cbc0111b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:00.108003 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb61daf-6c82-490d-a8b1-a4cbc0111b7a None admin] PATH_INFO: `/v3/users/c200fe70b1474e1d9846532764b494ad` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:00.123412 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb61daf-6c82-490d-a8b1-a4cbc0111b7a None admin] RBAC: Authorizing `identity:get_user(user_id=c200fe70b1474e1d9846532764b494ad)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:00.124895 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb61daf-6c82-490d-a8b1-a4cbc0111b7a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:00.126644 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 35/74] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:53:59 2022] GET /identity/v3/users/c200fe70b1474e1d9846532764b494ad => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:00.127881 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b28475-9bbe-44ae-9995-7578de61903e None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:00.128163 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b28475-9bbe-44ae-9995-7578de61903e None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:00.128481 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b28475-9bbe-44ae-9995-7578de61903e None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:00.129660 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 36/75] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:00.131515 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b28475-9bbe-44ae-9995-7578de61903e None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:00.161976 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820bac46-412a-4864-a110-cea9aa3f4a73 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:00.194353 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286fa07-17c2-4bbf-a8cd-b72ec99071f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:00.195024 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286fa07-17c2-4bbf-a8cd-b72ec99071f5 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:00.195308 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286fa07-17c2-4bbf-a8cd-b72ec99071f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:00.195583 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286fa07-17c2-4bbf-a8cd-b72ec99071f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:00.196329 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286fa07-17c2-4bbf-a8cd-b72ec99071f5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:00.196639 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286fa07-17c2-4bbf-a8cd-b72ec99071f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:00.198083 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286fa07-17c2-4bbf-a8cd-b72ec99071f5 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:00.205796 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 40/76] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:54:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:00.206585 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286fa07-17c2-4bbf-a8cd-b72ec99071f5 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:00.235388 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b28475-9bbe-44ae-9995-7578de61903e None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:00.270434 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96757a-a031-4d0a-9a85-11cdb2ca23ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:00.271488 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96757a-a031-4d0a-9a85-11cdb2ca23ff None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:00.271836 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96757a-a031-4d0a-9a85-11cdb2ca23ff None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:00.272180 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96757a-a031-4d0a-9a85-11cdb2ca23ff None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:00.273075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b96757a-a031-4d0a-9a85-11cdb2ca23ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:00.273497 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b96757a-a031-4d0a-9a85-11cdb2ca23ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:00.275083 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b96757a-a031-4d0a-9a85-11cdb2ca23ff None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:00.283330 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 37/77] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:54:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:00.284127 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96757a-a031-4d0a-9a85-11cdb2ca23ff None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:00.303361 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286fa07-17c2-4bbf-a8cd-b72ec99071f5 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:00.338295 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739eced-74bc-4d87-9e3d-de5e94e6582b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:00.339041 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739eced-74bc-4d87-9e3d-de5e94e6582b None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:00.339325 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739eced-74bc-4d87-9e3d-de5e94e6582b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:00.339597 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739eced-74bc-4d87-9e3d-de5e94e6582b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:00.349639 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7739eced-74bc-4d87-9e3d-de5e94e6582b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:00.357410 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-7739eced-74bc-4d87-9e3d-de5e94e6582b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 18:54:00.357410 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:00.357410 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:00.357410 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:00.357410 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:00.357410 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:00.357410 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:00.357410 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:00.357410 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:00.357410 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:00.357410 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:00.357410 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:00.357410 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:00.357410 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:00.357410 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:00.357410 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:00.358317 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:00.358317 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:00.358317 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:00.358317 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:00.358317 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:00.358317 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:00.358317 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:00.358317 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:00.358317 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:00.358317 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:00.358317 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:00.358317 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:00.358317 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:00.358317 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:00.358317 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:00.358317 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:00.359061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:00.359061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:00.359061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:00.359061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:00.359061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:00.359061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:00.359061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:00.359061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:00.359061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:00.359061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:00.359061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 18:54:00.359061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:00.359061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 41/78] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:54:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:00.360112 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514bedf-9254-4412-b4ae-e7a8eda83a47 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:00.360429 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514bedf-9254-4412-b4ae-e7a8eda83a47 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:00.360710 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514bedf-9254-4412-b4ae-e7a8eda83a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:00.376658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-7514bedf-9254-4412-b4ae-e7a8eda83a47 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:00.377858 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-7514bedf-9254-4412-b4ae-e7a8eda83a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:00.381666 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96757a-a031-4d0a-9a85-11cdb2ca23ff None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:00.412826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6fc7af-f792-40ad-b183-93bb87942387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:00.413471 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6fc7af-f792-40ad-b183-93bb87942387 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:00.413788 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6fc7af-f792-40ad-b183-93bb87942387 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:00.414423 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6fc7af-f792-40ad-b183-93bb87942387 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:00.442353 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 42/79] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:54:00.450400 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514bedf-9254-4412-b4ae-e7a8eda83a47 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:00.477362 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6fc7af-f792-40ad-b183-93bb87942387 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:00.478891 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6fc7af-f792-40ad-b183-93bb87942387 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:00.543080 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514bedf-9254-4412-b4ae-e7a8eda83a47 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:00.570047 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 38/80] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:54:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:54:00.570992 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6fc7af-f792-40ad-b183-93bb87942387 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:00.579149 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434d401-19fd-43f1-8aad-5e45471f2dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:00.580050 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434d401-19fd-43f1-8aad-5e45471f2dac None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:00.580336 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434d401-19fd-43f1-8aad-5e45471f2dac None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:00.580609 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434d401-19fd-43f1-8aad-5e45471f2dac None admin] PATH_INFO: `/v3/users/c200fe70b1474e1d9846532764b494ad` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:00.581854 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434d401-19fd-43f1-8aad-5e45471f2dac None admin] RBAC: Authorizing `identity:get_user(user_id=c200fe70b1474e1d9846532764b494ad)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:00.583329 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434d401-19fd-43f1-8aad-5e45471f2dac None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:00.584972 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 43/81] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:54:00 2022] GET /identity/v3/users/c200fe70b1474e1d9846532764b494ad => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:00.585851 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434d401-19fd-43f1-8aad-5e45471f2dac None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:00.665814 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6fc7af-f792-40ad-b183-93bb87942387 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:00.684007 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434d401-19fd-43f1-8aad-5e45471f2dac None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:00.697178 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9af737-3a49-4fa3-90f8-1284b88a9a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:00.698102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9af737-3a49-4fa3-90f8-1284b88a9a56 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:00.698389 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9af737-3a49-4fa3-90f8-1284b88a9a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:00.698690 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9af737-3a49-4fa3-90f8-1284b88a9a56 None admin] PATH_INFO: `/v3/users/e70b26bfebd8410b8d3b2aa16cacd530` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:00.699925 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9af737-3a49-4fa3-90f8-1284b88a9a56 None admin] RBAC: Authorizing `identity:get_user(user_id=e70b26bfebd8410b8d3b2aa16cacd530)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:00.701400 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9af737-3a49-4fa3-90f8-1284b88a9a56 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:00.703088 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 39/82] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:54:00 2022] GET /identity/v3/users/e70b26bfebd8410b8d3b2aa16cacd530 => generated 247 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:00.703857 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9af737-3a49-4fa3-90f8-1284b88a9a56 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:00.721767 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634248a-b811-419d-a447-6c48c6fc3e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:00.722438 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634248a-b811-419d-a447-6c48c6fc3e7a None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:00.722719 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634248a-b811-419d-a447-6c48c6fc3e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:00.722991 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634248a-b811-419d-a447-6c48c6fc3e7a None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:00.723737 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9634248a-b811-419d-a447-6c48c6fc3e7a None admin] RBAC: Adding query filter params (name=member) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:00.724046 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9634248a-b811-419d-a447-6c48c6fc3e7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:00.725437 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9634248a-b811-419d-a447-6c48c6fc3e7a None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:00.733297 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 44/83] 10.222.0.24 () {56 vars in 1101 bytes} [Mon May 16 18:54:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:00.734416 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634248a-b811-419d-a447-6c48c6fc3e7a None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:00.797217 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9af737-3a49-4fa3-90f8-1284b88a9a56 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:00.825812 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634248a-b811-419d-a447-6c48c6fc3e7a None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:00.832198 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952e765-ed38-4e72-b87b-d341c1d90ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:00.832998 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952e765-ed38-4e72-b87b-d341c1d90ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:00.833274 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952e765-ed38-4e72-b87b-d341c1d90ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:00.833570 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952e765-ed38-4e72-b87b-d341c1d90ba8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:00.834812 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952e765-ed38-4e72-b87b-d341c1d90ba8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:00.836265 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952e765-ed38-4e72-b87b-d341c1d90ba8 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:00.837939 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 40/84] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:54:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:00.838712 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952e765-ed38-4e72-b87b-d341c1d90ba8 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:00.862067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6395be-d22a-47a9-8f0a-cb106f76ee8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:00.862944 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6395be-d22a-47a9-8f0a-cb106f76ee8e None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:00.863206 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6395be-d22a-47a9-8f0a-cb106f76ee8e None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:00.863485 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6395be-d22a-47a9-8f0a-cb106f76ee8e None admin] PATH_INFO: `/v3/projects/61523379bf5c40d6a32f35726b048037` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:00.864687 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6395be-d22a-47a9-8f0a-cb106f76ee8e None admin] RBAC: Authorizing `identity:get_project(project_id=61523379bf5c40d6a32f35726b048037)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:00.866206 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6395be-d22a-47a9-8f0a-cb106f76ee8e None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:00.867939 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 45/85] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:54:00 2022] GET /identity/v3/projects/61523379bf5c40d6a32f35726b048037 => generated 298 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:00.868706 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6395be-d22a-47a9-8f0a-cb106f76ee8e None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:00.939178 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952e765-ed38-4e72-b87b-d341c1d90ba8 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:00.962792 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6395be-d22a-47a9-8f0a-cb106f76ee8e None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:00.973734 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17b349-45ab-4429-9a01-b90c2b0be86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:00.974384 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17b349-45ab-4429-9a01-b90c2b0be86d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:00.974684 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17b349-45ab-4429-9a01-b90c2b0be86d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:00.974958 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17b349-45ab-4429-9a01-b90c2b0be86d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:00.994988 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916627c-d4b6-4598-bec1-4442bceae49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:00.995632 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916627c-d4b6-4598-bec1-4442bceae49d None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:00.995913 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916627c-d4b6-4598-bec1-4442bceae49d None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:00.996211 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916627c-d4b6-4598-bec1-4442bceae49d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:01.038190 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17b349-45ab-4429-9a01-b90c2b0be86d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:01.040030 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17b349-45ab-4429-9a01-b90c2b0be86d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:01.059890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b916627c-d4b6-4598-bec1-4442bceae49d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:01.061396 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b916627c-d4b6-4598-bec1-4442bceae49d None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:01.133335 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 41/86] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:54:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:54:01.138193 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17b349-45ab-4429-9a01-b90c2b0be86d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:01.158215 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 46/87] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:54:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:54:01.159336 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916627c-d4b6-4598-bec1-4442bceae49d None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:01.227612 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17b349-45ab-4429-9a01-b90c2b0be86d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:01.257886 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916627c-d4b6-4598-bec1-4442bceae49d None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:01.260963 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15878681-05df-4c12-bc82-2c88b4f49f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:01.261982 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15878681-05df-4c12-bc82-2c88b4f49f14 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:01.262268 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15878681-05df-4c12-bc82-2c88b4f49f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:01.262533 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15878681-05df-4c12-bc82-2c88b4f49f14 None admin] PATH_INFO: `/v3/users/c200fe70b1474e1d9846532764b494ad` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:01.263722 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15878681-05df-4c12-bc82-2c88b4f49f14 None admin] RBAC: Authorizing `identity:get_user(user_id=c200fe70b1474e1d9846532764b494ad)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:01.265199 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15878681-05df-4c12-bc82-2c88b4f49f14 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:01.266909 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 42/88] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:54:01 2022] GET /identity/v3/users/c200fe70b1474e1d9846532764b494ad => generated 275 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:01.267743 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15878681-05df-4c12-bc82-2c88b4f49f14 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:01.289454 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ca91e-29d3-4b25-9a6e-496dc860ff5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:01.290162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ca91e-29d3-4b25-9a6e-496dc860ff5c None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:01.290447 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ca91e-29d3-4b25-9a6e-496dc860ff5c None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:01.290726 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ca91e-29d3-4b25-9a6e-496dc860ff5c None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:01.291437 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ca91e-29d3-4b25-9a6e-496dc860ff5c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:01.292905 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ca91e-29d3-4b25-9a6e-496dc860ff5c None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:01.319238 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 47/89] 10.222.0.24 () {60 vars in 1132 bytes} [Mon May 16 18:54:01 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:54:01.320164 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ca91e-29d3-4b25-9a6e-496dc860ff5c None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:01.367340 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15878681-05df-4c12-bc82-2c88b4f49f14 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:01.401471 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fca29b-9ca3-449f-89a6-5839ffa53ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:01.402177 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fca29b-9ca3-449f-89a6-5839ffa53ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:01.402495 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fca29b-9ca3-449f-89a6-5839ffa53ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:01.402771 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fca29b-9ca3-449f-89a6-5839ffa53ac4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:01.403624 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fca29b-9ca3-449f-89a6-5839ffa53ac4 None admin] RBAC: Adding query filter params (role.id=b0e5c5e3b5f54789a5a5c4c51220c97e, scope.project.id=61523379bf5c40d6a32f35726b048037, user.id=c200fe70b1474e1d9846532764b494ad) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:01.403939 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fca29b-9ca3-449f-89a6-5839ffa53ac4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:01.405466 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fca29b-9ca3-449f-89a6-5839ffa53ac4 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:01.412045 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 43/90] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:54:01 2022] GET /identity/v3/role_assignments?user.id=c200fe70b1474e1d9846532764b494ad&scope.project.id=61523379bf5c40d6a32f35726b048037&role.id=b0e5c5e3b5f54789a5a5c4c51220c97e => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:01.413359 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fca29b-9ca3-449f-89a6-5839ffa53ac4 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:01.439343 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ca91e-29d3-4b25-9a6e-496dc860ff5c None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:01.478388 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a927c-cd30-4f0a-9f14-fcef228e8e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:01.479418 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a927c-cd30-4f0a-9f14-fcef228e8e40 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:01.479783 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a927c-cd30-4f0a-9f14-fcef228e8e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:01.480139 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a927c-cd30-4f0a-9f14-fcef228e8e40 None admin] PATH_INFO: `/v3/projects/61523379bf5c40d6a32f35726b048037` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:01.481736 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a927c-cd30-4f0a-9f14-fcef228e8e40 None admin] RBAC: Authorizing `identity:get_project(project_id=61523379bf5c40d6a32f35726b048037)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:01.483439 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a927c-cd30-4f0a-9f14-fcef228e8e40 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:01.485689 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 48/91] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:54:01 2022] GET /identity/v3/projects/61523379bf5c40d6a32f35726b048037 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:01.486728 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a927c-cd30-4f0a-9f14-fcef228e8e40 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:01.528060 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fca29b-9ca3-449f-89a6-5839ffa53ac4 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:01.570408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55ad6e-588a-4294-9f19-569a7b01371b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:01.571416 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55ad6e-588a-4294-9f19-569a7b01371b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:01.571729 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55ad6e-588a-4294-9f19-569a7b01371b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:01.572010 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55ad6e-588a-4294-9f19-569a7b01371b None admin] PATH_INFO: `/v3/projects/61523379bf5c40d6a32f35726b048037` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:01.573467 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55ad6e-588a-4294-9f19-569a7b01371b None admin] RBAC: Authorizing `identity:get_project(project_id=61523379bf5c40d6a32f35726b048037)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:01.575406 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55ad6e-588a-4294-9f19-569a7b01371b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:01.577510 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 44/92] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:54:01 2022] GET /identity/v3/projects/61523379bf5c40d6a32f35726b048037 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:01.579326 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55ad6e-588a-4294-9f19-569a7b01371b None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:01.617394 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a927c-cd30-4f0a-9f14-fcef228e8e40 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:01.655625 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d79a33-9341-4b4f-aa28-c6b00a56ec63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:01.656305 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d79a33-9341-4b4f-aa28-c6b00a56ec63 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:01.656591 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d79a33-9341-4b4f-aa28-c6b00a56ec63 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:01.656873 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d79a33-9341-4b4f-aa28-c6b00a56ec63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:01.690911 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55ad6e-588a-4294-9f19-569a7b01371b None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:01.733758 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa02e6-5906-45bb-b9ab-b7973fdad74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:01.733758 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa02e6-5906-45bb-b9ab-b7973fdad74a None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:01.734038 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa02e6-5906-45bb-b9ab-b7973fdad74a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:01.734199 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa02e6-5906-45bb-b9ab-b7973fdad74a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:01.735046 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa02e6-5906-45bb-b9ab-b7973fdad74a None admin] RBAC: Adding query filter params (role.id=fda97f4c5b1f4e1ba165f8dfa70ddbd6, scope.project.id=61523379bf5c40d6a32f35726b048037, user.id=c200fe70b1474e1d9846532764b494ad) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:01.736014 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa02e6-5906-45bb-b9ab-b7973fdad74a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:01.736123 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d79a33-9341-4b4f-aa28-c6b00a56ec63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:01.736827 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa02e6-5906-45bb-b9ab-b7973fdad74a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:01.737758 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d79a33-9341-4b4f-aa28-c6b00a56ec63 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:01.744726 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 45/93] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:54:01 2022] GET /identity/v3/role_assignments?user.id=c200fe70b1474e1d9846532764b494ad&scope.project.id=61523379bf5c40d6a32f35726b048037&role.id=fda97f4c5b1f4e1ba165f8dfa70ddbd6 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:01.745675 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa02e6-5906-45bb-b9ab-b7973fdad74a None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:01.854004 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 49/94] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:54:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:54:01.859698 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d79a33-9341-4b4f-aa28-c6b00a56ec63 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:01.875473 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa02e6-5906-45bb-b9ab-b7973fdad74a None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:01.914485 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830398c-41f9-4d7a-b205-098cbc070f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:01.915534 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830398c-41f9-4d7a-b205-098cbc070f9c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:01.916124 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830398c-41f9-4d7a-b205-098cbc070f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:01.916608 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830398c-41f9-4d7a-b205-098cbc070f9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:01.917715 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4830398c-41f9-4d7a-b205-098cbc070f9c None admin] RBAC: Adding query filter params (role.id=5a6e54e81bb24eceb618d9ffa67f488e, scope.project.id=61523379bf5c40d6a32f35726b048037, user.id=e70b26bfebd8410b8d3b2aa16cacd530) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:01.918418 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4830398c-41f9-4d7a-b205-098cbc070f9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:01.920121 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4830398c-41f9-4d7a-b205-098cbc070f9c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:01.927418 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 46/95] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:54:01 2022] GET /identity/v3/role_assignments?user.id=e70b26bfebd8410b8d3b2aa16cacd530&scope.project.id=61523379bf5c40d6a32f35726b048037&role.id=5a6e54e81bb24eceb618d9ffa67f488e => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:01.973117 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d79a33-9341-4b4f-aa28-c6b00a56ec63 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:02.017619 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf28190-1ad1-4052-81e3-ce6c6396f72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:02.018466 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf28190-1ad1-4052-81e3-ce6c6396f72e None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:02.018753 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf28190-1ad1-4052-81e3-ce6c6396f72e None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:02.020055 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf28190-1ad1-4052-81e3-ce6c6396f72e None admin] PATH_INFO: `/v3/projects/8e23065785e54ba78d5c83b934f0f230` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:02.022224 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf28190-1ad1-4052-81e3-ce6c6396f72e None admin] RBAC: Authorizing `identity:get_project(project_id=8e23065785e54ba78d5c83b934f0f230)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:02.023776 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf28190-1ad1-4052-81e3-ce6c6396f72e None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:02.025630 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 50/96] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:54:01 2022] GET /identity/v3/projects/8e23065785e54ba78d5c83b934f0f230 => generated 312 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:54:02.032238 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830398c-41f9-4d7a-b205-098cbc070f9c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:02.147034 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830398c-41f9-4d7a-b205-098cbc070f9c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:02.187031 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e873b7-7ab5-4244-8f81-a1c38ab274cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:02.187957 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e873b7-7ab5-4244-8f81-a1c38ab274cc None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:02.188385 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e873b7-7ab5-4244-8f81-a1c38ab274cc None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:02.188829 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e873b7-7ab5-4244-8f81-a1c38ab274cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:02.189859 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e873b7-7ab5-4244-8f81-a1c38ab274cc None admin] RBAC: Adding query filter params (role.id=b0e5c5e3b5f54789a5a5c4c51220c97e, scope.project.id=8e23065785e54ba78d5c83b934f0f230, user.id=c200fe70b1474e1d9846532764b494ad) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:02.190317 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e873b7-7ab5-4244-8f81-a1c38ab274cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:02.192787 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e873b7-7ab5-4244-8f81-a1c38ab274cc None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:02.199756 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 47/97] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:54:02 2022] GET /identity/v3/role_assignments?user.id=c200fe70b1474e1d9846532764b494ad&scope.project.id=8e23065785e54ba78d5c83b934f0f230&role.id=b0e5c5e3b5f54789a5a5c4c51220c97e => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:04.441098 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6f45a-6043-4878-a8b7-c0b859f6a4f2 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:04.441662 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6f45a-6043-4878-a8b7-c0b859f6a4f2 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:04.441662 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6f45a-6043-4878-a8b7-c0b859f6a4f2 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:04.443220 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 51/98] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:04.448833 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675e013-ec32-4e38-a1e8-e0704465094b None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:04.449314 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675e013-ec32-4e38-a1e8-e0704465094b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:04.449508 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675e013-ec32-4e38-a1e8-e0704465094b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:04.478273 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-1675e013-ec32-4e38-a1e8-e0704465094b None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:04.479486 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1675e013-ec32-4e38-a1e8-e0704465094b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:04.551252 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 48/99] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:54:04.574273 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6f45a-6043-4878-a8b7-c0b859f6a4f2 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:04.680898 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6f45a-6043-4878-a8b7-c0b859f6a4f2 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:04.701280 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09745af1-5dda-4343-b2a9-2f2f32e4c4cd None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:04.701584 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09745af1-5dda-4343-b2a9-2f2f32e4c4cd None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:04.701772 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09745af1-5dda-4343-b2a9-2f2f32e4c4cd None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:04.703401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 49/100] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:54:04.711327 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e66d5-d82d-4f24-8ec0-4ef0d8850581 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:04.711597 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e66d5-d82d-4f24-8ec0-4ef0d8850581 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:04.711885 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e66d5-d82d-4f24-8ec0-4ef0d8850581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:04.739016 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-624e66d5-d82d-4f24-8ec0-4ef0d8850581 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:04.740286 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-624e66d5-d82d-4f24-8ec0-4ef0d8850581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:04.747294 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3201ca-30b1-4246-9f48-da868f906f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:04.748402 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3201ca-30b1-4246-9f48-da868f906f2a None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:04.748759 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3201ca-30b1-4246-9f48-da868f906f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:04.749067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3201ca-30b1-4246-9f48-da868f906f2a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:04.765006 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3201ca-30b1-4246-9f48-da868f906f2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:04.774025 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-4c3201ca-30b1-4246-9f48-da868f906f2a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 18:54:04.774025 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:04.774025 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:04.774025 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:04.774025 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:04.774025 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:04.774025 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:04.774025 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:04.774025 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:04.774025 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:04.774025 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:04.774025 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:04.774025 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:04.774025 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:04.774025 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:04.774025 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:04.774985 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:04.774985 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:04.774985 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:04.774985 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:04.774985 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:04.774985 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:04.774985 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:04.774985 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:04.774985 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:04.774985 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:04.774985 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:04.774985 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:04.774985 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:04.774985 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:04.774985 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:04.774985 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:04.776194 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:04.776194 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:04.776194 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:04.776194 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:04.776194 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:04.776194 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:04.776194 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:04.776194 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:04.776194 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:04.776194 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:04.776194 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 18:54:04.776194 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:04.776194 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 52/101] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:54:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:04.781763 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3201ca-30b1-4246-9f48-da868f906f2a None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:04.887569 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 50/102] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:54:04.929047 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3201ca-30b1-4246-9f48-da868f906f2a None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:04.931427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e66d5-d82d-4f24-8ec0-4ef0d8850581 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:05.008239 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70302a2-9655-42a7-9c79-26dacf3d6947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:05.008993 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70302a2-9655-42a7-9c79-26dacf3d6947 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:05.009287 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70302a2-9655-42a7-9c79-26dacf3d6947 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:05.009591 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70302a2-9655-42a7-9c79-26dacf3d6947 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:05.010371 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70302a2-9655-42a7-9c79-26dacf3d6947 None admin] RBAC: Adding query filter params (name=member) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:05.010686 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70302a2-9655-42a7-9c79-26dacf3d6947 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:05.012527 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70302a2-9655-42a7-9c79-26dacf3d6947 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:05.022983 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 53/103] 10.222.0.24 () {56 vars in 1101 bytes} [Mon May 16 18:54:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:05.029281 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70302a2-9655-42a7-9c79-26dacf3d6947 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:05.081383 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e66d5-d82d-4f24-8ec0-4ef0d8850581 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:05.116504 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977cea8-4a4d-4858-adbd-fb44317c32e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:05.117759 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977cea8-4a4d-4858-adbd-fb44317c32e6 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:05.118243 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977cea8-4a4d-4858-adbd-fb44317c32e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:05.118766 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977cea8-4a4d-4858-adbd-fb44317c32e6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:05.129519 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977cea8-4a4d-4858-adbd-fb44317c32e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:05.137840 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-2977cea8-4a4d-4858-adbd-fb44317c32e6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 18:54:05.137840 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:05.137840 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:05.137840 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:05.137840 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:05.137840 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:05.137840 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:05.137840 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:05.137840 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:05.137840 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:05.137840 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:05.137840 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:05.137840 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:05.137840 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:05.137840 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:05.137840 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:05.138672 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:05.138672 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:05.138672 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:05.138672 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:05.138672 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:05.138672 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:05.138672 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:05.138672 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:05.138672 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:05.138672 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:05.138672 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:05.138672 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:54:05.138672 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:05.138672 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:05.138672 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:05.138672 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:05.139401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:05.139401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:05.139401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:05.139401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:05.139401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:05.139401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:05.139401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:05.139401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:05.139401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:05.139401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:05.139401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 18:54:05.139401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:54:05.141835 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 51/104] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:54:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:54:05.143561 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a200b9-ec36-4625-a945-251d2c65e187 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:05.144054 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a200b9-ec36-4625-a945-251d2c65e187 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:05.144519 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a200b9-ec36-4625-a945-251d2c65e187 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:05.146566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 52/105] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:05.150509 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70302a2-9655-42a7-9c79-26dacf3d6947 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:05.151529 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a200b9-ec36-4625-a945-251d2c65e187 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:05.184996 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f5415-de3e-465b-aa9f-04b9b93553d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:05.185874 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f5415-de3e-465b-aa9f-04b9b93553d1 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:05.186163 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f5415-de3e-465b-aa9f-04b9b93553d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:05.186443 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f5415-de3e-465b-aa9f-04b9b93553d1 None admin] PATH_INFO: `/v3/users/c200fe70b1474e1d9846532764b494ad` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:05.187669 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f5415-de3e-465b-aa9f-04b9b93553d1 None admin] RBAC: Authorizing `identity:get_user(user_id=c200fe70b1474e1d9846532764b494ad)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:05.189147 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f5415-de3e-465b-aa9f-04b9b93553d1 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:05.191240 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 54/106] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:54:05 2022] GET /identity/v3/users/c200fe70b1474e1d9846532764b494ad => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:05.192329 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e2014-cfeb-414b-a137-ccc05aed3a0b None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:05.192618 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e2014-cfeb-414b-a137-ccc05aed3a0b None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:05.192900 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e2014-cfeb-414b-a137-ccc05aed3a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:05.214394 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-332e2014-cfeb-414b-a137-ccc05aed3a0b None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:05.215362 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-332e2014-cfeb-414b-a137-ccc05aed3a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:05.263773 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a200b9-ec36-4625-a945-251d2c65e187 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:05.285026 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 55/107] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:54:05.289780 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e2014-cfeb-414b-a137-ccc05aed3a0b None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:05.308488 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52bdc49-f5d1-4b66-8f76-ef7223637ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:05.309723 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52bdc49-f5d1-4b66-8f76-ef7223637ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:05.310330 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52bdc49-f5d1-4b66-8f76-ef7223637ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:05.310807 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52bdc49-f5d1-4b66-8f76-ef7223637ee8 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:05.311762 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52bdc49-f5d1-4b66-8f76-ef7223637ee8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:05.312251 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52bdc49-f5d1-4b66-8f76-ef7223637ee8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:05.313895 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52bdc49-f5d1-4b66-8f76-ef7223637ee8 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:05.329319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 53/108] 10.222.0.24 () {56 vars in 1101 bytes} [Mon May 16 18:54:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:05.331100 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e50de-cf0b-41ea-b985-8a72cad1fc72 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:05.331578 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e50de-cf0b-41ea-b985-8a72cad1fc72 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:05.332053 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e50de-cf0b-41ea-b985-8a72cad1fc72 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:05.333513 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 54/109] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:05.334733 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7e50de-cf0b-41ea-b985-8a72cad1fc72 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:05.386125 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e2014-cfeb-414b-a137-ccc05aed3a0b None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:05.419985 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b418730d-ff54-4771-9bb8-ae6f3e4b6216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:05.420872 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418730d-ff54-4771-9bb8-ae6f3e4b6216 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:05.421157 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418730d-ff54-4771-9bb8-ae6f3e4b6216 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:05.421431 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418730d-ff54-4771-9bb8-ae6f3e4b6216 None admin] PATH_INFO: `/v3/projects/61523379bf5c40d6a32f35726b048037` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:05.422880 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b418730d-ff54-4771-9bb8-ae6f3e4b6216 None admin] RBAC: Authorizing `identity:get_project(project_id=61523379bf5c40d6a32f35726b048037)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:05.424367 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b418730d-ff54-4771-9bb8-ae6f3e4b6216 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:05.426151 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 56/110] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:54:05 2022] GET /identity/v3/projects/61523379bf5c40d6a32f35726b048037 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:05.427329 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67d487-6ba9-4dbe-a9d5-a87e65a580cb None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:05.427606 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67d487-6ba9-4dbe-a9d5-a87e65a580cb None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:05.427886 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67d487-6ba9-4dbe-a9d5-a87e65a580cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:05.440380 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7e50de-cf0b-41ea-b985-8a72cad1fc72 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:05.449679 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-4d67d487-6ba9-4dbe-a9d5-a87e65a580cb None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:05.450904 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-4d67d487-6ba9-4dbe-a9d5-a87e65a580cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:05.475197 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec57c4-648e-48a2-a5e7-fdc4275da0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:05.476763 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec57c4-648e-48a2-a5e7-fdc4275da0ec None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:05.477230 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec57c4-648e-48a2-a5e7-fdc4275da0ec None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:05.477724 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec57c4-648e-48a2-a5e7-fdc4275da0ec None admin] PATH_INFO: `/v3/users/42fe3308334c48d79bc04973b93026de` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:05.491195 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec57c4-648e-48a2-a5e7-fdc4275da0ec None admin] RBAC: Authorizing `identity:get_user(user_id=42fe3308334c48d79bc04973b93026de)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:05.492906 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec57c4-648e-48a2-a5e7-fdc4275da0ec None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:05.495207 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 55/111] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:54:05 2022] GET /identity/v3/users/42fe3308334c48d79bc04973b93026de => generated 289 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:05.496392 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec57c4-648e-48a2-a5e7-fdc4275da0ec None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:05.516366 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 57/112] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:54:05.516948 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67d487-6ba9-4dbe-a9d5-a87e65a580cb None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:05.603376 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec57c4-648e-48a2-a5e7-fdc4275da0ec None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:05.617378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67d487-6ba9-4dbe-a9d5-a87e65a580cb None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:05.640093 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e353e-b49a-4e34-b72b-8f577b90283f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:05.641297 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e353e-b49a-4e34-b72b-8f577b90283f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:05.641835 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e353e-b49a-4e34-b72b-8f577b90283f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:05.642300 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e353e-b49a-4e34-b72b-8f577b90283f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:05.652563 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f768ea0-a01f-4b3c-a8d7-b48a05c25eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:05.653497 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f768ea0-a01f-4b3c-a8d7-b48a05c25eb6 None admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:05.653898 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f768ea0-a01f-4b3c-a8d7-b48a05c25eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:05.654176 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f768ea0-a01f-4b3c-a8d7-b48a05c25eb6 None admin] PATH_INFO: `/v3/projects/61523379bf5c40d6a32f35726b048037/users/c200fe70b1474e1d9846532764b494ad/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:05.656335 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f768ea0-a01f-4b3c-a8d7-b48a05c25eb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=61523379bf5c40d6a32f35726b048037, user_id=c200fe70b1474e1d9846532764b494ad, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:05.657783 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e353e-b49a-4e34-b72b-8f577b90283f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:05.657926 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f768ea0-a01f-4b3c-a8d7-b48a05c25eb6 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:05.666961 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-0a6e353e-b49a-4e34-b72b-8f577b90283f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:54:05.666961 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:05.666961 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:05.666961 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:05.666961 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:05.666961 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:05.666961 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:05.666961 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:05.666961 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:05.666961 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:05.666961 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:05.666961 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:05.666961 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:05.666961 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:05.666961 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:05.666961 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:05.668172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:05.668172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:05.668172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:05.668172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:05.668172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:05.668172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:05.668172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:05.668172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:05.668172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:05.668172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:05.668172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:05.668172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:54:05.668172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:05.668172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:05.668172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:05.668172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:05.669153 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:05.669153 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:05.669153 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:05.669153 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:05.669153 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:05.669153 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:05.669153 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:05.669153 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:05.669153 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:05.669153 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:05.669153 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:54:05.669153 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:54:05.670774 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 56/113] 10.222.0.24 () {56 vars in 1114 bytes} [Mon May 16 18:54:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:05.671862 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e353e-b49a-4e34-b72b-8f577b90283f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:05.678892 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 58/114] 10.222.0.24 () {58 vars in 1439 bytes} [Mon May 16 18:54:05 2022] PUT /identity/v3/projects/61523379bf5c40d6a32f35726b048037/users/c200fe70b1474e1d9846532764b494ad/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:54:05.685568 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f768ea0-a01f-4b3c-a8d7-b48a05c25eb6 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:05.799638 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e353e-b49a-4e34-b72b-8f577b90283f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:05.830473 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f768ea0-a01f-4b3c-a8d7-b48a05c25eb6 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:05.843094 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2726f-1bdb-48fb-99f9-ac44ad20e006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:05.844180 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2726f-1bdb-48fb-99f9-ac44ad20e006 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:05.844836 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2726f-1bdb-48fb-99f9-ac44ad20e006 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:05.845176 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2726f-1bdb-48fb-99f9-ac44ad20e006 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:05.871432 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3322e5e-b873-4de5-bc91-32fce153c311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:05.872268 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3322e5e-b873-4de5-bc91-32fce153c311 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:05.872538 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3322e5e-b873-4de5-bc91-32fce153c311 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:05.872813 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3322e5e-b873-4de5-bc91-32fce153c311 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:05.874095 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3322e5e-b873-4de5-bc91-32fce153c311 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:05.875618 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3322e5e-b873-4de5-bc91-32fce153c311 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:05.877338 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 59/115] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:54:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:05.883134 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3322e5e-b873-4de5-bc91-32fce153c311 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:05.924184 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2726f-1bdb-48fb-99f9-ac44ad20e006 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:05.925855 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2726f-1bdb-48fb-99f9-ac44ad20e006 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:05.992169 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3322e5e-b873-4de5-bc91-32fce153c311 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:06.025592 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 57/116] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:54:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:54:06.025592 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742857c-2edb-490b-b160-1f01ad0c4417 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:06.025592 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742857c-2edb-490b-b160-1f01ad0c4417 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:06.025592 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742857c-2edb-490b-b160-1f01ad0c4417 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:06.025592 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 58/117] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:06.026015 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77e8dd-20b1-4568-ab2d-5a01b3a6aeaf None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:06.026094 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77e8dd-20b1-4568-ab2d-5a01b3a6aeaf None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:06.026403 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77e8dd-20b1-4568-ab2d-5a01b3a6aeaf None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:06.027922 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 59/118] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:06.028707 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77e8dd-20b1-4568-ab2d-5a01b3a6aeaf None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:06.034785 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee029dcb-3111-4bbb-90b4-630a7a315441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:06.035471 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee029dcb-3111-4bbb-90b4-630a7a315441 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:06.035753 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee029dcb-3111-4bbb-90b4-630a7a315441 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:06.036029 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee029dcb-3111-4bbb-90b4-630a7a315441 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:06.036792 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee029dcb-3111-4bbb-90b4-630a7a315441 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:06.037099 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee029dcb-3111-4bbb-90b4-630a7a315441 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:06.038556 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee029dcb-3111-4bbb-90b4-630a7a315441 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:06.047297 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 60/119] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:54:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:06.050786 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee029dcb-3111-4bbb-90b4-630a7a315441 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:06.139773 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77e8dd-20b1-4568-ab2d-5a01b3a6aeaf None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:06.151375 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee029dcb-3111-4bbb-90b4-630a7a315441 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:06.175962 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0123e-4d71-4aaf-ac20-4f5e5198fde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:06.176642 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0123e-4d71-4aaf-ac20-4f5e5198fde4 None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:06.176931 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0123e-4d71-4aaf-ac20-4f5e5198fde4 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:06.177206 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0123e-4d71-4aaf-ac20-4f5e5198fde4 None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:06.177958 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b0123e-4d71-4aaf-ac20-4f5e5198fde4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:06.179420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b0123e-4d71-4aaf-ac20-4f5e5198fde4 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:06.187363 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1d9ad-5382-4958-b5f7-25f9e92352b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:06.188234 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1d9ad-5382-4958-b5f7-25f9e92352b1 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:06.188513 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1d9ad-5382-4958-b5f7-25f9e92352b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:06.188786 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1d9ad-5382-4958-b5f7-25f9e92352b1 None admin] PATH_INFO: `/v3/projects/61523379bf5c40d6a32f35726b048037` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:06.190019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1d9ad-5382-4958-b5f7-25f9e92352b1 None admin] RBAC: Authorizing `identity:get_project(project_id=61523379bf5c40d6a32f35726b048037)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:06.191488 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1d9ad-5382-4958-b5f7-25f9e92352b1 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:06.193197 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 61/120] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:54:06 2022] GET /identity/v3/projects/61523379bf5c40d6a32f35726b048037 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:06.194395 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bac83f-1fb6-4d71-a5d4-9517343dd759 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:06.194680 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bac83f-1fb6-4d71-a5d4-9517343dd759 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:06.194958 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bac83f-1fb6-4d71-a5d4-9517343dd759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:06.211265 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 60/121] 10.222.0.24 () {60 vars in 1141 bytes} [Mon May 16 18:54:06 2022] POST /identity/v3/projects => generated 302 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:54:06.211615 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-31bac83f-1fb6-4d71-a5d4-9517343dd759 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:06.212844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-31bac83f-1fb6-4d71-a5d4-9517343dd759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:06.213151 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab3691-09e0-442a-9a7e-eb7841d964d4 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:06.213877 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab3691-09e0-442a-9a7e-eb7841d964d4 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:06.214372 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab3691-09e0-442a-9a7e-eb7841d964d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:06.241259 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-faab3691-09e0-442a-9a7e-eb7841d964d4 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:06.242576 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-faab3691-09e0-442a-9a7e-eb7841d964d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:06.307495 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 62/122] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:54:06.308409 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bac83f-1fb6-4d71-a5d4-9517343dd759 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:06.330765 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 61/123] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:54:06.331800 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab3691-09e0-442a-9a7e-eb7841d964d4 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:06.436160 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bac83f-1fb6-4d71-a5d4-9517343dd759 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:06.449477 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab3691-09e0-442a-9a7e-eb7841d964d4 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:06.469774 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f168411-28a1-4ec4-b246-27ba2da048e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:06.471252 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f168411-28a1-4ec4-b246-27ba2da048e4 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:06.471660 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f168411-28a1-4ec4-b246-27ba2da048e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:06.472059 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f168411-28a1-4ec4-b246-27ba2da048e4 None admin] PATH_INFO: `/v3/users/c200fe70b1474e1d9846532764b494ad` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:06.474216 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f168411-28a1-4ec4-b246-27ba2da048e4 None admin] RBAC: Authorizing `identity:get_user(user_id=c200fe70b1474e1d9846532764b494ad)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:06.475921 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f168411-28a1-4ec4-b246-27ba2da048e4 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:06.482031 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 63/124] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:54:06 2022] GET /identity/v3/users/c200fe70b1474e1d9846532764b494ad => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:06.482031 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f168411-28a1-4ec4-b246-27ba2da048e4 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:06.483530 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f54f67-f634-4748-89a0-919f0e94c966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:06.484208 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f54f67-f634-4748-89a0-919f0e94c966 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:06.484500 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f54f67-f634-4748-89a0-919f0e94c966 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:06.484778 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f54f67-f634-4748-89a0-919f0e94c966 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:06.486935 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f54f67-f634-4748-89a0-919f0e94c966 None admin] RBAC: Adding query filter params (role.id=8f0019918cbf4b05aa6de1a3c0850251, scope.project.id=61523379bf5c40d6a32f35726b048037, user.id=42fe3308334c48d79bc04973b93026de) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:06.486935 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f54f67-f634-4748-89a0-919f0e94c966 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:06.487542 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f54f67-f634-4748-89a0-919f0e94c966 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:06.493334 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 62/125] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:54:06 2022] GET /identity/v3/role_assignments?user.id=42fe3308334c48d79bc04973b93026de&scope.project.id=61523379bf5c40d6a32f35726b048037&role.id=8f0019918cbf4b05aa6de1a3c0850251 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:06.494403 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f54f67-f634-4748-89a0-919f0e94c966 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:06.588324 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f168411-28a1-4ec4-b246-27ba2da048e4 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:06.602734 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f54f67-f634-4748-89a0-919f0e94c966 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:06.625945 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3b470-4ebd-429b-b4d0-729add402e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:06.626891 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3b470-4ebd-429b-b4d0-729add402e99 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:06.627066 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3b470-4ebd-429b-b4d0-729add402e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:06.627332 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3b470-4ebd-429b-b4d0-729add402e99 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:06.640712 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474670e0-5d1c-45ad-bbd4-f8be8e4c4fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:06.641951 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474670e0-5d1c-45ad-bbd4-f8be8e4c4fcf None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:06.642125 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3b470-4ebd-429b-b4d0-729add402e99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:06.642605 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474670e0-5d1c-45ad-bbd4-f8be8e4c4fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:06.643088 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474670e0-5d1c-45ad-bbd4-f8be8e4c4fcf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:06.650703 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-abd3b470-4ebd-429b-b4d0-729add402e99 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 18:54:06.650703 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:06.650703 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:06.650703 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:06.650703 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:06.650703 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:06.650703 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:06.650703 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:06.650703 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:06.650703 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:06.650703 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:06.650703 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:06.650703 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:06.650703 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:06.650703 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:06.650703 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:06.651681 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:06.651681 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:06.651681 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:06.651681 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:06.651681 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:06.651681 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:06.651681 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:06.651681 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:06.651681 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:06.651681 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:06.651681 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:06.651681 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:06.651681 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:06.651681 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:06.651681 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:06.651681 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:06.652467 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:06.652467 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:06.652467 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:06.652467 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:06.652467 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:06.652467 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:06.652467 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:06.652467 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:06.652467 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:06.652467 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:06.652467 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 18:54:06.652467 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:06.652467 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 64/126] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:54:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:06.653079 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3b470-4ebd-429b-b4d0-729add402e99 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:06.668690 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474670e0-5d1c-45ad-bbd4-f8be8e4c4fcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:06.681102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-474670e0-5d1c-45ad-bbd4-f8be8e4c4fcf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:54:06.681102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:06.681102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:06.681102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:06.681102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:06.681102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:06.681102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:06.681102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:06.681102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:06.681102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:06.681102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:06.681102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:06.681102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:06.681102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:06.681102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:06.681102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:06.682075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:06.682075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:06.682075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:06.682075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:06.682075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:06.682075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:06.682075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:06.682075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:06.682075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:06.682075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:06.682075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:06.682075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:54:06.682075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:06.682075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:06.682075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:06.682075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:06.682937 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:06.682937 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:06.682937 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:06.682937 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:06.682937 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:06.682937 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:06.682937 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:06.682937 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:06.682937 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:06.682937 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:06.682937 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:54:06.682937 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:54:06.682937 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 63/127] 10.222.0.24 () {56 vars in 1096 bytes} [Mon May 16 18:54:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:06.683640 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474670e0-5d1c-45ad-bbd4-f8be8e4c4fcf None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:06.789722 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3b470-4ebd-429b-b4d0-729add402e99 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:06.825774 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8084d6-8526-422b-a8b9-049307907f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:06.826678 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8084d6-8526-422b-a8b9-049307907f65 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:06.826965 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8084d6-8526-422b-a8b9-049307907f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:06.827242 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8084d6-8526-422b-a8b9-049307907f65 None admin] PATH_INFO: `/v3/projects/61523379bf5c40d6a32f35726b048037` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:06.828450 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8084d6-8526-422b-a8b9-049307907f65 None admin] RBAC: Authorizing `identity:get_project(project_id=61523379bf5c40d6a32f35726b048037)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:06.829962 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8084d6-8526-422b-a8b9-049307907f65 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:06.831989 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 65/128] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:54:06 2022] GET /identity/v3/projects/61523379bf5c40d6a32f35726b048037 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:06.832977 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8084d6-8526-422b-a8b9-049307907f65 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:06.850804 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474670e0-5d1c-45ad-bbd4-f8be8e4c4fcf None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:06.934454 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08d1dd-33d9-426f-adea-e696d4bae60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:06.935151 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08d1dd-33d9-426f-adea-e696d4bae60f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:06.935436 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08d1dd-33d9-426f-adea-e696d4bae60f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:06.935712 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08d1dd-33d9-426f-adea-e696d4bae60f None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:06.936486 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08d1dd-33d9-426f-adea-e696d4bae60f None admin] RBAC: Adding query filter params (name=member) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:06.936801 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08d1dd-33d9-426f-adea-e696d4bae60f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:06.938258 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08d1dd-33d9-426f-adea-e696d4bae60f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:06.945259 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8084d6-8526-422b-a8b9-049307907f65 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:06.950572 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 64/129] 10.222.0.24 () {56 vars in 1101 bytes} [Mon May 16 18:54:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:06.955899 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08d1dd-33d9-426f-adea-e696d4bae60f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:07.003279 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323e122-2b8c-40ed-a5a6-eee896a4a072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:07.003976 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323e122-2b8c-40ed-a5a6-eee896a4a072 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:07.004256 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323e122-2b8c-40ed-a5a6-eee896a4a072 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:07.004532 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323e122-2b8c-40ed-a5a6-eee896a4a072 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:07.005297 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8323e122-2b8c-40ed-a5a6-eee896a4a072 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:07.005639 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8323e122-2b8c-40ed-a5a6-eee896a4a072 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:07.007078 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8323e122-2b8c-40ed-a5a6-eee896a4a072 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:07.020406 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 66/130] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:54:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:07.020406 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323e122-2b8c-40ed-a5a6-eee896a4a072 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:07.145663 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08d1dd-33d9-426f-adea-e696d4bae60f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:07.169550 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323e122-2b8c-40ed-a5a6-eee896a4a072 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:07.197254 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d238a-37bb-49a2-b869-e6febd9ea988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:07.198243 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d238a-37bb-49a2-b869-e6febd9ea988 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:07.198527 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d238a-37bb-49a2-b869-e6febd9ea988 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:07.198807 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d238a-37bb-49a2-b869-e6febd9ea988 None admin] PATH_INFO: `/v3/users/c200fe70b1474e1d9846532764b494ad` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:07.200178 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d238a-37bb-49a2-b869-e6febd9ea988 None admin] RBAC: Authorizing `identity:get_user(user_id=c200fe70b1474e1d9846532764b494ad)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:07.201694 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d238a-37bb-49a2-b869-e6febd9ea988 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:07.202249 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ffaad4-682d-470b-91ad-921c275a4277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:07.203331 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ffaad4-682d-470b-91ad-921c275a4277 None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:07.203486 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 67/131] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:54:07 2022] GET /identity/v3/users/c200fe70b1474e1d9846532764b494ad => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:07.203714 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ffaad4-682d-470b-91ad-921c275a4277 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:07.204031 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ffaad4-682d-470b-91ad-921c275a4277 None admin] PATH_INFO: `/v3/projects/61523379bf5c40d6a32f35726b048037/users/c200fe70b1474e1d9846532764b494ad/roles/fda97f4c5b1f4e1ba165f8dfa70ddbd6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:07.204208 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d238a-37bb-49a2-b869-e6febd9ea988 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:07.206429 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ffaad4-682d-470b-91ad-921c275a4277 None admin] RBAC: Authorizing `identity:create_grant(project_id=61523379bf5c40d6a32f35726b048037, user_id=c200fe70b1474e1d9846532764b494ad, role_id=fda97f4c5b1f4e1ba165f8dfa70ddbd6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:07.207926 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ffaad4-682d-470b-91ad-921c275a4277 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:07.249252 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 65/132] 10.222.0.24 () {58 vars in 1439 bytes} [Mon May 16 18:54:06 2022] PUT /identity/v3/projects/61523379bf5c40d6a32f35726b048037/users/c200fe70b1474e1d9846532764b494ad/roles/fda97f4c5b1f4e1ba165f8dfa70ddbd6 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:54:07.253257 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ffaad4-682d-470b-91ad-921c275a4277 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:07.314223 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d238a-37bb-49a2-b869-e6febd9ea988 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:07.349068 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f39bf-e819-48bf-9274-66877f7bc2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:07.350120 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f39bf-e819-48bf-9274-66877f7bc2ca None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:07.350410 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f39bf-e819-48bf-9274-66877f7bc2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:07.350689 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f39bf-e819-48bf-9274-66877f7bc2ca None admin] PATH_INFO: `/v3/users/e70b26bfebd8410b8d3b2aa16cacd530` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:07.351938 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f39bf-e819-48bf-9274-66877f7bc2ca None admin] RBAC: Authorizing `identity:get_user(user_id=e70b26bfebd8410b8d3b2aa16cacd530)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:07.353441 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f39bf-e819-48bf-9274-66877f7bc2ca None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:07.355195 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 68/133] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:54:07 2022] GET /identity/v3/users/e70b26bfebd8410b8d3b2aa16cacd530 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:07.366380 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f39bf-e819-48bf-9274-66877f7bc2ca None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:07.479794 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f39bf-e819-48bf-9274-66877f7bc2ca None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:07.485563 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ffaad4-682d-470b-91ad-921c275a4277 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:07.531721 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb93d91-a404-4a3c-bded-1d6a5263dcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:07.532080 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036feca-aaa4-431b-8f68-6b4ee8b1c02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:07.532610 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb93d91-a404-4a3c-bded-1d6a5263dcbc None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:07.532892 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb93d91-a404-4a3c-bded-1d6a5263dcbc None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:07.533175 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb93d91-a404-4a3c-bded-1d6a5263dcbc None admin] PATH_INFO: `/v3/projects/8e23065785e54ba78d5c83b934f0f230` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:07.533932 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036feca-aaa4-431b-8f68-6b4ee8b1c02e None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:07.534406 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036feca-aaa4-431b-8f68-6b4ee8b1c02e None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:07.534878 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036feca-aaa4-431b-8f68-6b4ee8b1c02e None admin] PATH_INFO: `/v3/projects/61523379bf5c40d6a32f35726b048037` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:07.542536 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb93d91-a404-4a3c-bded-1d6a5263dcbc None admin] RBAC: Authorizing `identity:get_project(project_id=8e23065785e54ba78d5c83b934f0f230)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:07.542719 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5036feca-aaa4-431b-8f68-6b4ee8b1c02e None admin] RBAC: Authorizing `identity:get_project(project_id=61523379bf5c40d6a32f35726b048037)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:07.544115 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb93d91-a404-4a3c-bded-1d6a5263dcbc None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:07.544692 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5036feca-aaa4-431b-8f68-6b4ee8b1c02e None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:07.546408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 66/134] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:54:07 2022] GET /identity/v3/projects/8e23065785e54ba78d5c83b934f0f230 => generated 312 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:07.547312 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 69/135] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:54:07 2022] GET /identity/v3/projects/61523379bf5c40d6a32f35726b048037 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:54:07.553275 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb93d91-a404-4a3c-bded-1d6a5263dcbc None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:07.556716 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036feca-aaa4-431b-8f68-6b4ee8b1c02e None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:07.732693 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb93d91-a404-4a3c-bded-1d6a5263dcbc None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:07.757928 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036feca-aaa4-431b-8f68-6b4ee8b1c02e None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:07.778646 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea076076-1582-4479-935e-d850bd85fe9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:07.779876 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea076076-1582-4479-935e-d850bd85fe9f None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:07.780353 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea076076-1582-4479-935e-d850bd85fe9f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:07.780847 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea076076-1582-4479-935e-d850bd85fe9f None admin] PATH_INFO: `/v3/projects/61523379bf5c40d6a32f35726b048037/users/e70b26bfebd8410b8d3b2aa16cacd530/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:07.783080 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea076076-1582-4479-935e-d850bd85fe9f None admin] RBAC: Authorizing `identity:create_grant(project_id=61523379bf5c40d6a32f35726b048037, user_id=e70b26bfebd8410b8d3b2aa16cacd530, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:07.784762 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea076076-1582-4479-935e-d850bd85fe9f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:07.799672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f688a69-175a-4cca-9209-0796975e6cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:07.800596 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f688a69-175a-4cca-9209-0796975e6cb2 None admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:07.800875 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f688a69-175a-4cca-9209-0796975e6cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:07.801156 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f688a69-175a-4cca-9209-0796975e6cb2 None admin] PATH_INFO: `/v3/projects/8e23065785e54ba78d5c83b934f0f230/users/c200fe70b1474e1d9846532764b494ad/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:07.803229 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f688a69-175a-4cca-9209-0796975e6cb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e23065785e54ba78d5c83b934f0f230, user_id=c200fe70b1474e1d9846532764b494ad, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:07.810979 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f688a69-175a-4cca-9209-0796975e6cb2 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:07.820836 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 67/136] 10.222.0.24 () {58 vars in 1439 bytes} [Mon May 16 18:54:07 2022] PUT /identity/v3/projects/61523379bf5c40d6a32f35726b048037/users/e70b26bfebd8410b8d3b2aa16cacd530/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:54:07.841718 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 70/137] 10.222.0.24 () {58 vars in 1439 bytes} [Mon May 16 18:54:07 2022] PUT /identity/v3/projects/8e23065785e54ba78d5c83b934f0f230/users/c200fe70b1474e1d9846532764b494ad/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:54:08.163119 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd085839-a4a1-4bc2-8ee6-32ed234aab02 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:08.163655 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd085839-a4a1-4bc2-8ee6-32ed234aab02 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:08.164492 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd085839-a4a1-4bc2-8ee6-32ed234aab02 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:08.166173 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 68/138] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:08 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:08.172343 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e867ab-6cb3-4a64-953d-46634b0344dd None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:08.172713 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e867ab-6cb3-4a64-953d-46634b0344dd None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:08.172919 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e867ab-6cb3-4a64-953d-46634b0344dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:08.195213 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-b3e867ab-6cb3-4a64-953d-46634b0344dd None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:08.196456 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-b3e867ab-6cb3-4a64-953d-46634b0344dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:08.273580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 71/139] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:54:08.314224 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd085839-a4a1-4bc2-8ee6-32ed234aab02 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:08.451321 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd085839-a4a1-4bc2-8ee6-32ed234aab02 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:08.495200 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cfa60-6929-406b-a405-d1df8c01a508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:08.496891 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cfa60-6929-406b-a405-d1df8c01a508 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:08.497436 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cfa60-6929-406b-a405-d1df8c01a508 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:08.497961 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cfa60-6929-406b-a405-d1df8c01a508 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:08.513434 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835cfa60-6929-406b-a405-d1df8c01a508 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:08.521568 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-835cfa60-6929-406b-a405-d1df8c01a508 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 18:54:08.521568 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:08.521568 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:08.521568 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:08.521568 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:08.521568 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:08.521568 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:08.521568 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:08.521568 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:08.521568 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:08.521568 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:08.521568 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:08.521568 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:08.521568 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:08.521568 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:08.521568 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:08.522428 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:08.522428 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:08.522428 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:08.522428 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:08.522428 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:08.522428 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:08.522428 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:08.522428 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:08.522428 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:08.522428 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:08.522428 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:08.522428 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:54:08.522428 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:08.522428 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:08.522428 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:08.522428 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:08.523178 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:08.523178 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:08.523178 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:08.523178 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:08.523178 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:08.523178 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:08.523178 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:08.523178 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:08.523178 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:08.523178 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:08.523178 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 18:54:08.523178 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:54:08.527041 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 69/140] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:54:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:08.534671 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e867ab-6cb3-4a64-953d-46634b0344dd None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:08.679951 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e867ab-6cb3-4a64-953d-46634b0344dd None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:08.730092 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a8ff1-7000-4516-b724-1d3b13461363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:08.730754 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a8ff1-7000-4516-b724-1d3b13461363 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:08.731039 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a8ff1-7000-4516-b724-1d3b13461363 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:08.731314 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a8ff1-7000-4516-b724-1d3b13461363 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:08.732085 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a8ff1-7000-4516-b724-1d3b13461363 None admin] RBAC: Adding query filter params (name=member) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:08.732392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a8ff1-7000-4516-b724-1d3b13461363 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:08.733824 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a8ff1-7000-4516-b724-1d3b13461363 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:08.745902 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 72/141] 10.222.0.24 () {56 vars in 1101 bytes} [Mon May 16 18:54:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:08.751622 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cfa60-6929-406b-a405-d1df8c01a508 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:08.874607 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cfa60-6929-406b-a405-d1df8c01a508 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:08.912692 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0a928-db02-48bf-b06c-62c1651b05d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:08.914412 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0a928-db02-48bf-b06c-62c1651b05d0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:08.914907 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0a928-db02-48bf-b06c-62c1651b05d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:08.915391 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0a928-db02-48bf-b06c-62c1651b05d0 None admin] PATH_INFO: `/v3/users/c200fe70b1474e1d9846532764b494ad` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:08.922231 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0a928-db02-48bf-b06c-62c1651b05d0 None admin] RBAC: Authorizing `identity:get_user(user_id=c200fe70b1474e1d9846532764b494ad)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:08.923997 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0a928-db02-48bf-b06c-62c1651b05d0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:08.925901 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 70/142] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:54:08 2022] GET /identity/v3/users/c200fe70b1474e1d9846532764b494ad => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:08.931486 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a8ff1-7000-4516-b724-1d3b13461363 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:09.087981 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a8ff1-7000-4516-b724-1d3b13461363 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:09.130971 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66348700-78e1-4937-be07-1ed7f2c74583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:09.131664 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66348700-78e1-4937-be07-1ed7f2c74583 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:09.131953 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66348700-78e1-4937-be07-1ed7f2c74583 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:09.132231 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66348700-78e1-4937-be07-1ed7f2c74583 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:09.228949 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66348700-78e1-4937-be07-1ed7f2c74583 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:09.230508 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66348700-78e1-4937-be07-1ed7f2c74583 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:09.360767 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 73/143] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:54:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:54:09.366633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0a928-db02-48bf-b06c-62c1651b05d0 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:09.471680 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0a928-db02-48bf-b06c-62c1651b05d0 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:09.509130 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d715e8a-d1fe-4acc-a3c2-cb198b66085d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:09.510921 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d715e8a-d1fe-4acc-a3c2-cb198b66085d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:09.511436 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d715e8a-d1fe-4acc-a3c2-cb198b66085d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:09.512004 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d715e8a-d1fe-4acc-a3c2-cb198b66085d None admin] PATH_INFO: `/v3/projects/61523379bf5c40d6a32f35726b048037` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:09.513496 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d715e8a-d1fe-4acc-a3c2-cb198b66085d None admin] RBAC: Authorizing `identity:get_project(project_id=61523379bf5c40d6a32f35726b048037)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:09.515126 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d715e8a-d1fe-4acc-a3c2-cb198b66085d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:09.516998 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 71/144] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:54:09 2022] GET /identity/v3/projects/61523379bf5c40d6a32f35726b048037 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:54:09.523006 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66348700-78e1-4937-be07-1ed7f2c74583 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:09.646984 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66348700-78e1-4937-be07-1ed7f2c74583 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:09.689431 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61b039-013b-4640-ae06-b8d756f45dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:09.690149 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61b039-013b-4640-ae06-b8d756f45dbb None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:09.690442 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61b039-013b-4640-ae06-b8d756f45dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:09.690714 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61b039-013b-4640-ae06-b8d756f45dbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:09.691574 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c61b039-013b-4640-ae06-b8d756f45dbb None admin] RBAC: Adding query filter params (role.id=b0e5c5e3b5f54789a5a5c4c51220c97e, scope.project.id=61523379bf5c40d6a32f35726b048037, user.id=c200fe70b1474e1d9846532764b494ad) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:09.691894 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c61b039-013b-4640-ae06-b8d756f45dbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:09.693385 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c61b039-013b-4640-ae06-b8d756f45dbb None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:09.700331 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 74/145] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:54:09 2022] GET /identity/v3/role_assignments?user.id=c200fe70b1474e1d9846532764b494ad&scope.project.id=61523379bf5c40d6a32f35726b048037&role.id=b0e5c5e3b5f54789a5a5c4c51220c97e => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:09.780571 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006cd58-ad36-4eb5-ba21-cccb13e518c1 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:09.780926 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006cd58-ad36-4eb5-ba21-cccb13e518c1 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:09.781122 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006cd58-ad36-4eb5-ba21-cccb13e518c1 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:09.782552 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 72/146] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:09.798422 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce68e7-4da2-4762-a456-3ef394901f45 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:09.798738 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce68e7-4da2-4762-a456-3ef394901f45 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:09.798993 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce68e7-4da2-4762-a456-3ef394901f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:09.817167 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-91ce68e7-4da2-4762-a456-3ef394901f45 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:09.818756 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-91ce68e7-4da2-4762-a456-3ef394901f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:09.900569 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 75/147] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:54:09.934914 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c006cd58-ad36-4eb5-ba21-cccb13e518c1 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:10.058222 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c006cd58-ad36-4eb5-ba21-cccb13e518c1 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:10.103015 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c25e71-5d75-4aeb-861c-90eebe10aaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:10.104179 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c25e71-5d75-4aeb-861c-90eebe10aaca None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:10.104649 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c25e71-5d75-4aeb-861c-90eebe10aaca None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:10.105125 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c25e71-5d75-4aeb-861c-90eebe10aaca None admin] PATH_INFO: `/v3/domains/default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:10.110226 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c25e71-5d75-4aeb-861c-90eebe10aaca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:10.111989 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c25e71-5d75-4aeb-861c-90eebe10aaca None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:10.113952 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 73/148] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:54:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:10.119614 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce68e7-4da2-4762-a456-3ef394901f45 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:10.156685 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4031eecc-9ccb-4128-b9ed-77a04e188365 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:10.157317 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4031eecc-9ccb-4128-b9ed-77a04e188365 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:10.158020 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4031eecc-9ccb-4128-b9ed-77a04e188365 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:10.159612 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 74/149] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:54:10.175160 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5fef8-c836-45d0-be8c-dd4da084e2fb None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:10.175431 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5fef8-c836-45d0-be8c-dd4da084e2fb None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:10.175708 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5fef8-c836-45d0-be8c-dd4da084e2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:10.197933 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-19c5fef8-c836-45d0-be8c-dd4da084e2fb None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:10.199451 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-19c5fef8-c836-45d0-be8c-dd4da084e2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:10.246723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce68e7-4da2-4762-a456-3ef394901f45 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:10.291545 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34468669-2ba2-475b-b57e-30f24d08791d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:10.292657 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34468669-2ba2-475b-b57e-30f24d08791d None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:10.293204 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34468669-2ba2-475b-b57e-30f24d08791d None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:10.293713 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34468669-2ba2-475b-b57e-30f24d08791d None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:10.294665 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34468669-2ba2-475b-b57e-30f24d08791d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:10.296793 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34468669-2ba2-475b-b57e-30f24d08791d None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:10.333364 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 76/150] 10.222.0.24 () {60 vars in 1132 bytes} [Mon May 16 18:54:10 2022] POST /identity/v3/users => generated 283 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:54:10.342368 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 75/151] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:54:10.387446 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34468669-2ba2-475b-b57e-30f24d08791d None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:10.507942 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34468669-2ba2-475b-b57e-30f24d08791d None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:10.548857 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49211e8a-6226-45be-8011-3e28fd67aa70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:10.550143 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49211e8a-6226-45be-8011-3e28fd67aa70 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:10.550631 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49211e8a-6226-45be-8011-3e28fd67aa70 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:10.551092 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49211e8a-6226-45be-8011-3e28fd67aa70 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:10.565373 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49211e8a-6226-45be-8011-3e28fd67aa70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:10.581254 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-49211e8a-6226-45be-8011-3e28fd67aa70 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 18:54:10.581254 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:10.581254 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:10.581254 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:10.581254 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:10.581254 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:10.581254 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:10.581254 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:10.581254 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:10.581254 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:10.581254 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:10.581254 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:10.581254 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:10.581254 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:10.581254 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:10.581254 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:10.582407 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:10.582407 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:10.582407 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:10.582407 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:10.582407 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:10.582407 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:10.582407 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:10.582407 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:10.582407 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:10.582407 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:10.582407 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:10.582407 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:10.582407 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:10.582407 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:10.582407 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:10.582407 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:10.583618 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:10.583618 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:10.583618 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:10.583618 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:10.583618 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:10.583618 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:10.583618 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:10.583618 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:10.583618 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:10.583618 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:10.583618 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 18:54:10.583618 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:10.585941 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 77/152] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:54:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:10.592767 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5fef8-c836-45d0-be8c-dd4da084e2fb None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:10.712557 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5fef8-c836-45d0-be8c-dd4da084e2fb None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:10.747563 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e1d4f-f349-4bd8-b995-03a87a94edbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:10.748252 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e1d4f-f349-4bd8-b995-03a87a94edbc None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:10.748531 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e1d4f-f349-4bd8-b995-03a87a94edbc None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:10.748804 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e1d4f-f349-4bd8-b995-03a87a94edbc None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:10.749650 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e1d4f-f349-4bd8-b995-03a87a94edbc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:10.749956 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e1d4f-f349-4bd8-b995-03a87a94edbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:10.751398 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e1d4f-f349-4bd8-b995-03a87a94edbc None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:10.760332 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 76/153] 10.222.0.24 () {56 vars in 1101 bytes} [Mon May 16 18:54:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:10.766052 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49211e8a-6226-45be-8011-3e28fd67aa70 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:10.839120 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25275aa5-06c4-40cd-a283-47ddcced63e8 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:10.839404 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25275aa5-06c4-40cd-a283-47ddcced63e8 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:10.839785 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25275aa5-06c4-40cd-a283-47ddcced63e8 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:10.841161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 77/154] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:54:10.846745 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4067b-64a9-4a72-bdbb-58245aaeb4db None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:10.847332 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4067b-64a9-4a72-bdbb-58245aaeb4db None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:10.847806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4067b-64a9-4a72-bdbb-58245aaeb4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:10.865588 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-90a4067b-64a9-4a72-bdbb-58245aaeb4db None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:10.867161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-90a4067b-64a9-4a72-bdbb-58245aaeb4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:10.885022 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49211e8a-6226-45be-8011-3e28fd67aa70 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:10.929282 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da54df4-89cb-4be2-8e10-bb652f0853d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:10.930202 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da54df4-89cb-4be2-8e10-bb652f0853d3 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:10.930482 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da54df4-89cb-4be2-8e10-bb652f0853d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:10.930902 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da54df4-89cb-4be2-8e10-bb652f0853d3 None admin] PATH_INFO: `/v3/users/42fe3308334c48d79bc04973b93026de` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:10.932674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da54df4-89cb-4be2-8e10-bb652f0853d3 None admin] RBAC: Authorizing `identity:get_user(user_id=42fe3308334c48d79bc04973b93026de)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:10.933415 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da54df4-89cb-4be2-8e10-bb652f0853d3 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:10.935242 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 78/155] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:54:10 2022] GET /identity/v3/users/42fe3308334c48d79bc04973b93026de => generated 289 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:10.936289 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63341d-7416-450a-978e-8c86884fb224 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:10.936554 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63341d-7416-450a-978e-8c86884fb224 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:10.936825 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63341d-7416-450a-978e-8c86884fb224 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:10.939100 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 79/156] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:10.942407 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63341d-7416-450a-978e-8c86884fb224 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:10.955186 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 78/157] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:54:10.956646 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bebd27-458a-4c34-80a2-a1dab674fdc4 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:10.957135 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bebd27-458a-4c34-80a2-a1dab674fdc4 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:10.957569 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bebd27-458a-4c34-80a2-a1dab674fdc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:10.975087 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-a1bebd27-458a-4c34-80a2-a1dab674fdc4 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:10.976481 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a1bebd27-458a-4c34-80a2-a1dab674fdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:11.056951 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 79/158] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:54:11.057801 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bebd27-458a-4c34-80a2-a1dab674fdc4 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:11.063435 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63341d-7416-450a-978e-8c86884fb224 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:11.096973 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672ca81-9387-416b-9827-0a42eb4b370b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:11.097877 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672ca81-9387-416b-9827-0a42eb4b370b None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:11.098163 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672ca81-9387-416b-9827-0a42eb4b370b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:11.098437 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672ca81-9387-416b-9827-0a42eb4b370b None admin] PATH_INFO: `/v3/projects/61523379bf5c40d6a32f35726b048037` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:11.099635 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5672ca81-9387-416b-9827-0a42eb4b370b None admin] RBAC: Authorizing `identity:get_project(project_id=61523379bf5c40d6a32f35726b048037)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:11.101097 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5672ca81-9387-416b-9827-0a42eb4b370b None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:11.103214 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 80/159] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:54:10 2022] GET /identity/v3/projects/61523379bf5c40d6a32f35726b048037 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:11.104044 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672ca81-9387-416b-9827-0a42eb4b370b None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:11.180220 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bebd27-458a-4c34-80a2-a1dab674fdc4 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:11.227279 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672ca81-9387-416b-9827-0a42eb4b370b None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:11.229979 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aee389-acaf-47f6-9d03-d7c92eb38391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:11.230893 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aee389-acaf-47f6-9d03-d7c92eb38391 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:11.231197 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aee389-acaf-47f6-9d03-d7c92eb38391 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:11.231467 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aee389-acaf-47f6-9d03-d7c92eb38391 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:11.244256 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aee389-acaf-47f6-9d03-d7c92eb38391 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:11.252528 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-35aee389-acaf-47f6-9d03-d7c92eb38391 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:54:11.252528 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:11.252528 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:11.252528 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:11.252528 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:11.252528 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:11.252528 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:11.252528 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:11.252528 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:11.252528 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:11.252528 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:11.252528 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:11.252528 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:11.252528 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:11.252528 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:11.252528 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:11.253393 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:11.253393 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:11.253393 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:11.253393 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:11.253393 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:11.253393 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:11.253393 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:11.253393 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:11.253393 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:11.253393 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:11.253393 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:11.253393 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:54:11.253393 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:11.253393 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:11.253393 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:11.253393 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:11.254228 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:11.254228 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:11.254228 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:11.254228 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:11.254228 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:11.254228 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:11.254228 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:11.254228 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:11.254228 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:11.254228 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:11.254228 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:54:11.254228 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:54:11.254228 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 80/160] 10.222.0.24 () {56 vars in 1114 bytes} [Mon May 16 18:54:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:11.254837 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aee389-acaf-47f6-9d03-d7c92eb38391 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:11.270867 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13df75d-1f25-4f44-bda4-4f83c4dd2a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:11.272072 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13df75d-1f25-4f44-bda4-4f83c4dd2a81 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:11.272926 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13df75d-1f25-4f44-bda4-4f83c4dd2a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:11.273395 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13df75d-1f25-4f44-bda4-4f83c4dd2a81 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:11.290038 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13df75d-1f25-4f44-bda4-4f83c4dd2a81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:11.302703 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-b13df75d-1f25-4f44-bda4-4f83c4dd2a81 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 18:54:11.302703 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:11.302703 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:11.302703 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:11.302703 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:11.302703 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:11.302703 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:11.302703 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:11.302703 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:11.302703 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:11.302703 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:11.302703 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:11.302703 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:11.302703 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:11.302703 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:11.302703 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:11.304415 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:11.304415 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:11.304415 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:11.304415 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:11.304415 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:11.304415 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:11.304415 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:11.304415 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:11.304415 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:11.304415 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:11.304415 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:11.304415 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:11.304415 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:11.304415 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:11.304415 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:11.304415 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:11.305943 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:11.305943 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:11.305943 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:11.305943 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:11.305943 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:11.305943 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:11.305943 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:11.305943 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:11.305943 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:11.305943 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:11.305943 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 18:54:11.305943 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:11.309334 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 81/161] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:54:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:11.315134 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e029b2a-497a-43d6-9d61-7a2f6468b3ef None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:11.315684 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e029b2a-497a-43d6-9d61-7a2f6468b3ef None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:11.316170 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e029b2a-497a-43d6-9d61-7a2f6468b3ef None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:11.317749 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 82/162] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:11.318656 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e029b2a-497a-43d6-9d61-7a2f6468b3ef None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:11.377837 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aee389-acaf-47f6-9d03-d7c92eb38391 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:11.421930 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c352f-021d-466f-80ea-edc9111b2144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:11.422835 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c352f-021d-466f-80ea-edc9111b2144 None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:11.423115 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c352f-021d-466f-80ea-edc9111b2144 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:11.423387 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c352f-021d-466f-80ea-edc9111b2144 None admin] PATH_INFO: `/v3/projects/61523379bf5c40d6a32f35726b048037/users/42fe3308334c48d79bc04973b93026de/roles/8f0019918cbf4b05aa6de1a3c0850251` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:11.425386 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c352f-021d-466f-80ea-edc9111b2144 None admin] RBAC: Authorizing `identity:create_grant(project_id=61523379bf5c40d6a32f35726b048037, user_id=42fe3308334c48d79bc04973b93026de, role_id=8f0019918cbf4b05aa6de1a3c0850251)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:11.426953 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c352f-021d-466f-80ea-edc9111b2144 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:11.427674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e029b2a-497a-43d6-9d61-7a2f6468b3ef None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:11.442603 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 81/163] 10.222.0.24 () {58 vars in 1439 bytes} [Mon May 16 18:54:11 2022] PUT /identity/v3/projects/61523379bf5c40d6a32f35726b048037/users/42fe3308334c48d79bc04973b93026de/roles/8f0019918cbf4b05aa6de1a3c0850251 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:54:11.444277 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1a4e4-8e02-4928-8725-37d968693eb6 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:11.444572 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1a4e4-8e02-4928-8725-37d968693eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:11.444850 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1a4e4-8e02-4928-8725-37d968693eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:11.482751 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f14a6-ce94-488b-a374-08de18c34460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:11.483902 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f14a6-ce94-488b-a374-08de18c34460 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:11.484408 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f14a6-ce94-488b-a374-08de18c34460 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:11.484885 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f14a6-ce94-488b-a374-08de18c34460 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:11.485911 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f14a6-ce94-488b-a374-08de18c34460 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:11.486206 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-1cc1a4e4-8e02-4928-8725-37d968693eb6 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:11.486622 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f14a6-ce94-488b-a374-08de18c34460 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:11.487542 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1cc1a4e4-8e02-4928-8725-37d968693eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:11.488593 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f14a6-ce94-488b-a374-08de18c34460 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:11.499872 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 83/164] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:54:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:11.501183 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f14a6-ce94-488b-a374-08de18c34460 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:11.638152 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 82/165] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:54:11.642016 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1a4e4-8e02-4928-8725-37d968693eb6 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:11.666134 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f14a6-ce94-488b-a374-08de18c34460 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:11.707032 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd41f3-bfee-4aa7-8000-1b9b27489e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:11.708037 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd41f3-bfee-4aa7-8000-1b9b27489e80 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:11.708489 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd41f3-bfee-4aa7-8000-1b9b27489e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:11.708945 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd41f3-bfee-4aa7-8000-1b9b27489e80 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:11.709903 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd41f3-bfee-4aa7-8000-1b9b27489e80 None admin] RBAC: Adding query filter params (name=member) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:11.710400 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd41f3-bfee-4aa7-8000-1b9b27489e80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:11.711971 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd41f3-bfee-4aa7-8000-1b9b27489e80 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:11.720987 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 84/166] 10.222.0.24 () {56 vars in 1101 bytes} [Mon May 16 18:54:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:11.723785 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd41f3-bfee-4aa7-8000-1b9b27489e80 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:11.765841 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1a4e4-8e02-4928-8725-37d968693eb6 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:11.799947 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34d783-ae9b-449a-a3fe-04d3a53ee62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:11.800845 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34d783-ae9b-449a-a3fe-04d3a53ee62d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:11.801127 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34d783-ae9b-449a-a3fe-04d3a53ee62d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:11.801401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34d783-ae9b-449a-a3fe-04d3a53ee62d None admin] PATH_INFO: `/v3/users/c200fe70b1474e1d9846532764b494ad` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:11.802723 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34d783-ae9b-449a-a3fe-04d3a53ee62d None admin] RBAC: Authorizing `identity:get_user(user_id=c200fe70b1474e1d9846532764b494ad)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:11.804450 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34d783-ae9b-449a-a3fe-04d3a53ee62d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:11.805899 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 83/167] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:54:11 2022] GET /identity/v3/users/c200fe70b1474e1d9846532764b494ad => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:11.806681 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34d783-ae9b-449a-a3fe-04d3a53ee62d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:11.829631 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd41f3-bfee-4aa7-8000-1b9b27489e80 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:11.863682 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065a1a7-1569-4ff7-93fa-f8c2984926cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:11.864831 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065a1a7-1569-4ff7-93fa-f8c2984926cc None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:11.865281 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065a1a7-1569-4ff7-93fa-f8c2984926cc None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:11.865767 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065a1a7-1569-4ff7-93fa-f8c2984926cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:11.876317 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065a1a7-1569-4ff7-93fa-f8c2984926cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:11.884354 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-4065a1a7-1569-4ff7-93fa-f8c2984926cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:54:11.884354 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:11.884354 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:11.884354 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:11.884354 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:11.884354 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:11.884354 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:11.884354 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:11.884354 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:11.884354 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:11.884354 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:11.884354 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:11.884354 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:11.884354 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:11.884354 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:11.884354 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:11.885247 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:11.885247 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:11.885247 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:11.885247 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:11.885247 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:11.885247 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:11.885247 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:11.885247 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:11.885247 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:11.885247 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:11.885247 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:11.885247 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:11.885247 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:11.885247 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:11.885247 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:11.885247 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:11.886035 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:11.886035 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:11.886035 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:11.886035 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:11.886035 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:11.886035 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:11.886035 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:11.886035 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:11.886035 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:11.886035 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:11.886035 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:54:11.886035 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:11.888335 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 85/168] 10.222.0.24 () {56 vars in 1096 bytes} [Mon May 16 18:54:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:11.889273 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065a1a7-1569-4ff7-93fa-f8c2984926cc None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:11.909042 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34d783-ae9b-449a-a3fe-04d3a53ee62d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:11.945907 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192612c-f9d3-4ac4-96ad-39993ac7c7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:11.946795 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192612c-f9d3-4ac4-96ad-39993ac7c7c6 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:11.947073 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192612c-f9d3-4ac4-96ad-39993ac7c7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:11.947343 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192612c-f9d3-4ac4-96ad-39993ac7c7c6 None admin] PATH_INFO: `/v3/users/c200fe70b1474e1d9846532764b494ad` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:11.948536 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192612c-f9d3-4ac4-96ad-39993ac7c7c6 None admin] RBAC: Authorizing `identity:get_user(user_id=c200fe70b1474e1d9846532764b494ad)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:11.950125 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192612c-f9d3-4ac4-96ad-39993ac7c7c6 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:11.952012 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 84/169] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:54:11 2022] GET /identity/v3/users/c200fe70b1474e1d9846532764b494ad => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:11.952797 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192612c-f9d3-4ac4-96ad-39993ac7c7c6 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:11.995826 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065a1a7-1569-4ff7-93fa-f8c2984926cc None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:12.030358 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4595a8-9a86-4cd0-a963-de96b5334ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:12.031304 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4595a8-9a86-4cd0-a963-de96b5334ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:12.031757 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4595a8-9a86-4cd0-a963-de96b5334ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:12.032168 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4595a8-9a86-4cd0-a963-de96b5334ee2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:12.055683 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192612c-f9d3-4ac4-96ad-39993ac7c7c6 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:12.090263 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de55a3-da3e-47ac-9f17-cb4f84a1ea48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:12.090952 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de55a3-da3e-47ac-9f17-cb4f84a1ea48 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:12.091282 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de55a3-da3e-47ac-9f17-cb4f84a1ea48 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:12.091496 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de55a3-da3e-47ac-9f17-cb4f84a1ea48 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:12.092252 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de55a3-da3e-47ac-9f17-cb4f84a1ea48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:12.092570 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de55a3-da3e-47ac-9f17-cb4f84a1ea48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:12.094013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de55a3-da3e-47ac-9f17-cb4f84a1ea48 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:12.102428 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4595a8-9a86-4cd0-a963-de96b5334ee2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:12.102580 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 85/170] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:54:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:12.103271 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de55a3-da3e-47ac-9f17-cb4f84a1ea48 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:12.104443 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4595a8-9a86-4cd0-a963-de96b5334ee2 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:12.204771 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de55a3-da3e-47ac-9f17-cb4f84a1ea48 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:12.211366 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 86/171] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:54:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:54:12.212415 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4595a8-9a86-4cd0-a963-de96b5334ee2 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:12.243391 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e54d1d-8555-4dee-934f-4acdb0a4ae99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:12.244056 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e54d1d-8555-4dee-934f-4acdb0a4ae99 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:12.244338 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e54d1d-8555-4dee-934f-4acdb0a4ae99 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:12.244609 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e54d1d-8555-4dee-934f-4acdb0a4ae99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:12.309052 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4595a8-9a86-4cd0-a963-de96b5334ee2 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:12.312236 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e54d1d-8555-4dee-934f-4acdb0a4ae99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:12.313854 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e54d1d-8555-4dee-934f-4acdb0a4ae99 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:12.344768 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4826062e-cde9-4f70-a7fc-32666f707884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:12.345943 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826062e-cde9-4f70-a7fc-32666f707884 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:12.346361 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826062e-cde9-4f70-a7fc-32666f707884 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:12.346769 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826062e-cde9-4f70-a7fc-32666f707884 None admin] PATH_INFO: `/v3/users/e70b26bfebd8410b8d3b2aa16cacd530` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:12.348177 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4826062e-cde9-4f70-a7fc-32666f707884 None admin] RBAC: Authorizing `identity:get_user(user_id=e70b26bfebd8410b8d3b2aa16cacd530)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:12.349866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4826062e-cde9-4f70-a7fc-32666f707884 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:12.351714 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 87/172] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:54:12 2022] GET /identity/v3/users/e70b26bfebd8410b8d3b2aa16cacd530 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:12.352681 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4826062e-cde9-4f70-a7fc-32666f707884 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:12.418797 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 86/173] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:54:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:54:12.419580 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e54d1d-8555-4dee-934f-4acdb0a4ae99 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:12.468881 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4826062e-cde9-4f70-a7fc-32666f707884 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:12.510871 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0d019-79aa-45a0-a431-4a5189ffd94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:12.512120 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0d019-79aa-45a0-a431-4a5189ffd94b None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:12.512574 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0d019-79aa-45a0-a431-4a5189ffd94b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:12.513040 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0d019-79aa-45a0-a431-4a5189ffd94b None admin] PATH_INFO: `/v3/projects/61523379bf5c40d6a32f35726b048037` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:12.514461 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa0d019-79aa-45a0-a431-4a5189ffd94b None admin] RBAC: Authorizing `identity:get_project(project_id=61523379bf5c40d6a32f35726b048037)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:12.516102 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa0d019-79aa-45a0-a431-4a5189ffd94b None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:12.518039 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 88/174] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:54:12 2022] GET /identity/v3/projects/61523379bf5c40d6a32f35726b048037 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:12.518970 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0d019-79aa-45a0-a431-4a5189ffd94b None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:12.527777 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e54d1d-8555-4dee-934f-4acdb0a4ae99 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:12.565560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ec9e2-0434-44a5-adc5-4935cf1b3c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:12.565560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ec9e2-0434-44a5-adc5-4935cf1b3c27 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:12.565560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ec9e2-0434-44a5-adc5-4935cf1b3c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:12.565560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ec9e2-0434-44a5-adc5-4935cf1b3c27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:12.655311 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ec9e2-0434-44a5-adc5-4935cf1b3c27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:12.656801 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ec9e2-0434-44a5-adc5-4935cf1b3c27 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:12.711936 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0d019-79aa-45a0-a431-4a5189ffd94b None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:12.777020 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de95cd-d690-4442-bd90-f8f295836c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:12.779597 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de95cd-d690-4442-bd90-f8f295836c08 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:12.779881 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de95cd-d690-4442-bd90-f8f295836c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:12.780155 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de95cd-d690-4442-bd90-f8f295836c08 None admin] PATH_INFO: `/v3/projects/8e23065785e54ba78d5c83b934f0f230` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:12.783640 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de95cd-d690-4442-bd90-f8f295836c08 None admin] RBAC: Authorizing `identity:get_project(project_id=8e23065785e54ba78d5c83b934f0f230)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:12.785699 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de95cd-d690-4442-bd90-f8f295836c08 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:12.787449 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 89/175] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:54:12 2022] GET /identity/v3/projects/8e23065785e54ba78d5c83b934f0f230 => generated 312 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:12.799907 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 87/176] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:54:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:54:12.800961 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ec9e2-0434-44a5-adc5-4935cf1b3c27 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:12.803054 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de95cd-d690-4442-bd90-f8f295836c08 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:12.935259 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de95cd-d690-4442-bd90-f8f295836c08 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:12.975942 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c59772-33c3-4e9a-9964-e5617fe2609b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:12.976952 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c59772-33c3-4e9a-9964-e5617fe2609b None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:12.977427 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c59772-33c3-4e9a-9964-e5617fe2609b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:12.977916 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c59772-33c3-4e9a-9964-e5617fe2609b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:12.978941 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c59772-33c3-4e9a-9964-e5617fe2609b None admin] RBAC: Adding query filter params (role.id=fda97f4c5b1f4e1ba165f8dfa70ddbd6, scope.project.id=61523379bf5c40d6a32f35726b048037, user.id=c200fe70b1474e1d9846532764b494ad) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:12.979477 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c59772-33c3-4e9a-9964-e5617fe2609b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:12.981242 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c59772-33c3-4e9a-9964-e5617fe2609b None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:12.987530 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 90/177] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:54:12 2022] GET /identity/v3/role_assignments?user.id=c200fe70b1474e1d9846532764b494ad&scope.project.id=61523379bf5c40d6a32f35726b048037&role.id=fda97f4c5b1f4e1ba165f8dfa70ddbd6 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:12.993557 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c59772-33c3-4e9a-9964-e5617fe2609b None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:12.999750 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ec9e2-0434-44a5-adc5-4935cf1b3c27 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:13.098263 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b99321-1747-4da0-9dea-9beb2f93f9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:13.098966 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b99321-1747-4da0-9dea-9beb2f93f9cf None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:13.099247 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b99321-1747-4da0-9dea-9beb2f93f9cf None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:13.099516 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b99321-1747-4da0-9dea-9beb2f93f9cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:13.100380 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b99321-1747-4da0-9dea-9beb2f93f9cf None admin] RBAC: Adding query filter params (role.id=b0e5c5e3b5f54789a5a5c4c51220c97e, scope.project.id=8e23065785e54ba78d5c83b934f0f230, user.id=c200fe70b1474e1d9846532764b494ad) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:13.100677 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b99321-1747-4da0-9dea-9beb2f93f9cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:13.102219 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b99321-1747-4da0-9dea-9beb2f93f9cf None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:13.112965 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c59772-33c3-4e9a-9964-e5617fe2609b None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:13.120300 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 88/178] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:54:12 2022] GET /identity/v3/role_assignments?user.id=c200fe70b1474e1d9846532764b494ad&scope.project.id=8e23065785e54ba78d5c83b934f0f230&role.id=b0e5c5e3b5f54789a5a5c4c51220c97e => generated 608 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:13.170560 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693f51a-6b7d-4e53-ac07-73affe9130ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:13.171452 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693f51a-6b7d-4e53-ac07-73affe9130ec None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:13.171733 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693f51a-6b7d-4e53-ac07-73affe9130ec None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:13.172005 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693f51a-6b7d-4e53-ac07-73affe9130ec None admin] PATH_INFO: `/v3/projects/61523379bf5c40d6a32f35726b048037` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:13.175252 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f693f51a-6b7d-4e53-ac07-73affe9130ec None admin] RBAC: Authorizing `identity:get_project(project_id=61523379bf5c40d6a32f35726b048037)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:13.176760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f693f51a-6b7d-4e53-ac07-73affe9130ec None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:13.178597 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 91/179] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:54:12 2022] GET /identity/v3/projects/61523379bf5c40d6a32f35726b048037 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:13.185145 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b99321-1747-4da0-9dea-9beb2f93f9cf None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:13.345111 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b99321-1747-4da0-9dea-9beb2f93f9cf None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:13.393160 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a23bae-d631-44de-aaac-6fa864c127a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:13.393901 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a23bae-d631-44de-aaac-6fa864c127a1 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:13.394179 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a23bae-d631-44de-aaac-6fa864c127a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:13.394443 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a23bae-d631-44de-aaac-6fa864c127a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:13.395292 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a23bae-d631-44de-aaac-6fa864c127a1 None admin] RBAC: Adding query filter params (role.id=5a6e54e81bb24eceb618d9ffa67f488e, scope.project.id=61523379bf5c40d6a32f35726b048037, user.id=e70b26bfebd8410b8d3b2aa16cacd530) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:13.395597 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a23bae-d631-44de-aaac-6fa864c127a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:13.397059 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a23bae-d631-44de-aaac-6fa864c127a1 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:13.403595 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 89/180] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:54:13 2022] GET /identity/v3/role_assignments?user.id=e70b26bfebd8410b8d3b2aa16cacd530&scope.project.id=61523379bf5c40d6a32f35726b048037&role.id=5a6e54e81bb24eceb618d9ffa67f488e => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:14.030607 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe19b1-fe52-49fa-b9fe-2a16fb734521 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:14.031122 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe19b1-fe52-49fa-b9fe-2a16fb734521 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:14.031122 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe19b1-fe52-49fa-b9fe-2a16fb734521 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:14.032688 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 92/181] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:14.039026 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6caf0-e436-41c2-94d4-e71320f7648d None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:14.039462 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6caf0-e436-41c2-94d4-e71320f7648d None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:14.039641 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6caf0-e436-41c2-94d4-e71320f7648d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:14.059542 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-5be6caf0-e436-41c2-94d4-e71320f7648d None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:14.060747 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5be6caf0-e436-41c2-94d4-e71320f7648d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:14.139556 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 90/182] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:54:14.168096 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe19b1-fe52-49fa-b9fe-2a16fb734521 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:14.269555 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe19b1-fe52-49fa-b9fe-2a16fb734521 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:14.303733 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b3254-7a85-484b-90dc-da68edea03ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:14.304827 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b3254-7a85-484b-90dc-da68edea03ea None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:14.305281 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b3254-7a85-484b-90dc-da68edea03ea None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:14.305748 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b3254-7a85-484b-90dc-da68edea03ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:14.316134 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3b3254-7a85-484b-90dc-da68edea03ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:14.324215 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-6c3b3254-7a85-484b-90dc-da68edea03ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:54:14.324215 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:14.324215 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:14.324215 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:14.324215 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:14.324215 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:14.324215 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:14.324215 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:14.324215 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:14.324215 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:14.324215 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:14.324215 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:14.324215 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:14.324215 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:14.324215 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:14.324215 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:14.325137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:14.325137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:14.325137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:14.325137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:14.325137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:14.325137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:14.325137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:14.325137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:14.325137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:14.325137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:14.325137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:14.325137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:14.325137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:14.325137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:14.325137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:14.325137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:14.325946 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:14.325946 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:14.325946 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:14.325946 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:14.325946 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:14.325946 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:14.325946 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:14.325946 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:14.325946 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:14.325946 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:14.325946 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:54:14.325946 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:14.328165 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 93/183] 10.222.0.24 () {56 vars in 1096 bytes} [Mon May 16 18:54:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:14.334572 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6caf0-e436-41c2-94d4-e71320f7648d None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:14.437581 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6caf0-e436-41c2-94d4-e71320f7648d None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:14.474708 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1526ab3-ea12-4cc6-9f4d-6deb10332117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:14.475399 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1526ab3-ea12-4cc6-9f4d-6deb10332117 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:14.475673 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1526ab3-ea12-4cc6-9f4d-6deb10332117 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:14.475940 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1526ab3-ea12-4cc6-9f4d-6deb10332117 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:14.476696 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1526ab3-ea12-4cc6-9f4d-6deb10332117 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:14.477003 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1526ab3-ea12-4cc6-9f4d-6deb10332117 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:14.478420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1526ab3-ea12-4cc6-9f4d-6deb10332117 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:14.487261 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 91/184] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:54:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:14.492961 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b3254-7a85-484b-90dc-da68edea03ea None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:14.530454 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98a2ac-3a27-4312-885e-19ce8a81f0b3 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:14.530809 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98a2ac-3a27-4312-885e-19ce8a81f0b3 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:14.531000 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98a2ac-3a27-4312-885e-19ce8a81f0b3 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:14.532396 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 92/185] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:54:14.537736 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc207d-da3a-43d3-aa42-dcf1fd3c7692 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:14.538019 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc207d-da3a-43d3-aa42-dcf1fd3c7692 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:14.538294 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc207d-da3a-43d3-aa42-dcf1fd3c7692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:14.555467 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-f0cc207d-da3a-43d3-aa42-dcf1fd3c7692 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:14.556561 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f0cc207d-da3a-43d3-aa42-dcf1fd3c7692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:14.594286 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b3254-7a85-484b-90dc-da68edea03ea None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:14.621410 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 93/186] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:54:14.622639 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29220c4f-1409-4a00-9f31-e82c38fb4973 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:14.622993 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29220c4f-1409-4a00-9f31-e82c38fb4973 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:14.623330 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29220c4f-1409-4a00-9f31-e82c38fb4973 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:14.625565 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 94/187] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:14.630136 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468c515-c5d2-4b45-8c67-033053802ba3 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:14.630582 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468c515-c5d2-4b45-8c67-033053802ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:14.631006 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468c515-c5d2-4b45-8c67-033053802ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:14.633289 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c705c-2ada-47e3-bc97-fa8d3cba334d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:14.634307 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c705c-2ada-47e3-bc97-fa8d3cba334d None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:14.634693 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c705c-2ada-47e3-bc97-fa8d3cba334d None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:14.635322 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c705c-2ada-47e3-bc97-fa8d3cba334d None admin] PATH_INFO: `/v3/users/3fef82fd38504838b9bcdb44cd6f500b` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:14.648827 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-8468c515-c5d2-4b45-8c67-033053802ba3 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:14.649067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c705c-2ada-47e3-bc97-fa8d3cba334d None admin] RBAC: Authorizing `identity:get_user(user_id=3fef82fd38504838b9bcdb44cd6f500b)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:14.650015 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-8468c515-c5d2-4b45-8c67-033053802ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:14.650581 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c705c-2ada-47e3-bc97-fa8d3cba334d None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:14.656594 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 94/188] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:54:14 2022] GET /identity/v3/users/3fef82fd38504838b9bcdb44cd6f500b => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:14.656594 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac0f89-2de5-438f-9b46-6701e273e9a4 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:14.656594 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac0f89-2de5-438f-9b46-6701e273e9a4 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:14.656594 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac0f89-2de5-438f-9b46-6701e273e9a4 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:14.656594 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 95/189] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:14.657392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac0f89-2de5-438f-9b46-6701e273e9a4 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:14.712675 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 95/190] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:54:14.713617 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468c515-c5d2-4b45-8c67-033053802ba3 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:14.754320 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac0f89-2de5-438f-9b46-6701e273e9a4 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:14.785711 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf4ef0a-f258-4643-942c-930de3d8b7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:14.786477 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4ef0a-f258-4643-942c-930de3d8b7e6 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:14.786753 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4ef0a-f258-4643-942c-930de3d8b7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:14.787391 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4ef0a-f258-4643-942c-930de3d8b7e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:14.789670 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf4ef0a-f258-4643-942c-930de3d8b7e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:14.791123 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf4ef0a-f258-4643-942c-930de3d8b7e6 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:14.792763 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 96/191] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:54:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:14.794756 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b24a5-0626-42f7-974a-f68de3ee3a54 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:14.795010 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b24a5-0626-42f7-974a-f68de3ee3a54 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:14.795294 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b24a5-0626-42f7-974a-f68de3ee3a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:14.806108 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468c515-c5d2-4b45-8c67-033053802ba3 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:14.811592 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-c55b24a5-0626-42f7-974a-f68de3ee3a54 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:14.812757 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-c55b24a5-0626-42f7-974a-f68de3ee3a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:14.839467 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe248a-f4e5-49dc-a987-f5e648c9b599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:14.840123 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe248a-f4e5-49dc-a987-f5e648c9b599 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:14.840403 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe248a-f4e5-49dc-a987-f5e648c9b599 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:14.840653 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe248a-f4e5-49dc-a987-f5e648c9b599 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:14.875973 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 97/192] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:54:14.876800 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b24a5-0626-42f7-974a-f68de3ee3a54 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:14.906423 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe248a-f4e5-49dc-a987-f5e648c9b599 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:14.907911 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe248a-f4e5-49dc-a987-f5e648c9b599 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:14.969065 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b24a5-0626-42f7-974a-f68de3ee3a54 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:14.999570 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 96/193] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:54:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:54:15.000378 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe248a-f4e5-49dc-a987-f5e648c9b599 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:15.002771 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9848422-baa2-4e5a-b70b-a7265bd76577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:15.003571 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9848422-baa2-4e5a-b70b-a7265bd76577 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:15.003859 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9848422-baa2-4e5a-b70b-a7265bd76577 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:15.004384 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9848422-baa2-4e5a-b70b-a7265bd76577 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:15.015072 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9848422-baa2-4e5a-b70b-a7265bd76577 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:15.022860 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-c9848422-baa2-4e5a-b70b-a7265bd76577 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 18:54:15.022860 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:15.022860 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:15.022860 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:15.022860 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:15.022860 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:15.022860 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:15.022860 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:15.022860 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:15.022860 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:15.022860 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:15.022860 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:15.022860 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:15.022860 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:15.022860 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:15.022860 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:15.023734 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:15.023734 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:15.023734 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:15.023734 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:15.023734 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:15.023734 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:15.023734 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:15.023734 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:15.023734 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:15.023734 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:15.023734 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:15.023734 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:15.023734 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:15.023734 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:15.023734 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:15.023734 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:15.024498 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:15.024498 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:15.024498 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:15.024498 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:15.024498 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:15.024498 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:15.024498 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:15.024498 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:15.024498 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:15.024498 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:15.024498 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 18:54:15.024498 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:15.024498 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 98/194] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:54:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:15.026177 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9848422-baa2-4e5a-b70b-a7265bd76577 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:15.090809 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe248a-f4e5-49dc-a987-f5e648c9b599 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:15.123428 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc1238-adb5-4f3b-9d72-c4b6d7b35d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:15.124103 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc1238-adb5-4f3b-9d72-c4b6d7b35d65 None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:15.124311 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9848422-baa2-4e5a-b70b-a7265bd76577 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:15.124743 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc1238-adb5-4f3b-9d72-c4b6d7b35d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:15.124743 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc1238-adb5-4f3b-9d72-c4b6d7b35d65 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:15.125327 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc1238-adb5-4f3b-9d72-c4b6d7b35d65 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:15.126788 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc1238-adb5-4f3b-9d72-c4b6d7b35d65 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:15.145304 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 97/195] 10.222.0.24 () {60 vars in 1132 bytes} [Mon May 16 18:54:14 2022] POST /identity/v3/users => generated 297 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:54:15.146157 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc1238-adb5-4f3b-9d72-c4b6d7b35d65 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:15.158017 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354b4cb-0fc3-46cc-b9a0-41e55d804d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:15.158878 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354b4cb-0fc3-46cc-b9a0-41e55d804d38 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:15.159158 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354b4cb-0fc3-46cc-b9a0-41e55d804d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:15.159434 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354b4cb-0fc3-46cc-b9a0-41e55d804d38 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:15.172069 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354b4cb-0fc3-46cc-b9a0-41e55d804d38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:15.180793 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-0354b4cb-0fc3-46cc-b9a0-41e55d804d38 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:54:15.180793 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:15.180793 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:15.180793 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:15.180793 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:15.180793 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:15.180793 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:15.180793 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:15.180793 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:15.180793 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:15.180793 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:15.180793 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:15.180793 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:15.180793 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:15.180793 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:15.180793 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:15.182019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:15.182019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:15.182019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:15.182019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:15.182019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:15.182019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:15.182019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:15.182019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:15.182019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:15.182019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:15.182019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:15.182019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:15.182019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:15.182019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:15.182019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:15.182019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:15.183038 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:15.183038 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:15.183038 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:15.183038 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:15.183038 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:15.183038 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:15.183038 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:15.183038 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:15.183038 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:15.183038 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:15.183038 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:54:15.183038 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:15.183038 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 99/196] 10.222.0.24 () {56 vars in 1114 bytes} [Mon May 16 18:54:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:15.188164 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354b4cb-0fc3-46cc-b9a0-41e55d804d38 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:15.275019 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc1238-adb5-4f3b-9d72-c4b6d7b35d65 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:15.297384 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354b4cb-0fc3-46cc-b9a0-41e55d804d38 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:15.311061 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215894fd-292a-43a0-9351-826ba4cebc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:15.311949 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215894fd-292a-43a0-9351-826ba4cebc86 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:15.312225 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215894fd-292a-43a0-9351-826ba4cebc86 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:15.312493 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215894fd-292a-43a0-9351-826ba4cebc86 None admin] PATH_INFO: `/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:15.313744 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215894fd-292a-43a0-9351-826ba4cebc86 None admin] RBAC: Authorizing `identity:get_project(project_id=4e1cc38a8ece4d619be76f0ba70f8f1b)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:15.315222 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215894fd-292a-43a0-9351-826ba4cebc86 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:15.317163 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 98/197] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:54:15 2022] GET /identity/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:15.322847 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215894fd-292a-43a0-9351-826ba4cebc86 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:15.333829 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3078cd-de9e-4b63-9fa5-cc15cd737f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:15.334889 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3078cd-de9e-4b63-9fa5-cc15cd737f2f None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:15.335177 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3078cd-de9e-4b63-9fa5-cc15cd737f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:15.335454 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3078cd-de9e-4b63-9fa5-cc15cd737f2f None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:15.336536 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3078cd-de9e-4b63-9fa5-cc15cd737f2f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:15.336851 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3078cd-de9e-4b63-9fa5-cc15cd737f2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:15.338872 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3078cd-de9e-4b63-9fa5-cc15cd737f2f None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:15.346891 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 100/198] 10.222.0.24 () {56 vars in 1101 bytes} [Mon May 16 18:54:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:15.347884 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3078cd-de9e-4b63-9fa5-cc15cd737f2f None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:15.444681 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215894fd-292a-43a0-9351-826ba4cebc86 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:15.462925 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3078cd-de9e-4b63-9fa5-cc15cd737f2f None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:15.483018 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2cea5-07c4-440c-a253-2f050c53fec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:15.483936 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2cea5-07c4-440c-a253-2f050c53fec7 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:15.484383 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2cea5-07c4-440c-a253-2f050c53fec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:15.484806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2cea5-07c4-440c-a253-2f050c53fec7 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:15.485600 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e2cea5-07c4-440c-a253-2f050c53fec7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:15.485914 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e2cea5-07c4-440c-a253-2f050c53fec7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:15.487330 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e2cea5-07c4-440c-a253-2f050c53fec7 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:15.495512 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 99/199] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:54:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:15.496384 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2cea5-07c4-440c-a253-2f050c53fec7 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:15.502994 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3455f-f4c8-4626-b921-d5a75ddce6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:15.503739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3455f-f4c8-4626-b921-d5a75ddce6da None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:15.504082 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3455f-f4c8-4626-b921-d5a75ddce6da None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:15.504413 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3455f-f4c8-4626-b921-d5a75ddce6da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:15.505317 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf3455f-f4c8-4626-b921-d5a75ddce6da None admin] RBAC: Adding query filter params (role.id=5a6e54e81bb24eceb618d9ffa67f488e, scope.project.id=4e1cc38a8ece4d619be76f0ba70f8f1b, user.id=3fef82fd38504838b9bcdb44cd6f500b) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:15.506512 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf3455f-f4c8-4626-b921-d5a75ddce6da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:15.507255 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf3455f-f4c8-4626-b921-d5a75ddce6da None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:15.517614 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 101/200] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:54:15 2022] GET /identity/v3/role_assignments?user.id=3fef82fd38504838b9bcdb44cd6f500b&scope.project.id=4e1cc38a8ece4d619be76f0ba70f8f1b&role.id=5a6e54e81bb24eceb618d9ffa67f488e => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:15.519094 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3455f-f4c8-4626-b921-d5a75ddce6da None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:15.632129 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2cea5-07c4-440c-a253-2f050c53fec7 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:15.652825 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3455f-f4c8-4626-b921-d5a75ddce6da None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:15.679551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5d0b1-1f07-4e36-8b2c-396ae8eaa12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:15.681353 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5d0b1-1f07-4e36-8b2c-396ae8eaa12e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:15.681977 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5d0b1-1f07-4e36-8b2c-396ae8eaa12e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:15.682497 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5d0b1-1f07-4e36-8b2c-396ae8eaa12e None admin] PATH_INFO: `/v3/users/42fe3308334c48d79bc04973b93026de` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:15.684463 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d5d0b1-1f07-4e36-8b2c-396ae8eaa12e None admin] RBAC: Authorizing `identity:get_user(user_id=42fe3308334c48d79bc04973b93026de)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:15.686959 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d5d0b1-1f07-4e36-8b2c-396ae8eaa12e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:15.689817 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 100/201] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:54:15 2022] GET /identity/v3/users/42fe3308334c48d79bc04973b93026de => generated 289 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:15.697568 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5d0b1-1f07-4e36-8b2c-396ae8eaa12e None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:15.699583 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffd1c0-963b-4fc6-8f72-a5e74fd174ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:15.702501 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffd1c0-963b-4fc6-8f72-a5e74fd174ba None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:15.703031 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffd1c0-963b-4fc6-8f72-a5e74fd174ba None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:15.703450 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffd1c0-963b-4fc6-8f72-a5e74fd174ba None admin] PATH_INFO: `/v3/users/3fef82fd38504838b9bcdb44cd6f500b` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:15.706312 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cffd1c0-963b-4fc6-8f72-a5e74fd174ba None admin] RBAC: Authorizing `identity:get_user(user_id=3fef82fd38504838b9bcdb44cd6f500b)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:15.707964 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cffd1c0-963b-4fc6-8f72-a5e74fd174ba None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:15.711592 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 102/202] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:54:15 2022] GET /identity/v3/users/3fef82fd38504838b9bcdb44cd6f500b => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:15.717365 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffd1c0-963b-4fc6-8f72-a5e74fd174ba None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:15.835706 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5d0b1-1f07-4e36-8b2c-396ae8eaa12e None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:15.890942 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9863837-43de-4d1b-9842-e06147c93018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:15.891966 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9863837-43de-4d1b-9842-e06147c93018 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:15.892336 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9863837-43de-4d1b-9842-e06147c93018 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:15.892699 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9863837-43de-4d1b-9842-e06147c93018 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:15.931583 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffd1c0-963b-4fc6-8f72-a5e74fd174ba None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:15.985837 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81060e5-6f4b-4ea2-85f0-b320f45ca5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:15.986668 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81060e5-6f4b-4ea2-85f0-b320f45ca5e5 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:15.987033 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81060e5-6f4b-4ea2-85f0-b320f45ca5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:15.987418 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81060e5-6f4b-4ea2-85f0-b320f45ca5e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:16.022089 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9863837-43de-4d1b-9842-e06147c93018 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:16.024460 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9863837-43de-4d1b-9842-e06147c93018 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:16.110633 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81060e5-6f4b-4ea2-85f0-b320f45ca5e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:16.112121 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81060e5-6f4b-4ea2-85f0-b320f45ca5e5 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:16.186355 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 101/203] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:54:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 18:54:16.192035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9863837-43de-4d1b-9842-e06147c93018 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:16.246469 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 103/204] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:54:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 18:54:16.251505 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81060e5-6f4b-4ea2-85f0-b320f45ca5e5 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:16.353631 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81060e5-6f4b-4ea2-85f0-b320f45ca5e5 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:16.389610 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0cd3fb-f388-4346-b783-dab61631ade2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:16.390493 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cd3fb-f388-4346-b783-dab61631ade2 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:16.390776 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cd3fb-f388-4346-b783-dab61631ade2 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:16.391035 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cd3fb-f388-4346-b783-dab61631ade2 None admin] PATH_INFO: `/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:16.392557 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0cd3fb-f388-4346-b783-dab61631ade2 None admin] RBAC: Authorizing `identity:get_project(project_id=4e1cc38a8ece4d619be76f0ba70f8f1b)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:16.394202 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0cd3fb-f388-4346-b783-dab61631ade2 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:16.396256 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 104/205] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:54:16 2022] GET /identity/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:16.401430 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0cd3fb-f388-4346-b783-dab61631ade2 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:16.413254 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9863837-43de-4d1b-9842-e06147c93018 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:16.502949 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4fefc-37be-4464-bb82-9200dd3eb94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:16.503731 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4fefc-37be-4464-bb82-9200dd3eb94b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:16.504015 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4fefc-37be-4464-bb82-9200dd3eb94b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:16.504346 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4fefc-37be-4464-bb82-9200dd3eb94b None admin] PATH_INFO: `/v3/projects/61523379bf5c40d6a32f35726b048037` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:16.504716 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0cd3fb-f388-4346-b783-dab61631ade2 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:16.510397 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b4fefc-37be-4464-bb82-9200dd3eb94b None admin] RBAC: Authorizing `identity:get_project(project_id=61523379bf5c40d6a32f35726b048037)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:16.512007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b4fefc-37be-4464-bb82-9200dd3eb94b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:16.513989 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 102/206] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:54:16 2022] GET /identity/v3/projects/61523379bf5c40d6a32f35726b048037 => generated 298 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:16.519837 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4fefc-37be-4464-bb82-9200dd3eb94b None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:16.542067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101081a-4a68-47e9-aecf-a1c3ed3f8aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:16.542813 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101081a-4a68-47e9-aecf-a1c3ed3f8aeb None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:16.543096 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101081a-4a68-47e9-aecf-a1c3ed3f8aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:16.543361 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101081a-4a68-47e9-aecf-a1c3ed3f8aeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:16.544214 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d101081a-4a68-47e9-aecf-a1c3ed3f8aeb None admin] RBAC: Adding query filter params (role.id=fda97f4c5b1f4e1ba165f8dfa70ddbd6, scope.project.id=4e1cc38a8ece4d619be76f0ba70f8f1b, user.id=3fef82fd38504838b9bcdb44cd6f500b) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:16.544522 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d101081a-4a68-47e9-aecf-a1c3ed3f8aeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:16.546033 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d101081a-4a68-47e9-aecf-a1c3ed3f8aeb None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:16.553154 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 105/207] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:54:16 2022] GET /identity/v3/role_assignments?user.id=3fef82fd38504838b9bcdb44cd6f500b&scope.project.id=4e1cc38a8ece4d619be76f0ba70f8f1b&role.id=fda97f4c5b1f4e1ba165f8dfa70ddbd6 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:16.713558 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4fefc-37be-4464-bb82-9200dd3eb94b None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:16.749540 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22170f2b-4bb0-479c-acab-d97ea5a0c4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:16.750226 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22170f2b-4bb0-479c-acab-d97ea5a0c4c9 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:16.750553 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22170f2b-4bb0-479c-acab-d97ea5a0c4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:16.750825 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22170f2b-4bb0-479c-acab-d97ea5a0c4c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:16.751671 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22170f2b-4bb0-479c-acab-d97ea5a0c4c9 None admin] RBAC: Adding query filter params (role.id=8f0019918cbf4b05aa6de1a3c0850251, scope.project.id=61523379bf5c40d6a32f35726b048037, user.id=42fe3308334c48d79bc04973b93026de) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:16.751978 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22170f2b-4bb0-479c-acab-d97ea5a0c4c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:16.753567 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22170f2b-4bb0-479c-acab-d97ea5a0c4c9 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:16.760218 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 103/208] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:54:16 2022] GET /identity/v3/role_assignments?user.id=42fe3308334c48d79bc04973b93026de&scope.project.id=61523379bf5c40d6a32f35726b048037&role.id=8f0019918cbf4b05aa6de1a3c0850251 => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:54:17.692456 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f7262-6e4c-4610-bece-4810c98d833b None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:17.693166 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f7262-6e4c-4610-bece-4810c98d833b None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:17.693166 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f7262-6e4c-4610-bece-4810c98d833b None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:17.694409 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 106/209] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:54:17.700046 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8bd3a-abcd-45f3-b91b-7e83bdfd2d6c None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:17.700460 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8bd3a-abcd-45f3-b91b-7e83bdfd2d6c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:17.700627 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8bd3a-abcd-45f3-b91b-7e83bdfd2d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:17.718789 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-ada8bd3a-abcd-45f3-b91b-7e83bdfd2d6c None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:17.720012 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ada8bd3a-abcd-45f3-b91b-7e83bdfd2d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:17.788522 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 104/210] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:54:17.811973 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f7262-6e4c-4610-bece-4810c98d833b None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:17.905336 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453ea23-7c71-45b9-b93c-957a1dc16cad None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:17.905662 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453ea23-7c71-45b9-b93c-957a1dc16cad None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:17.905934 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453ea23-7c71-45b9-b93c-957a1dc16cad None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:17.907477 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 105/211] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:54:17.915209 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027f9c4-64e8-44d9-a81b-25ca9a0d2f80 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:17.915726 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027f9c4-64e8-44d9-a81b-25ca9a0d2f80 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:17.916195 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027f9c4-64e8-44d9-a81b-25ca9a0d2f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:17.917139 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f7262-6e4c-4610-bece-4810c98d833b None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:17.938844 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-2027f9c4-64e8-44d9-a81b-25ca9a0d2f80 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:17.940679 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2027f9c4-64e8-44d9-a81b-25ca9a0d2f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:17.954256 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80955d1a-8be2-40f0-add3-5477cfd3d4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:17.954841 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80955d1a-8be2-40f0-add3-5477cfd3d4d0 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:17.955117 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80955d1a-8be2-40f0-add3-5477cfd3d4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:17.955384 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80955d1a-8be2-40f0-add3-5477cfd3d4d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:17.966245 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80955d1a-8be2-40f0-add3-5477cfd3d4d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:17.974179 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-80955d1a-8be2-40f0-add3-5477cfd3d4d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 18:54:17.974179 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:17.974179 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:17.974179 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:17.974179 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:17.974179 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:17.974179 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:17.974179 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:17.974179 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:17.974179 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:17.974179 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:17.974179 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:17.974179 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:17.974179 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:17.974179 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:17.974179 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:17.975092 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:17.975092 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:17.975092 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:17.975092 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:17.975092 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:17.975092 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:17.975092 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:17.975092 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:17.975092 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:17.975092 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:17.975092 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:17.975092 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:17.975092 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:17.975092 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:17.975092 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:17.975092 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:17.975877 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:17.975877 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:17.975877 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:17.975877 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:17.975877 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:17.975877 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:17.975877 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:17.975877 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:17.975877 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:17.975877 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:17.975877 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 18:54:17.975877 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:17.975877 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 107/212] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:54:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:17.981867 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80955d1a-8be2-40f0-add3-5477cfd3d4d0 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:18.029711 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 106/213] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:54:18.035533 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672e075-ea51-4516-aa82-ce07100f9a2b None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:18.036332 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672e075-ea51-4516-aa82-ce07100f9a2b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:18.036811 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672e075-ea51-4516-aa82-ce07100f9a2b None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:18.039542 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 107/214] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:18.044982 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a49dd7-0bb7-4847-bfb9-7a4bbb5a2f37 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:18.045496 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a49dd7-0bb7-4847-bfb9-7a4bbb5a2f37 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:18.046044 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a49dd7-0bb7-4847-bfb9-7a4bbb5a2f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:18.062754 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-28a49dd7-0bb7-4847-bfb9-7a4bbb5a2f37 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:18.064010 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-28a49dd7-0bb7-4847-bfb9-7a4bbb5a2f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:18.081692 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80955d1a-8be2-40f0-add3-5477cfd3d4d0 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:18.115605 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff464b-f5a4-4d41-b198-1cc465bf7602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:18.116288 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff464b-f5a4-4d41-b198-1cc465bf7602 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:18.119226 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff464b-f5a4-4d41-b198-1cc465bf7602 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:18.119226 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff464b-f5a4-4d41-b198-1cc465bf7602 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:18.119226 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff464b-f5a4-4d41-b198-1cc465bf7602 None admin] RBAC: Adding query filter params (name=member) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:18.119226 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff464b-f5a4-4d41-b198-1cc465bf7602 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:18.119521 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff464b-f5a4-4d41-b198-1cc465bf7602 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:18.128033 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 108/215] 10.222.0.24 () {56 vars in 1101 bytes} [Mon May 16 18:54:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:18.128662 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff464b-f5a4-4d41-b198-1cc465bf7602 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:18.137580 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 108/216] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:54:18.137580 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a49dd7-0bb7-4847-bfb9-7a4bbb5a2f37 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:18.232649 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff464b-f5a4-4d41-b198-1cc465bf7602 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:18.243630 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a49dd7-0bb7-4847-bfb9-7a4bbb5a2f37 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:18.263914 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8494aac-8893-46d7-94d9-51ade55acc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:18.264721 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8494aac-8893-46d7-94d9-51ade55acc3b None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:18.265009 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8494aac-8893-46d7-94d9-51ade55acc3b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:18.265281 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8494aac-8893-46d7-94d9-51ade55acc3b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:18.266492 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8494aac-8893-46d7-94d9-51ade55acc3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:18.267976 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8494aac-8893-46d7-94d9-51ade55acc3b None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:18.269789 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 109/217] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:54:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:18.270383 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8494aac-8893-46d7-94d9-51ade55acc3b None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:18.280752 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf1e79-b578-4d1e-95db-76688242e557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:18.281904 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf1e79-b578-4d1e-95db-76688242e557 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:18.282344 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf1e79-b578-4d1e-95db-76688242e557 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:18.282755 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf1e79-b578-4d1e-95db-76688242e557 None admin] PATH_INFO: `/v3/users/5750e6fb77174d87b09b9121fae6e803` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:18.295903 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cf1e79-b578-4d1e-95db-76688242e557 None admin] RBAC: Authorizing `identity:get_user(user_id=5750e6fb77174d87b09b9121fae6e803)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:18.297571 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cf1e79-b578-4d1e-95db-76688242e557 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:18.299395 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 109/218] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:54:18 2022] GET /identity/v3/users/5750e6fb77174d87b09b9121fae6e803 => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:18.300301 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf1e79-b578-4d1e-95db-76688242e557 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:18.373890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8494aac-8893-46d7-94d9-51ade55acc3b None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:18.395530 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf1e79-b578-4d1e-95db-76688242e557 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:18.406674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7874fa-9b2e-41dc-8aa8-a1d89cc0c1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:18.407494 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7874fa-9b2e-41dc-8aa8-a1d89cc0c1c6 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:18.407796 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7874fa-9b2e-41dc-8aa8-a1d89cc0c1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:18.408041 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7874fa-9b2e-41dc-8aa8-a1d89cc0c1c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:18.418548 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7874fa-9b2e-41dc-8aa8-a1d89cc0c1c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:18.426349 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-da7874fa-9b2e-41dc-8aa8-a1d89cc0c1c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:54:18.426349 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:18.426349 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:18.426349 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:18.426349 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:18.426349 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:18.426349 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:18.426349 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:18.426349 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:18.426349 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:18.426349 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:18.426349 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:18.426349 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:18.426349 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:18.426349 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:18.426349 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:18.427291 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:18.427291 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:18.427291 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:18.427291 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:18.427291 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:18.427291 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:18.427291 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:18.427291 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:18.427291 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:18.427291 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:18.427291 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:18.427291 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:18.427291 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:18.427291 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:18.427291 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:18.427291 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:18.428071 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:18.428071 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:18.428071 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:18.428071 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:18.428071 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:18.428071 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:18.428071 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:18.428071 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:18.428071 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:18.428071 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:18.428071 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:54:18.428071 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:18.429404 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66a331-7761-4385-983f-d2d2a45e1ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:18.430121 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66a331-7761-4385-983f-d2d2a45e1ef2 None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:18.430398 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66a331-7761-4385-983f-d2d2a45e1ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:18.430662 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66a331-7761-4385-983f-d2d2a45e1ef2 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:18.431391 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66a331-7761-4385-983f-d2d2a45e1ef2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:18.432424 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 110/219] 10.222.0.24 () {56 vars in 1096 bytes} [Mon May 16 18:54:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:18.433119 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66a331-7761-4385-983f-d2d2a45e1ef2 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:18.433328 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7874fa-9b2e-41dc-8aa8-a1d89cc0c1c6 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:18.454643 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 110/220] 10.222.0.24 () {60 vars in 1132 bytes} [Mon May 16 18:54:18 2022] POST /identity/v3/users => generated 297 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:54:18.465794 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66a331-7761-4385-983f-d2d2a45e1ef2 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:18.569159 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66a331-7761-4385-983f-d2d2a45e1ef2 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:18.581863 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7874fa-9b2e-41dc-8aa8-a1d89cc0c1c6 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:18.614092 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223494c-e6ad-432a-ac47-0ea41cd73d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:18.615080 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223494c-e6ad-432a-ac47-0ea41cd73d11 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:18.615358 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223494c-e6ad-432a-ac47-0ea41cd73d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:18.615637 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223494c-e6ad-432a-ac47-0ea41cd73d11 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:18.616408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6223494c-e6ad-432a-ac47-0ea41cd73d11 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:18.616719 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6223494c-e6ad-432a-ac47-0ea41cd73d11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:18.618177 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6223494c-e6ad-432a-ac47-0ea41cd73d11 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:18.618543 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df8875-7efc-434f-9314-249110e51180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:18.619209 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df8875-7efc-434f-9314-249110e51180 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:18.619492 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df8875-7efc-434f-9314-249110e51180 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:18.619765 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df8875-7efc-434f-9314-249110e51180 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:18.628499 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 111/221] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:54:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:18.634676 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223494c-e6ad-432a-ac47-0ea41cd73d11 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:18.698893 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df8875-7efc-434f-9314-249110e51180 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:18.700946 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df8875-7efc-434f-9314-249110e51180 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:18.745635 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223494c-e6ad-432a-ac47-0ea41cd73d11 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:18.782951 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc6d9b-afb1-4aaa-92b0-3e7f07b76dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:18.784248 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc6d9b-afb1-4aaa-92b0-3e7f07b76dda None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:18.784529 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc6d9b-afb1-4aaa-92b0-3e7f07b76dda None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:18.784804 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc6d9b-afb1-4aaa-92b0-3e7f07b76dda None admin] PATH_INFO: `/v3/users/3fef82fd38504838b9bcdb44cd6f500b` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:18.786901 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc6d9b-afb1-4aaa-92b0-3e7f07b76dda None admin] RBAC: Authorizing `identity:get_user(user_id=3fef82fd38504838b9bcdb44cd6f500b)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:18.788387 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc6d9b-afb1-4aaa-92b0-3e7f07b76dda None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:18.790623 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 112/222] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:54:18 2022] GET /identity/v3/users/3fef82fd38504838b9bcdb44cd6f500b => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:18.795972 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc6d9b-afb1-4aaa-92b0-3e7f07b76dda None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:18.808474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 111/223] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:54:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:54:18.810358 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df8875-7efc-434f-9314-249110e51180 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:18.899425 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc6d9b-afb1-4aaa-92b0-3e7f07b76dda None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:18.922761 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df8875-7efc-434f-9314-249110e51180 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:18.940039 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a288af8-43aa-48bd-ba86-9ff3491e75fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:18.940935 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a288af8-43aa-48bd-ba86-9ff3491e75fd None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:18.941216 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a288af8-43aa-48bd-ba86-9ff3491e75fd None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:18.941491 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a288af8-43aa-48bd-ba86-9ff3491e75fd None admin] PATH_INFO: `/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:18.942825 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a288af8-43aa-48bd-ba86-9ff3491e75fd None admin] RBAC: Authorizing `identity:get_project(project_id=4e1cc38a8ece4d619be76f0ba70f8f1b)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:18.944317 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a288af8-43aa-48bd-ba86-9ff3491e75fd None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:18.946276 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 113/224] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:54:18 2022] GET /identity/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:54:18.952067 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a288af8-43aa-48bd-ba86-9ff3491e75fd None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:18.961629 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee94f95-834f-4383-840c-663121547ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:18.962814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee94f95-834f-4383-840c-663121547ddb None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:18.963239 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee94f95-834f-4383-840c-663121547ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:18.963649 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee94f95-834f-4383-840c-663121547ddb None admin] PATH_INFO: `/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:18.965186 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee94f95-834f-4383-840c-663121547ddb None admin] RBAC: Authorizing `identity:get_project(project_id=4e1cc38a8ece4d619be76f0ba70f8f1b)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:18.967258 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee94f95-834f-4383-840c-663121547ddb None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:18.970204 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 112/225] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:54:18 2022] GET /identity/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:54:18.975868 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee94f95-834f-4383-840c-663121547ddb None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:19.052778 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a288af8-43aa-48bd-ba86-9ff3491e75fd None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:19.086568 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d52bd-a29a-49f1-8b67-0a7cf8ed5024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:19.087507 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d52bd-a29a-49f1-8b67-0a7cf8ed5024 None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:19.087852 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d52bd-a29a-49f1-8b67-0a7cf8ed5024 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:19.088137 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d52bd-a29a-49f1-8b67-0a7cf8ed5024 None admin] PATH_INFO: `/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b/users/3fef82fd38504838b9bcdb44cd6f500b/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:19.090180 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d52bd-a29a-49f1-8b67-0a7cf8ed5024 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e1cc38a8ece4d619be76f0ba70f8f1b, user_id=3fef82fd38504838b9bcdb44cd6f500b, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:19.091669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d52bd-a29a-49f1-8b67-0a7cf8ed5024 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:19.107980 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 114/226] 10.222.0.24 () {58 vars in 1439 bytes} [Mon May 16 18:54:18 2022] PUT /identity/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b/users/3fef82fd38504838b9bcdb44cd6f500b/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:54:19.109658 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af3adb-95a8-4e5d-a282-cc4ea35bd754 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:19.113769 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af3adb-95a8-4e5d-a282-cc4ea35bd754 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:19.114112 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af3adb-95a8-4e5d-a282-cc4ea35bd754 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:19.115890 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 115/227] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:19.122228 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc2d06-f5d6-494c-9c9d-4f48e452a323 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:19.122517 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc2d06-f5d6-494c-9c9d-4f48e452a323 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:19.122789 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc2d06-f5d6-494c-9c9d-4f48e452a323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:19.132746 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee94f95-834f-4383-840c-663121547ddb None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:19.160387 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-03bc2d06-f5d6-494c-9c9d-4f48e452a323 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:19.161691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-03bc2d06-f5d6-494c-9c9d-4f48e452a323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:19.202570 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a6569-8ab2-42e1-a543-62e791293f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:19.203313 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a6569-8ab2-42e1-a543-62e791293f02 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:19.203621 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a6569-8ab2-42e1-a543-62e791293f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:19.203866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a6569-8ab2-42e1-a543-62e791293f02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:19.204896 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a6569-8ab2-42e1-a543-62e791293f02 None admin] RBAC: Adding query filter params (role.id=b0e5c5e3b5f54789a5a5c4c51220c97e, scope.project.id=4e1cc38a8ece4d619be76f0ba70f8f1b, user.id=5750e6fb77174d87b09b9121fae6e803) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:19.206113 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a6569-8ab2-42e1-a543-62e791293f02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:19.207678 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a6569-8ab2-42e1-a543-62e791293f02 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:19.218728 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 113/228] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:54:18 2022] GET /identity/v3/role_assignments?user.id=5750e6fb77174d87b09b9121fae6e803&scope.project.id=4e1cc38a8ece4d619be76f0ba70f8f1b&role.id=b0e5c5e3b5f54789a5a5c4c51220c97e => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:19.271642 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 116/229] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:54:19.309430 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a6569-8ab2-42e1-a543-62e791293f02 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:19.429229 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a6569-8ab2-42e1-a543-62e791293f02 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:19.467861 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61daba3e-85ec-4dbc-b080-258a0a2ea819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:19.468704 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61daba3e-85ec-4dbc-b080-258a0a2ea819 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:19.468978 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61daba3e-85ec-4dbc-b080-258a0a2ea819 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:19.469240 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61daba3e-85ec-4dbc-b080-258a0a2ea819 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:19.481196 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61daba3e-85ec-4dbc-b080-258a0a2ea819 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:19.489716 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-61daba3e-85ec-4dbc-b080-258a0a2ea819 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:54:19.489716 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:19.489716 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:19.489716 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:19.489716 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:19.489716 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:19.489716 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:19.489716 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:19.489716 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:19.489716 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:19.489716 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:19.489716 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:19.489716 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:19.489716 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:19.489716 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:19.489716 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:19.490669 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:19.490669 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:19.490669 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:19.490669 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:19.490669 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:19.490669 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:19.490669 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:19.490669 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:19.490669 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:19.490669 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:19.490669 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:19.490669 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:19.490669 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:19.490669 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:19.490669 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:19.490669 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:19.491441 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:19.491441 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:19.491441 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:19.491441 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:19.491441 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:19.491441 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:19.491441 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:19.491441 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:19.491441 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:19.491441 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:19.491441 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:54:19.491441 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:19.491441 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 114/230] 10.222.0.24 () {56 vars in 1114 bytes} [Mon May 16 18:54:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:19.497051 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc2d06-f5d6-494c-9c9d-4f48e452a323 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:19.616164 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc2d06-f5d6-494c-9c9d-4f48e452a323 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:19.655470 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae2945-ad75-475a-9288-25a018d2656a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:19.656142 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae2945-ad75-475a-9288-25a018d2656a None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:19.656413 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae2945-ad75-475a-9288-25a018d2656a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:19.656680 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae2945-ad75-475a-9288-25a018d2656a None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:19.657428 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ae2945-ad75-475a-9288-25a018d2656a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:19.657758 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ae2945-ad75-475a-9288-25a018d2656a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:19.659153 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ae2945-ad75-475a-9288-25a018d2656a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:19.673017 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 117/231] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:54:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:19.678827 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61daba3e-85ec-4dbc-b080-258a0a2ea819 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:19.791774 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61daba3e-85ec-4dbc-b080-258a0a2ea819 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:19.824505 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1082c98-12bc-4654-a694-f2551106a4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:19.825391 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1082c98-12bc-4654-a694-f2551106a4fd None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:19.825730 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1082c98-12bc-4654-a694-f2551106a4fd None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:19.826003 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1082c98-12bc-4654-a694-f2551106a4fd None admin] PATH_INFO: `/v3/users/3fef82fd38504838b9bcdb44cd6f500b` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:19.827338 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1082c98-12bc-4654-a694-f2551106a4fd None admin] RBAC: Authorizing `identity:get_user(user_id=3fef82fd38504838b9bcdb44cd6f500b)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:19.828861 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1082c98-12bc-4654-a694-f2551106a4fd None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:19.830533 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 115/232] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:54:19 2022] GET /identity/v3/users/3fef82fd38504838b9bcdb44cd6f500b => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:19.836250 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae2945-ad75-475a-9288-25a018d2656a None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:19.965714 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae2945-ad75-475a-9288-25a018d2656a None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:20.003312 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949727b6-f3b7-4f4c-9e3b-3330df5230a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:20.004198 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949727b6-f3b7-4f4c-9e3b-3330df5230a4 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:20.004471 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949727b6-f3b7-4f4c-9e3b-3330df5230a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:20.004742 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949727b6-f3b7-4f4c-9e3b-3330df5230a4 None admin] PATH_INFO: `/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:20.005973 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949727b6-f3b7-4f4c-9e3b-3330df5230a4 None admin] RBAC: Authorizing `identity:get_project(project_id=4e1cc38a8ece4d619be76f0ba70f8f1b)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:20.007457 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949727b6-f3b7-4f4c-9e3b-3330df5230a4 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:20.009188 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 118/233] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:54:19 2022] GET /identity/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:20.018597 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1082c98-12bc-4654-a694-f2551106a4fd None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:20.157136 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1082c98-12bc-4654-a694-f2551106a4fd None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:20.204570 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4acfa1c-11ab-4892-8ebb-e5302085f60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:20.205523 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acfa1c-11ab-4892-8ebb-e5302085f60f None admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:20.205864 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acfa1c-11ab-4892-8ebb-e5302085f60f None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:20.206137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acfa1c-11ab-4892-8ebb-e5302085f60f None admin] PATH_INFO: `/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b/users/3fef82fd38504838b9bcdb44cd6f500b/roles/fda97f4c5b1f4e1ba165f8dfa70ddbd6` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:20.211515 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4acfa1c-11ab-4892-8ebb-e5302085f60f None admin] RBAC: Authorizing `identity:create_grant(project_id=4e1cc38a8ece4d619be76f0ba70f8f1b, user_id=3fef82fd38504838b9bcdb44cd6f500b, role_id=fda97f4c5b1f4e1ba165f8dfa70ddbd6)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:20.212971 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4acfa1c-11ab-4892-8ebb-e5302085f60f None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:20.239898 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 116/234] 10.222.0.24 () {58 vars in 1439 bytes} [Mon May 16 18:54:20 2022] PUT /identity/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b/users/3fef82fd38504838b9bcdb44cd6f500b/roles/fda97f4c5b1f4e1ba165f8dfa70ddbd6 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:54:21.265569 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f416d-eb13-46b5-bce7-bf0d6e7f2b16 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:21.265569 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f416d-eb13-46b5-bce7-bf0d6e7f2b16 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:21.265569 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f416d-eb13-46b5-bce7-bf0d6e7f2b16 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:21.266755 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 119/235] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:21.272041 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312fee5-575f-4b73-82ff-4d8c2657418d None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:21.272462 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312fee5-575f-4b73-82ff-4d8c2657418d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:21.272591 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312fee5-575f-4b73-82ff-4d8c2657418d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:21.302585 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-b312fee5-575f-4b73-82ff-4d8c2657418d None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:21.303775 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-b312fee5-575f-4b73-82ff-4d8c2657418d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:21.394099 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 117/236] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:54:21.416950 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f416d-eb13-46b5-bce7-bf0d6e7f2b16 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:21.538198 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f416d-eb13-46b5-bce7-bf0d6e7f2b16 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:21.543630 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0f6dc-7b85-4a9a-a6fb-407195b62cea None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:21.543919 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0f6dc-7b85-4a9a-a6fb-407195b62cea None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:21.544195 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0f6dc-7b85-4a9a-a6fb-407195b62cea None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:21.545766 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 118/237] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:21.550881 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19070c-f4c4-4188-b52f-283a1ad2e2a4 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:21.551408 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19070c-f4c4-4188-b52f-283a1ad2e2a4 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:21.551878 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19070c-f4c4-4188-b52f-283a1ad2e2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:21.583057 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548fe1b-d804-4a04-9c0a-3fabcadcbcc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:21.584248 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548fe1b-d804-4a04-9c0a-3fabcadcbcc4 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:21.584725 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548fe1b-d804-4a04-9c0a-3fabcadcbcc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:21.585187 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548fe1b-d804-4a04-9c0a-3fabcadcbcc4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:21.592446 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-5d19070c-f4c4-4188-b52f-283a1ad2e2a4 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:21.596506 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-5d19070c-f4c4-4188-b52f-283a1ad2e2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:21.611295 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9548fe1b-d804-4a04-9c0a-3fabcadcbcc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:21.619664 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-9548fe1b-d804-4a04-9c0a-3fabcadcbcc4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 18:54:21.619664 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:21.619664 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:21.619664 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:21.619664 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:21.619664 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:21.619664 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:21.619664 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:21.619664 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:21.619664 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:21.619664 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:21.619664 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:21.619664 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:21.619664 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:21.619664 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:21.619664 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:21.620764 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:21.620764 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:21.620764 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:21.620764 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:21.620764 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:21.620764 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:21.620764 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:21.620764 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:21.620764 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:21.620764 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:21.620764 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:21.620764 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:54:21.620764 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:21.620764 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:21.620764 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:21.620764 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:21.621621 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:21.621621 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:21.621621 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:21.621621 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:21.621621 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:21.621621 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:21.621621 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:21.621621 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:21.621621 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:21.621621 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:21.621621 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 18:54:21.621621 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:54:21.628350 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 120/238] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:54:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:21.631981 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548fe1b-d804-4a04-9c0a-3fabcadcbcc4 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:21.747286 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 119/239] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:54:21.763463 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548fe1b-d804-4a04-9c0a-3fabcadcbcc4 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:21.790673 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19070c-f4c4-4188-b52f-283a1ad2e2a4 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:21.805616 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95ef2c-97f2-4266-9c63-28398c95bd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:21.807067 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95ef2c-97f2-4266-9c63-28398c95bd75 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:21.807724 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95ef2c-97f2-4266-9c63-28398c95bd75 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:21.808227 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95ef2c-97f2-4266-9c63-28398c95bd75 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:21.809322 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95ef2c-97f2-4266-9c63-28398c95bd75 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:21.810089 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95ef2c-97f2-4266-9c63-28398c95bd75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:21.811771 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95ef2c-97f2-4266-9c63-28398c95bd75 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:21.824038 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 121/240] 10.222.0.24 () {56 vars in 1101 bytes} [Mon May 16 18:54:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:21.826284 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94623e8e-8d1b-4751-8886-4c9eae4612a4 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:21.826591 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94623e8e-8d1b-4751-8886-4c9eae4612a4 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:21.826838 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94623e8e-8d1b-4751-8886-4c9eae4612a4 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:21.828448 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 122/241] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:21.834499 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94623e8e-8d1b-4751-8886-4c9eae4612a4 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:21.899271 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19070c-f4c4-4188-b52f-283a1ad2e2a4 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:21.938886 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9684a838-f058-4426-bf69-aae1575a69d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:21.940344 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684a838-f058-4426-bf69-aae1575a69d1 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:21.940826 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684a838-f058-4426-bf69-aae1575a69d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:21.941319 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684a838-f058-4426-bf69-aae1575a69d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:21.943152 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9684a838-f058-4426-bf69-aae1575a69d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:21.945309 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9684a838-f058-4426-bf69-aae1575a69d1 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:21.948164 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 120/242] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:54:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:21.950207 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71833ff-60dd-4815-8810-4137c3effeb8 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:21.950811 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71833ff-60dd-4815-8810-4137c3effeb8 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:21.951246 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71833ff-60dd-4815-8810-4137c3effeb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:21.955597 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94623e8e-8d1b-4751-8886-4c9eae4612a4 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:21.972555 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-c71833ff-60dd-4815-8810-4137c3effeb8 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:21.974054 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-c71833ff-60dd-4815-8810-4137c3effeb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:21.993347 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52420b74-abef-4244-bcb8-bf1c502bc1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:21.994394 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52420b74-abef-4244-bcb8-bf1c502bc1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:21.994798 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52420b74-abef-4244-bcb8-bf1c502bc1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:21.995171 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52420b74-abef-4244-bcb8-bf1c502bc1c1 None admin] PATH_INFO: `/v3/users/4ed3753f36cd4a739c9a1458edd79689` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:22.009455 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52420b74-abef-4244-bcb8-bf1c502bc1c1 None admin] RBAC: Authorizing `identity:get_user(user_id=4ed3753f36cd4a739c9a1458edd79689)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:22.011097 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52420b74-abef-4244-bcb8-bf1c502bc1c1 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:22.013001 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 123/243] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:54:21 2022] GET /identity/v3/users/4ed3753f36cd4a739c9a1458edd79689 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:22.014025 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52420b74-abef-4244-bcb8-bf1c502bc1c1 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:22.062561 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 121/244] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:54:22.063568 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71833ff-60dd-4815-8810-4137c3effeb8 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:22.115780 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52420b74-abef-4244-bcb8-bf1c502bc1c1 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:22.148223 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43260123-2552-4875-964d-9494d5ba1bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:22.148895 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43260123-2552-4875-964d-9494d5ba1bb5 None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:22.149167 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43260123-2552-4875-964d-9494d5ba1bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:22.149432 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43260123-2552-4875-964d-9494d5ba1bb5 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:22.150184 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43260123-2552-4875-964d-9494d5ba1bb5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:22.151673 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43260123-2552-4875-964d-9494d5ba1bb5 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:22.175481 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 124/245] 10.222.0.24 () {60 vars in 1132 bytes} [Mon May 16 18:54:22 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:54:22.176124 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71833ff-60dd-4815-8810-4137c3effeb8 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:22.186582 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43260123-2552-4875-964d-9494d5ba1bb5 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:22.222579 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda2d49a-4e58-49f9-9052-ac5ebfc1d22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:22.223547 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2d49a-4e58-49f9-9052-ac5ebfc1d22d None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:22.223987 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2d49a-4e58-49f9-9052-ac5ebfc1d22d None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:22.224400 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2d49a-4e58-49f9-9052-ac5ebfc1d22d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:22.300319 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda2d49a-4e58-49f9-9052-ac5ebfc1d22d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:22.302660 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda2d49a-4e58-49f9-9052-ac5ebfc1d22d None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:22.372944 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43260123-2552-4875-964d-9494d5ba1bb5 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:22.411129 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 122/246] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:54:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:54:22.419190 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1bf6f-5050-4286-9f3a-4e0d27391c10 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:22.419495 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1bf6f-5050-4286-9f3a-4e0d27391c10 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:22.419769 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1bf6f-5050-4286-9f3a-4e0d27391c10 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:22.421829 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 123/247] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:22 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:22.423839 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1bf6f-5050-4286-9f3a-4e0d27391c10 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:22.428641 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a756aa7-218a-4cb6-9490-8a11dc5365d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:22.429737 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a756aa7-218a-4cb6-9490-8a11dc5365d0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:22.430253 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a756aa7-218a-4cb6-9490-8a11dc5365d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:22.430705 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a756aa7-218a-4cb6-9490-8a11dc5365d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:22.444303 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a756aa7-218a-4cb6-9490-8a11dc5365d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:22.452493 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-8a756aa7-218a-4cb6-9490-8a11dc5365d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:54:22.452493 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:22.452493 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:22.452493 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:22.452493 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:22.452493 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:22.452493 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:22.452493 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:22.452493 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:22.452493 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:22.452493 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:22.452493 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:22.452493 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:22.452493 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:22.452493 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:22.452493 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:22.453585 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:22.453585 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:22.453585 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:22.453585 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:22.453585 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:22.453585 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:22.453585 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:22.453585 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:22.453585 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:22.453585 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:22.453585 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:22.453585 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:54:22.453585 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:22.453585 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:22.453585 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:22.453585 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:22.454560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:22.454560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:22.454560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:22.454560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:22.454560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:22.454560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:22.454560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:22.454560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:22.454560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:22.454560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:22.454560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:54:22.454560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:54:22.456450 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 125/248] 10.222.0.24 () {56 vars in 1096 bytes} [Mon May 16 18:54:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:22.457845 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599f24e-2559-4ac6-a31d-80d3cc6be818 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:22.458265 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599f24e-2559-4ac6-a31d-80d3cc6be818 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:22.458664 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599f24e-2559-4ac6-a31d-80d3cc6be818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:22.479288 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-e599f24e-2559-4ac6-a31d-80d3cc6be818 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:22.481093 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e599f24e-2559-4ac6-a31d-80d3cc6be818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:22.559961 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1bf6f-5050-4286-9f3a-4e0d27391c10 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:22.574500 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 126/249] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:54:22.575522 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599f24e-2559-4ac6-a31d-80d3cc6be818 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:22.605645 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f113b7-23a8-4373-a2e3-a744a6e466b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:22.606968 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f113b7-23a8-4373-a2e3-a744a6e466b9 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:22.607554 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f113b7-23a8-4373-a2e3-a744a6e466b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:22.608321 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f113b7-23a8-4373-a2e3-a744a6e466b9 None admin] PATH_INFO: `/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:22.610017 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f113b7-23a8-4373-a2e3-a744a6e466b9 None admin] RBAC: Authorizing `identity:get_project(project_id=4e1cc38a8ece4d619be76f0ba70f8f1b)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:22.612698 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f113b7-23a8-4373-a2e3-a744a6e466b9 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:22.614747 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 124/250] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:54:22 2022] GET /identity/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:22.615728 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f113b7-23a8-4373-a2e3-a744a6e466b9 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:22.695624 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599f24e-2559-4ac6-a31d-80d3cc6be818 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:22.733699 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7d940-6a1c-4e30-a3f8-5821e9c4800a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:22.734507 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7d940-6a1c-4e30-a3f8-5821e9c4800a None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:22.734785 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7d940-6a1c-4e30-a3f8-5821e9c4800a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:22.735051 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7d940-6a1c-4e30-a3f8-5821e9c4800a None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:22.735962 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7d940-6a1c-4e30-a3f8-5821e9c4800a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:22.736269 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7d940-6a1c-4e30-a3f8-5821e9c4800a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:22.737709 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7d940-6a1c-4e30-a3f8-5821e9c4800a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:22.748090 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 127/251] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:54:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:22.748938 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7d940-6a1c-4e30-a3f8-5821e9c4800a None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:22.749955 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f113b7-23a8-4373-a2e3-a744a6e466b9 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:22.835260 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a06a80-7ee5-4272-bd69-fda7bfc4601a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:22.836452 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a06a80-7ee5-4272-bd69-fda7bfc4601a None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:22.836930 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a06a80-7ee5-4272-bd69-fda7bfc4601a None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:22.837398 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a06a80-7ee5-4272-bd69-fda7bfc4601a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:22.854045 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7d940-6a1c-4e30-a3f8-5821e9c4800a None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:22.866635 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a06a80-7ee5-4272-bd69-fda7bfc4601a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:22.882721 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-04a06a80-7ee5-4272-bd69-fda7bfc4601a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 18:54:22.882721 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:22.882721 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:22.882721 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:22.882721 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:22.882721 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:22.882721 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:22.882721 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:22.882721 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:22.882721 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:22.882721 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:22.882721 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:22.882721 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:22.882721 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:22.882721 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:22.882721 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:22.883715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:22.883715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:22.883715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:22.883715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:22.883715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:22.883715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:22.883715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:22.883715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:22.883715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:22.883715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:22.883715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:22.883715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:22.883715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:22.883715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:22.883715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:22.883715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:22.884495 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:22.884495 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:22.884495 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:22.884495 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:22.884495 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:22.884495 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:22.884495 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:22.884495 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:22.884495 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:22.884495 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:22.884495 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 18:54:22.884495 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:22.884495 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 125/252] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:54:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:22.885143 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a06a80-7ee5-4272-bd69-fda7bfc4601a None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:22.893196 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5cc063-962a-4dc1-bdc9-98fcbcfe7879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:22.893917 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5cc063-962a-4dc1-bdc9-98fcbcfe7879 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:22.894194 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5cc063-962a-4dc1-bdc9-98fcbcfe7879 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:22.894516 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5cc063-962a-4dc1-bdc9-98fcbcfe7879 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:22.896471 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5cc063-962a-4dc1-bdc9-98fcbcfe7879 None admin] RBAC: Adding query filter params (role.id=8f0019918cbf4b05aa6de1a3c0850251, scope.project.id=4e1cc38a8ece4d619be76f0ba70f8f1b, user.id=4ed3753f36cd4a739c9a1458edd79689) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:22.896801 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5cc063-962a-4dc1-bdc9-98fcbcfe7879 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:22.898598 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5cc063-962a-4dc1-bdc9-98fcbcfe7879 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:22.910469 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 128/253] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:54:22 2022] GET /identity/v3/role_assignments?user.id=4ed3753f36cd4a739c9a1458edd79689&scope.project.id=4e1cc38a8ece4d619be76f0ba70f8f1b&role.id=8f0019918cbf4b05aa6de1a3c0850251 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:22.911575 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5cc063-962a-4dc1-bdc9-98fcbcfe7879 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:23.029319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5cc063-962a-4dc1-bdc9-98fcbcfe7879 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:23.067066 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc601a98-df65-415b-bd81-23ff695441e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:23.067741 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc601a98-df65-415b-bd81-23ff695441e4 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:23.068025 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc601a98-df65-415b-bd81-23ff695441e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:23.068293 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc601a98-df65-415b-bd81-23ff695441e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:23.073577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc601a98-df65-415b-bd81-23ff695441e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:23.073577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc601a98-df65-415b-bd81-23ff695441e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:23.073577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc601a98-df65-415b-bd81-23ff695441e4 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:23.084462 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 129/254] 10.222.0.24 () {56 vars in 1101 bytes} [Mon May 16 18:54:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:23.086624 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c6d4d-8619-41a9-b784-0d38f9c0263b None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:23.086855 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c6d4d-8619-41a9-b784-0d38f9c0263b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:23.087129 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c6d4d-8619-41a9-b784-0d38f9c0263b None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:23.088920 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 130/255] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:23.093424 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c6d4d-8619-41a9-b784-0d38f9c0263b None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:23.151022 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a06a80-7ee5-4272-bd69-fda7bfc4601a None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:23.207652 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c6d4d-8619-41a9-b784-0d38f9c0263b None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:23.241793 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb392d99-afae-49dc-a493-d23555158e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:23.242708 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb392d99-afae-49dc-a493-d23555158e85 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:23.242990 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb392d99-afae-49dc-a493-d23555158e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:23.243261 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb392d99-afae-49dc-a493-d23555158e85 None admin] PATH_INFO: `/v3/users/3fef82fd38504838b9bcdb44cd6f500b` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:23.244501 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb392d99-afae-49dc-a493-d23555158e85 None admin] RBAC: Authorizing `identity:get_user(user_id=3fef82fd38504838b9bcdb44cd6f500b)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:23.244634 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9babd-3092-45ca-8379-6fe679028550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:23.245689 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9babd-3092-45ca-8379-6fe679028550 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:23.245966 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9babd-3092-45ca-8379-6fe679028550 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:23.246202 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb392d99-afae-49dc-a493-d23555158e85 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:23.246300 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9babd-3092-45ca-8379-6fe679028550 None admin] PATH_INFO: `/v3/users/5750e6fb77174d87b09b9121fae6e803` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:23.247405 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9babd-3092-45ca-8379-6fe679028550 None admin] RBAC: Authorizing `identity:get_user(user_id=5750e6fb77174d87b09b9121fae6e803)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:23.248283 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 126/256] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:54:22 2022] GET /identity/v3/users/3fef82fd38504838b9bcdb44cd6f500b => generated 283 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:23.249032 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9babd-3092-45ca-8379-6fe679028550 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:23.249496 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d29e7f-8e67-47c6-83ad-6e84297b81c7 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:23.249800 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d29e7f-8e67-47c6-83ad-6e84297b81c7 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:23.250070 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d29e7f-8e67-47c6-83ad-6e84297b81c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:23.250694 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 131/257] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:54:23 2022] GET /identity/v3/users/5750e6fb77174d87b09b9121fae6e803 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:23.253375 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9babd-3092-45ca-8379-6fe679028550 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:23.281614 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-54d29e7f-8e67-47c6-83ad-6e84297b81c7 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:23.282823 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-54d29e7f-8e67-47c6-83ad-6e84297b81c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:23.362124 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 127/258] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:54:23.362998 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d29e7f-8e67-47c6-83ad-6e84297b81c7 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:23.416631 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9babd-3092-45ca-8379-6fe679028550 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:23.459475 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2d973-8a9c-451a-b92d-5bedb6fdecad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:23.460142 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2d973-8a9c-451a-b92d-5bedb6fdecad None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:23.460419 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2d973-8a9c-451a-b92d-5bedb6fdecad None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:23.460689 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2d973-8a9c-451a-b92d-5bedb6fdecad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:23.474256 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d29e7f-8e67-47c6-83ad-6e84297b81c7 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:23.507864 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c739567-e256-4033-ae70-52c9f3b161e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:23.508741 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c739567-e256-4033-ae70-52c9f3b161e0 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:23.509016 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c739567-e256-4033-ae70-52c9f3b161e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:23.509284 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c739567-e256-4033-ae70-52c9f3b161e0 None admin] PATH_INFO: `/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:23.510712 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c739567-e256-4033-ae70-52c9f3b161e0 None admin] RBAC: Authorizing `identity:get_project(project_id=4e1cc38a8ece4d619be76f0ba70f8f1b)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:23.512241 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c739567-e256-4033-ae70-52c9f3b161e0 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:23.514325 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 128/259] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:54:23 2022] GET /identity/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:23.515216 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c739567-e256-4033-ae70-52c9f3b161e0 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:23.526010 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2d973-8a9c-451a-b92d-5bedb6fdecad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:23.527570 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2d973-8a9c-451a-b92d-5bedb6fdecad None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:23.635966 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 132/260] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:54:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:54:23.636745 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2d973-8a9c-451a-b92d-5bedb6fdecad None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:23.641993 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c739567-e256-4033-ae70-52c9f3b161e0 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:23.700744 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb59cc-577d-46ba-ad61-56b9166a185c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:23.701599 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb59cc-577d-46ba-ad61-56b9166a185c None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:23.701881 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb59cc-577d-46ba-ad61-56b9166a185c None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:23.702153 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb59cc-577d-46ba-ad61-56b9166a185c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:23.719618 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fb59cc-577d-46ba-ad61-56b9166a185c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:23.727841 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-67fb59cc-577d-46ba-ad61-56b9166a185c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:54:23.727841 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:23.727841 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:23.727841 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:23.727841 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:23.727841 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:23.727841 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:23.727841 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:23.727841 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:23.727841 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:23.727841 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:23.727841 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:23.727841 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:23.727841 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:23.727841 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:23.727841 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:23.729489 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:23.729489 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:23.729489 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:23.729489 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:23.729489 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:23.729489 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:23.729489 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:23.729489 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:23.729489 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:23.729489 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:23.729489 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:23.729489 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:23.729489 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:23.729489 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:23.729489 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:23.729489 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:23.730553 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:23.730553 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:23.730553 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:23.730553 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:23.730553 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:23.730553 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:23.730553 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:23.730553 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:23.730553 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:23.730553 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:23.730553 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:54:23.730553 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:23.730553 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 129/261] 10.222.0.24 () {56 vars in 1114 bytes} [Mon May 16 18:54:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:23.733630 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb59cc-577d-46ba-ad61-56b9166a185c None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:23.816527 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2d973-8a9c-451a-b92d-5bedb6fdecad None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:23.875673 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c445d-4237-40bd-885e-a657c2972e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:23.876580 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c445d-4237-40bd-885e-a657c2972e04 None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:23.876858 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c445d-4237-40bd-885e-a657c2972e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:23.877139 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c445d-4237-40bd-885e-a657c2972e04 None admin] PATH_INFO: `/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b/users/5750e6fb77174d87b09b9121fae6e803/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:23.882943 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c445d-4237-40bd-885e-a657c2972e04 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e1cc38a8ece4d619be76f0ba70f8f1b, user_id=5750e6fb77174d87b09b9121fae6e803, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:23.884408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c445d-4237-40bd-885e-a657c2972e04 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:23.896199 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb59cc-577d-46ba-ad61-56b9166a185c None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:23.932100 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96810e-ce6d-4581-b1f8-605f35824ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:23.932917 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 133/262] 10.222.0.24 () {58 vars in 1439 bytes} [Mon May 16 18:54:23 2022] PUT /identity/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b/users/5750e6fb77174d87b09b9121fae6e803/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:54:23.933190 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96810e-ce6d-4581-b1f8-605f35824ca8 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:23.933519 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96810e-ce6d-4581-b1f8-605f35824ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:23.933759 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c445d-4237-40bd-885e-a657c2972e04 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:23.933917 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96810e-ce6d-4581-b1f8-605f35824ca8 None admin] PATH_INFO: `/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:23.935278 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e96810e-ce6d-4581-b1f8-605f35824ca8 None admin] RBAC: Authorizing `identity:get_project(project_id=4e1cc38a8ece4d619be76f0ba70f8f1b)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:23.936907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e96810e-ce6d-4581-b1f8-605f35824ca8 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:23.938990 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 130/263] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:54:23 2022] GET /identity/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:23.944658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96810e-ce6d-4581-b1f8-605f35824ca8 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:24.146977 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c445d-4237-40bd-885e-a657c2972e04 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:24.175893 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96810e-ce6d-4581-b1f8-605f35824ca8 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:24.223615 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457f0c3-c3f9-4f35-a5d2-70520d75fd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:24.224350 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457f0c3-c3f9-4f35-a5d2-70520d75fd17 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:24.224636 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457f0c3-c3f9-4f35-a5d2-70520d75fd17 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:24.224910 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457f0c3-c3f9-4f35-a5d2-70520d75fd17 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:24.227825 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457f0c3-c3f9-4f35-a5d2-70520d75fd17 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:24.228134 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457f0c3-c3f9-4f35-a5d2-70520d75fd17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:24.230543 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457f0c3-c3f9-4f35-a5d2-70520d75fd17 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:24.250582 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357fbece-0add-4b2f-9e99-987916b60258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:24.251256 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357fbece-0add-4b2f-9e99-987916b60258 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:24.251537 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357fbece-0add-4b2f-9e99-987916b60258 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:24.251809 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357fbece-0add-4b2f-9e99-987916b60258 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:24.252661 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357fbece-0add-4b2f-9e99-987916b60258 None admin] RBAC: Adding query filter params (role.id=5a6e54e81bb24eceb618d9ffa67f488e, scope.project.id=4e1cc38a8ece4d619be76f0ba70f8f1b, user.id=3fef82fd38504838b9bcdb44cd6f500b) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:24.252975 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357fbece-0add-4b2f-9e99-987916b60258 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:24.254536 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357fbece-0add-4b2f-9e99-987916b60258 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:24.255173 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 134/264] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:54:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:24.256767 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457f0c3-c3f9-4f35-a5d2-70520d75fd17 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:24.274010 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 131/265] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:54:23 2022] GET /identity/v3/role_assignments?user.id=3fef82fd38504838b9bcdb44cd6f500b&scope.project.id=4e1cc38a8ece4d619be76f0ba70f8f1b&role.id=5a6e54e81bb24eceb618d9ffa67f488e => generated 608 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:24.388312 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457f0c3-c3f9-4f35-a5d2-70520d75fd17 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:24.422786 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f5e92-bc03-41f8-acd3-11ebe9ebd05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:24.423692 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f5e92-bc03-41f8-acd3-11ebe9ebd05e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:24.423970 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f5e92-bc03-41f8-acd3-11ebe9ebd05e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:24.424242 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f5e92-bc03-41f8-acd3-11ebe9ebd05e None admin] PATH_INFO: `/v3/users/3fef82fd38504838b9bcdb44cd6f500b` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:24.425455 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f5e92-bc03-41f8-acd3-11ebe9ebd05e None admin] RBAC: Authorizing `identity:get_user(user_id=3fef82fd38504838b9bcdb44cd6f500b)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:24.426970 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f5e92-bc03-41f8-acd3-11ebe9ebd05e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:24.428943 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 135/266] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:54:24 2022] GET /identity/v3/users/3fef82fd38504838b9bcdb44cd6f500b => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:24.434611 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357fbece-0add-4b2f-9e99-987916b60258 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:24.556595 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357fbece-0add-4b2f-9e99-987916b60258 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:24.592588 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808ad26-ad05-46bd-bf9b-7d61e8f252af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:24.593261 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808ad26-ad05-46bd-bf9b-7d61e8f252af None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:24.593562 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808ad26-ad05-46bd-bf9b-7d61e8f252af None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:24.593837 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808ad26-ad05-46bd-bf9b-7d61e8f252af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:24.664674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808ad26-ad05-46bd-bf9b-7d61e8f252af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:24.666209 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808ad26-ad05-46bd-bf9b-7d61e8f252af None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:24.770244 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 132/267] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:54:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:54:24.775849 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f5e92-bc03-41f8-acd3-11ebe9ebd05e None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:24.892596 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f5e92-bc03-41f8-acd3-11ebe9ebd05e None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:24.927829 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e84ed1-5ac8-4e71-9815-794d3e9927f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:24.928699 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e84ed1-5ac8-4e71-9815-794d3e9927f5 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:24.928977 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e84ed1-5ac8-4e71-9815-794d3e9927f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:24.929251 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e84ed1-5ac8-4e71-9815-794d3e9927f5 None admin] PATH_INFO: `/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:24.930464 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e84ed1-5ac8-4e71-9815-794d3e9927f5 None admin] RBAC: Authorizing `identity:get_project(project_id=4e1cc38a8ece4d619be76f0ba70f8f1b)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:24.931944 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e84ed1-5ac8-4e71-9815-794d3e9927f5 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:24.934038 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 136/268] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:54:24 2022] GET /identity/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:24.942664 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808ad26-ad05-46bd-bf9b-7d61e8f252af None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:25.048066 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808ad26-ad05-46bd-bf9b-7d61e8f252af None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:25.072252 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183428a1-7f32-4eb5-8707-7a76e182a7fe None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:25.072596 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183428a1-7f32-4eb5-8707-7a76e182a7fe None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:25.072800 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183428a1-7f32-4eb5-8707-7a76e182a7fe None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:25.074597 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 137/269] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:54:25.079553 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178d29f-e06c-4a54-a5f2-52c59efa56b7 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:25.079831 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178d29f-e06c-4a54-a5f2-52c59efa56b7 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:25.080099 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178d29f-e06c-4a54-a5f2-52c59efa56b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:25.093567 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29818bb7-aca9-40c8-98b2-4cd16c7cc164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:25.094250 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29818bb7-aca9-40c8-98b2-4cd16c7cc164 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:25.094528 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29818bb7-aca9-40c8-98b2-4cd16c7cc164 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:25.094793 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29818bb7-aca9-40c8-98b2-4cd16c7cc164 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:25.095625 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29818bb7-aca9-40c8-98b2-4cd16c7cc164 None admin] RBAC: Adding query filter params (role.id=fda97f4c5b1f4e1ba165f8dfa70ddbd6, scope.project.id=4e1cc38a8ece4d619be76f0ba70f8f1b, user.id=3fef82fd38504838b9bcdb44cd6f500b) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:25.095932 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29818bb7-aca9-40c8-98b2-4cd16c7cc164 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:25.097386 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29818bb7-aca9-40c8-98b2-4cd16c7cc164 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:25.098869 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-8178d29f-e06c-4a54-a5f2-52c59efa56b7 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:25.100271 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-8178d29f-e06c-4a54-a5f2-52c59efa56b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:25.105482 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 133/270] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:54:24 2022] GET /identity/v3/role_assignments?user.id=3fef82fd38504838b9bcdb44cd6f500b&scope.project.id=4e1cc38a8ece4d619be76f0ba70f8f1b&role.id=fda97f4c5b1f4e1ba165f8dfa70ddbd6 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:25.190692 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 138/271] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:54:25.216423 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29818bb7-aca9-40c8-98b2-4cd16c7cc164 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:25.343491 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29818bb7-aca9-40c8-98b2-4cd16c7cc164 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:25.381206 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185c156-009e-4561-827b-8282b4f9922f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:25.382053 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185c156-009e-4561-827b-8282b4f9922f None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:25.382337 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185c156-009e-4561-827b-8282b4f9922f None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:25.382605 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185c156-009e-4561-827b-8282b4f9922f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:25.383787 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5185c156-009e-4561-827b-8282b4f9922f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:25.385256 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5185c156-009e-4561-827b-8282b4f9922f None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:25.387339 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 134/272] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:54:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:25.392886 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178d29f-e06c-4a54-a5f2-52c59efa56b7 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:25.424920 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab71c5-ce8c-4eca-b7b4-50bbfa0dd898 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:25.425570 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab71c5-ce8c-4eca-b7b4-50bbfa0dd898 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:25.426099 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab71c5-ce8c-4eca-b7b4-50bbfa0dd898 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:25.427920 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 135/273] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:25.433641 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1de4e-52a3-49d9-8329-390032b8a242 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:25.434164 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1de4e-52a3-49d9-8329-390032b8a242 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:25.434450 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1de4e-52a3-49d9-8329-390032b8a242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:25.453218 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-ead1de4e-52a3-49d9-8329-390032b8a242 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:25.455106 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-ead1de4e-52a3-49d9-8329-390032b8a242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:25.505285 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178d29f-e06c-4a54-a5f2-52c59efa56b7 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:25.522362 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 136/274] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:54:25.543773 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e46cc-a991-4792-b7da-70c5e175c5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:25.544690 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e46cc-a991-4792-b7da-70c5e175c5f7 None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:25.545138 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e46cc-a991-4792-b7da-70c5e175c5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:25.545571 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e46cc-a991-4792-b7da-70c5e175c5f7 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:25.546424 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40e46cc-a991-4792-b7da-70c5e175c5f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:25.548026 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40e46cc-a991-4792-b7da-70c5e175c5f7 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:25.557626 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead1de4e-52a3-49d9-8329-390032b8a242 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:25.581035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 139/275] 10.222.0.24 () {60 vars in 1132 bytes} [Mon May 16 18:54:25 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:54:25.672220 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead1de4e-52a3-49d9-8329-390032b8a242 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:25.708583 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34517eaf-9bb1-44c3-a60f-eebf32ae9878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:25.709439 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34517eaf-9bb1-44c3-a60f-eebf32ae9878 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:25.709738 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34517eaf-9bb1-44c3-a60f-eebf32ae9878 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:25.710003 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34517eaf-9bb1-44c3-a60f-eebf32ae9878 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:25.721929 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34517eaf-9bb1-44c3-a60f-eebf32ae9878 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:25.729867 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-34517eaf-9bb1-44c3-a60f-eebf32ae9878 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 18:54:25.729867 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:25.729867 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:25.729867 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:25.729867 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:25.729867 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:25.729867 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:25.729867 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:25.729867 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:25.729867 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:25.729867 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:25.729867 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:25.729867 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:25.729867 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:25.729867 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:25.729867 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:25.730799 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:25.730799 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:25.730799 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:25.730799 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:25.730799 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:25.730799 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:25.730799 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:25.730799 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:25.730799 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:25.730799 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:25.730799 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:25.730799 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:25.730799 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:25.730799 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:25.730799 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:25.730799 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:25.731572 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:25.731572 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:25.731572 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:25.731572 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:25.731572 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:25.731572 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:25.731572 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:25.731572 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:25.731572 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:25.731572 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:25.731572 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 18:54:25.731572 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:25.731572 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 137/276] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:54:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:25.737336 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e46cc-a991-4792-b7da-70c5e175c5f7 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:25.852177 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e46cc-a991-4792-b7da-70c5e175c5f7 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:25.884511 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86230e03-b13d-4037-b6e4-3d950760aecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:25.885206 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86230e03-b13d-4037-b6e4-3d950760aecb None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:25.885487 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86230e03-b13d-4037-b6e4-3d950760aecb None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:25.885765 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86230e03-b13d-4037-b6e4-3d950760aecb None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:25.886728 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86230e03-b13d-4037-b6e4-3d950760aecb None admin] RBAC: Adding query filter params (name=member) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:25.887032 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86230e03-b13d-4037-b6e4-3d950760aecb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:25.888463 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86230e03-b13d-4037-b6e4-3d950760aecb None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:25.902898 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 140/277] 10.222.0.24 () {56 vars in 1101 bytes} [Mon May 16 18:54:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:25.904473 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34517eaf-9bb1-44c3-a60f-eebf32ae9878 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:26.025641 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34517eaf-9bb1-44c3-a60f-eebf32ae9878 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:26.058874 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d62c6e-2a8b-4880-9b57-af69858d10be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:26.059790 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d62c6e-2a8b-4880-9b57-af69858d10be None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:26.060034 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d62c6e-2a8b-4880-9b57-af69858d10be None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:26.060302 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d62c6e-2a8b-4880-9b57-af69858d10be None admin] PATH_INFO: `/v3/users/877babc2744146cb8ffde2d0a9bfd5d8` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:26.073781 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d62c6e-2a8b-4880-9b57-af69858d10be None admin] RBAC: Authorizing `identity:get_user(user_id=877babc2744146cb8ffde2d0a9bfd5d8)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:26.075264 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d62c6e-2a8b-4880-9b57-af69858d10be None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:26.081734 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 138/278] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:54:25 2022] GET /identity/v3/users/877babc2744146cb8ffde2d0a9bfd5d8 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:26.083148 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86230e03-b13d-4037-b6e4-3d950760aecb None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:26.087017 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3e3b8-34ef-4b6c-a820-8a2896a0465b None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:26.087308 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3e3b8-34ef-4b6c-a820-8a2896a0465b None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:26.087591 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3e3b8-34ef-4b6c-a820-8a2896a0465b None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:26.089242 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 139/279] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:54:26.095039 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec82368-55f6-400d-b2d5-d46ecf88ead3 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:26.095325 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec82368-55f6-400d-b2d5-d46ecf88ead3 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:26.095604 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec82368-55f6-400d-b2d5-d46ecf88ead3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:26.114411 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-4ec82368-55f6-400d-b2d5-d46ecf88ead3 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:26.115437 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-4ec82368-55f6-400d-b2d5-d46ecf88ead3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:26.200590 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 140/280] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:54:26.208003 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86230e03-b13d-4037-b6e4-3d950760aecb None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:26.225323 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec82368-55f6-400d-b2d5-d46ecf88ead3 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:26.241398 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98474f35-6d4d-4881-850e-d072aa70a6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:26.242351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98474f35-6d4d-4881-850e-d072aa70a6c5 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:26.242791 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98474f35-6d4d-4881-850e-d072aa70a6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:26.243198 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98474f35-6d4d-4881-850e-d072aa70a6c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:26.244202 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98474f35-6d4d-4881-850e-d072aa70a6c5 None admin] RBAC: Adding query filter params (role.id=b0e5c5e3b5f54789a5a5c4c51220c97e, user.id=877babc2744146cb8ffde2d0a9bfd5d8, scope.system=all) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:26.244646 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98474f35-6d4d-4881-850e-d072aa70a6c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:26.246450 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98474f35-6d4d-4881-850e-d072aa70a6c5 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:26.257694 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 141/281] 10.222.0.24 () {56 vars in 1308 bytes} [Mon May 16 18:54:26 2022] GET /identity/v3/role_assignments?user.id=877babc2744146cb8ffde2d0a9bfd5d8&scope.system=all&role.id=b0e5c5e3b5f54789a5a5c4c51220c97e => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:26.339601 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec82368-55f6-400d-b2d5-d46ecf88ead3 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:26.376641 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4631cb-7214-4d9d-89bf-ca7853090ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:26.377471 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4631cb-7214-4d9d-89bf-ca7853090ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:26.377781 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4631cb-7214-4d9d-89bf-ca7853090ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:26.378052 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4631cb-7214-4d9d-89bf-ca7853090ca2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:26.389742 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4631cb-7214-4d9d-89bf-ca7853090ca2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:26.397692 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-bc4631cb-7214-4d9d-89bf-ca7853090ca2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 18:54:26.397692 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:26.397692 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:26.397692 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:26.397692 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:26.397692 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:26.397692 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:26.397692 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:26.397692 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:26.397692 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:26.397692 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:26.397692 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:26.397692 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:26.397692 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:26.397692 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:26.397692 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:26.398627 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:26.398627 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:26.398627 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:26.398627 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:26.398627 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:26.398627 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:26.398627 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:26.398627 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:26.398627 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:26.398627 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:26.398627 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:26.398627 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:26.398627 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:26.398627 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:26.398627 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:26.398627 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:26.399839 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:26.399839 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:26.399839 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:26.399839 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:26.399839 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:26.399839 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:26.399839 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:26.399839 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:26.399839 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:26.399839 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:26.399839 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 18:54:26.399839 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:26.399839 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 141/282] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:54:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:26.405202 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98474f35-6d4d-4881-850e-d072aa70a6c5 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:26.526965 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98474f35-6d4d-4881-850e-d072aa70a6c5 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:26.565754 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c11c2-8016-4ca7-8e97-13dac0c77be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:26.566769 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c11c2-8016-4ca7-8e97-13dac0c77be5 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:26.567223 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c11c2-8016-4ca7-8e97-13dac0c77be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:26.567684 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c11c2-8016-4ca7-8e97-13dac0c77be5 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:26.568603 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c11c2-8016-4ca7-8e97-13dac0c77be5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:26.569067 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c11c2-8016-4ca7-8e97-13dac0c77be5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:26.570667 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c11c2-8016-4ca7-8e97-13dac0c77be5 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:26.580390 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 142/283] 10.222.0.24 () {56 vars in 1101 bytes} [Mon May 16 18:54:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:26.587536 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4631cb-7214-4d9d-89bf-ca7853090ca2 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:26.719098 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4631cb-7214-4d9d-89bf-ca7853090ca2 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:26.762709 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9f5ea-dc00-4461-83e9-ba4726250d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:26.763614 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9f5ea-dc00-4461-83e9-ba4726250d07 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:26.763885 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9f5ea-dc00-4461-83e9-ba4726250d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:26.764151 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9f5ea-dc00-4461-83e9-ba4726250d07 None admin] PATH_INFO: `/v3/users/4ed3753f36cd4a739c9a1458edd79689` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:26.765352 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9f5ea-dc00-4461-83e9-ba4726250d07 None admin] RBAC: Authorizing `identity:get_user(user_id=4ed3753f36cd4a739c9a1458edd79689)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:26.766842 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9f5ea-dc00-4461-83e9-ba4726250d07 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:26.772971 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 142/284] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:54:26 2022] GET /identity/v3/users/4ed3753f36cd4a739c9a1458edd79689 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:26.774764 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c11c2-8016-4ca7-8e97-13dac0c77be5 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:26.897156 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c11c2-8016-4ca7-8e97-13dac0c77be5 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:26.943167 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06f64d-6967-4c63-ba06-d636f993ab9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:26.944408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06f64d-6967-4c63-ba06-d636f993ab9b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:26.944882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06f64d-6967-4c63-ba06-d636f993ab9b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:26.945345 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06f64d-6967-4c63-ba06-d636f993ab9b None admin] PATH_INFO: `/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:26.946891 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f06f64d-6967-4c63-ba06-d636f993ab9b None admin] RBAC: Authorizing `identity:get_project(project_id=4e1cc38a8ece4d619be76f0ba70f8f1b)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:26.948613 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f06f64d-6967-4c63-ba06-d636f993ab9b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:26.950584 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 143/285] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:54:26 2022] GET /identity/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:26.956726 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9f5ea-dc00-4461-83e9-ba4726250d07 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:27.106550 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9f5ea-dc00-4461-83e9-ba4726250d07 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:27.131763 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c4f4e-402a-4684-95e5-b356b2bb8648 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:27.132369 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c4f4e-402a-4684-95e5-b356b2bb8648 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:27.132856 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c4f4e-402a-4684-95e5-b356b2bb8648 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:27.135150 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 144/286] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:27.141275 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf80e0-868a-4e46-94f5-a70d2932237a None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:27.141843 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf80e0-868a-4e46-94f5-a70d2932237a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:27.142720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf80e0-868a-4e46-94f5-a70d2932237a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:27.171278 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba4b3e-e987-497f-bc4f-6a58225f36a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:27.172200 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba4b3e-e987-497f-bc4f-6a58225f36a3 None admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:27.172477 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba4b3e-e987-497f-bc4f-6a58225f36a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:27.172745 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba4b3e-e987-497f-bc4f-6a58225f36a3 None admin] PATH_INFO: `/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b/users/4ed3753f36cd4a739c9a1458edd79689/roles/8f0019918cbf4b05aa6de1a3c0850251` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:27.174714 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba4b3e-e987-497f-bc4f-6a58225f36a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e1cc38a8ece4d619be76f0ba70f8f1b, user_id=4ed3753f36cd4a739c9a1458edd79689, role_id=8f0019918cbf4b05aa6de1a3c0850251)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:27.176190 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba4b3e-e987-497f-bc4f-6a58225f36a3 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:27.179296 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-0faf80e0-868a-4e46-94f5-a70d2932237a None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:27.180472 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0faf80e0-868a-4e46-94f5-a70d2932237a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:27.205466 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 143/287] 10.222.0.24 () {58 vars in 1439 bytes} [Mon May 16 18:54:26 2022] PUT /identity/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b/users/4ed3753f36cd4a739c9a1458edd79689/roles/8f0019918cbf4b05aa6de1a3c0850251 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:54:27.257657 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 145/288] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:54:27.279603 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba4b3e-e987-497f-bc4f-6a58225f36a3 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:27.402310 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba4b3e-e987-497f-bc4f-6a58225f36a3 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:27.446396 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10725ab0-b53c-4982-be17-372d8c16bd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:27.447239 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10725ab0-b53c-4982-be17-372d8c16bd60 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:27.447517 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10725ab0-b53c-4982-be17-372d8c16bd60 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:27.447783 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10725ab0-b53c-4982-be17-372d8c16bd60 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:27.462511 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10725ab0-b53c-4982-be17-372d8c16bd60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:27.470378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-10725ab0-b53c-4982-be17-372d8c16bd60 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 18:54:27.470378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:27.470378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:27.470378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:27.470378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:27.470378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:27.470378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:27.470378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:27.470378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:27.470378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:27.470378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:27.470378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:27.470378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:27.470378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:27.470378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:27.470378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:27.471232 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:27.471232 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:27.471232 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:27.471232 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:27.471232 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:27.471232 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:27.471232 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:27.471232 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:27.471232 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:27.471232 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:27.471232 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:27.471232 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:27.471232 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:27.471232 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:27.471232 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:27.471232 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:27.472435 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:27.472435 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:27.472435 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:27.472435 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:27.472435 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:27.472435 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:27.472435 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:27.472435 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:27.472435 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:27.472435 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:27.472435 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 18:54:27.472435 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:27.472435 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 144/289] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:54:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:27.477759 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf80e0-868a-4e46-94f5-a70d2932237a None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:27.577179 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf80e0-868a-4e46-94f5-a70d2932237a None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:27.610370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e7746-cb65-4d20-b857-282ef6b34923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:27.611048 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e7746-cb65-4d20-b857-282ef6b34923 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:27.611326 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e7746-cb65-4d20-b857-282ef6b34923 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:27.611597 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e7746-cb65-4d20-b857-282ef6b34923 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:27.612352 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e7746-cb65-4d20-b857-282ef6b34923 None admin] RBAC: Adding query filter params (name=member) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:27.612659 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e7746-cb65-4d20-b857-282ef6b34923 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:27.614076 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e7746-cb65-4d20-b857-282ef6b34923 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:27.622303 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 146/290] 10.222.0.24 () {56 vars in 1101 bytes} [Mon May 16 18:54:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:27.627803 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10725ab0-b53c-4982-be17-372d8c16bd60 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:27.746657 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10725ab0-b53c-4982-be17-372d8c16bd60 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:27.790203 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47a7cd-0ba5-482d-b3f7-639ed180df09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:27.791099 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47a7cd-0ba5-482d-b3f7-639ed180df09 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:27.791379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47a7cd-0ba5-482d-b3f7-639ed180df09 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:27.791713 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47a7cd-0ba5-482d-b3f7-639ed180df09 None admin] PATH_INFO: `/v3/users/5750e6fb77174d87b09b9121fae6e803` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:27.797436 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47a7cd-0ba5-482d-b3f7-639ed180df09 None admin] RBAC: Authorizing `identity:get_user(user_id=5750e6fb77174d87b09b9121fae6e803)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:27.799051 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47a7cd-0ba5-482d-b3f7-639ed180df09 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:27.800970 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 145/291] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:54:27 2022] GET /identity/v3/users/5750e6fb77174d87b09b9121fae6e803 => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:27.806250 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e7746-cb65-4d20-b857-282ef6b34923 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:27.912601 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e7746-cb65-4d20-b857-282ef6b34923 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:27.945680 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2efd6a-efe9-4ebe-892a-20cc742fda19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:27.946334 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2efd6a-efe9-4ebe-892a-20cc742fda19 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:27.946612 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2efd6a-efe9-4ebe-892a-20cc742fda19 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:27.946882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2efd6a-efe9-4ebe-892a-20cc742fda19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:28.012287 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2efd6a-efe9-4ebe-892a-20cc742fda19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:28.013757 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2efd6a-efe9-4ebe-892a-20cc742fda19 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:28.110174 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 147/292] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:54:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:54:28.115834 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47a7cd-0ba5-482d-b3f7-639ed180df09 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:28.226728 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47a7cd-0ba5-482d-b3f7-639ed180df09 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:28.264573 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c5e84-b100-425a-b579-7b3cce0c83ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:28.265365 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c5e84-b100-425a-b579-7b3cce0c83ab None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:28.265685 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c5e84-b100-425a-b579-7b3cce0c83ab None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:28.265961 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c5e84-b100-425a-b579-7b3cce0c83ab None admin] PATH_INFO: `/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:28.267157 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94c5e84-b100-425a-b579-7b3cce0c83ab None admin] RBAC: Authorizing `identity:get_project(project_id=4e1cc38a8ece4d619be76f0ba70f8f1b)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:28.268611 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94c5e84-b100-425a-b579-7b3cce0c83ab None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:28.270644 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 146/293] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:54:28 2022] GET /identity/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:28.276467 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2efd6a-efe9-4ebe-892a-20cc742fda19 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:28.373699 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2efd6a-efe9-4ebe-892a-20cc742fda19 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:28.406939 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e8b6c-2d84-449d-8cb7-40e608004487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:28.407602 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e8b6c-2d84-449d-8cb7-40e608004487 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:28.407882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e8b6c-2d84-449d-8cb7-40e608004487 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:28.408150 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e8b6c-2d84-449d-8cb7-40e608004487 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:28.408995 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e8b6c-2d84-449d-8cb7-40e608004487 None admin] RBAC: Adding query filter params (role.id=b0e5c5e3b5f54789a5a5c4c51220c97e, scope.project.id=4e1cc38a8ece4d619be76f0ba70f8f1b, user.id=5750e6fb77174d87b09b9121fae6e803) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:28.409302 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e8b6c-2d84-449d-8cb7-40e608004487 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:28.410857 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e8b6c-2d84-449d-8cb7-40e608004487 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:28.417810 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 148/294] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:54:28 2022] GET /identity/v3/role_assignments?user.id=5750e6fb77174d87b09b9121fae6e803&scope.project.id=4e1cc38a8ece4d619be76f0ba70f8f1b&role.id=b0e5c5e3b5f54789a5a5c4c51220c97e => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:28.775481 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422e9da-343f-438d-8c1b-446aa67d66e5 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:28.776617 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422e9da-343f-438d-8c1b-446aa67d66e5 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:28.777106 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422e9da-343f-438d-8c1b-446aa67d66e5 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:28.778866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 147/295] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:28.785582 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7febd-fc5f-4d5a-bef1-7b3ba0a2a66d None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:28.786549 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7febd-fc5f-4d5a-bef1-7b3ba0a2a66d None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:28.787041 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7febd-fc5f-4d5a-bef1-7b3ba0a2a66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:28.807029 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-f1a7febd-fc5f-4d5a-bef1-7b3ba0a2a66d None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:28.808738 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f1a7febd-fc5f-4d5a-bef1-7b3ba0a2a66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:28.876730 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 149/296] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:54:28.877326 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ce639-cf5a-4168-a94c-1c22af04f06d None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:28.877636 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ce639-cf5a-4168-a94c-1c22af04f06d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:28.877971 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ce639-cf5a-4168-a94c-1c22af04f06d None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:28.879433 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 148/297] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:28.885018 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5ddad-e48b-41f5-b316-094fcba85432 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:28.885574 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5ddad-e48b-41f5-b316-094fcba85432 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:28.886142 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5ddad-e48b-41f5-b316-094fcba85432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:28.900148 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ce639-cf5a-4168-a94c-1c22af04f06d None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:28.904898 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-a1c5ddad-e48b-41f5-b316-094fcba85432 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:28.906105 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a1c5ddad-e48b-41f5-b316-094fcba85432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:28.971830 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 150/298] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:54:28.995700 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5ddad-e48b-41f5-b316-094fcba85432 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:29.024093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ce639-cf5a-4168-a94c-1c22af04f06d None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:29.057986 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bdc234-b099-4e95-abfc-d768722ec31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:29.059107 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bdc234-b099-4e95-abfc-d768722ec31a None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:29.059584 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bdc234-b099-4e95-abfc-d768722ec31a None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:29.060045 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bdc234-b099-4e95-abfc-d768722ec31a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:29.069819 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bdc234-b099-4e95-abfc-d768722ec31a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:29.077851 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-73bdc234-b099-4e95-abfc-d768722ec31a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 18:54:29.077851 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:29.077851 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:29.077851 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:29.077851 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:29.077851 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:29.077851 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:29.077851 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:29.077851 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:29.077851 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:29.077851 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:29.077851 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:29.077851 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:29.077851 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:29.077851 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:29.077851 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:29.078923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:29.078923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:29.078923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:29.078923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:29.078923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:29.078923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:29.078923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:29.078923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:29.078923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:29.078923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:29.078923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:29.078923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:29.078923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:29.078923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:29.078923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:29.078923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:29.079888 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:29.079888 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:29.079888 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:29.079888 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:29.079888 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:29.079888 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:29.079888 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:29.079888 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:29.079888 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:29.079888 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:29.079888 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 18:54:29.079888 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:29.086744 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 149/299] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:54:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:54:29.088195 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba6cd1-19e1-4fd9-97f8-c42124d47f49 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:29.088620 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba6cd1-19e1-4fd9-97f8-c42124d47f49 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:29.089064 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba6cd1-19e1-4fd9-97f8-c42124d47f49 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:29.090523 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 150/300] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:29.091355 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba6cd1-19e1-4fd9-97f8-c42124d47f49 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:29.104050 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5ddad-e48b-41f5-b316-094fcba85432 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:29.138981 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658dbe7-1252-42aa-b88d-b64341887bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:29.139787 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658dbe7-1252-42aa-b88d-b64341887bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:29.140062 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658dbe7-1252-42aa-b88d-b64341887bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:29.140336 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658dbe7-1252-42aa-b88d-b64341887bf5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:29.141493 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1658dbe7-1252-42aa-b88d-b64341887bf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:29.143039 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1658dbe7-1252-42aa-b88d-b64341887bf5 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:29.144684 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 151/301] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:54:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:29.146006 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d81c1-e45b-44db-8ffa-a45634650d76 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:29.146425 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d81c1-e45b-44db-8ffa-a45634650d76 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:29.146826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d81c1-e45b-44db-8ffa-a45634650d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:29.167801 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-e08d81c1-e45b-44db-8ffa-a45634650d76 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:29.168980 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e08d81c1-e45b-44db-8ffa-a45634650d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:29.198349 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba6cd1-19e1-4fd9-97f8-c42124d47f49 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:29.230823 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 152/302] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:54:29.231636 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d81c1-e45b-44db-8ffa-a45634650d76 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:29.242918 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1117d13d-8e4b-4993-80a8-35648ba23dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:29.243922 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117d13d-8e4b-4993-80a8-35648ba23dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:29.244351 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117d13d-8e4b-4993-80a8-35648ba23dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:29.244913 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117d13d-8e4b-4993-80a8-35648ba23dc5 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:29.246297 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1117d13d-8e4b-4993-80a8-35648ba23dc5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:29.247019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1117d13d-8e4b-4993-80a8-35648ba23dc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:29.249011 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1117d13d-8e4b-4993-80a8-35648ba23dc5 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:29.257709 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 151/303] 10.222.0.24 () {56 vars in 1101 bytes} [Mon May 16 18:54:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:29.258762 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1117d13d-8e4b-4993-80a8-35648ba23dc5 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:29.332519 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d81c1-e45b-44db-8ffa-a45634650d76 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:29.355016 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1117d13d-8e4b-4993-80a8-35648ba23dc5 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:29.365212 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da0b57-cb43-43a7-91c4-f5369e5702cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:29.365979 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da0b57-cb43-43a7-91c4-f5369e5702cd None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:29.366273 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da0b57-cb43-43a7-91c4-f5369e5702cd None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:29.366544 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da0b57-cb43-43a7-91c4-f5369e5702cd None admin] PATH_INFO: `/v3/groups` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:29.367227 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52da0b57-cb43-43a7-91c4-f5369e5702cd None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:29.368696 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52da0b57-cb43-43a7-91c4-f5369e5702cd None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:29.384184 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 153/304] 10.222.0.24 () {60 vars in 1134 bytes} [Mon May 16 18:54:29 2022] POST /identity/v3/groups => generated 229 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:54:29.385296 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da0b57-cb43-43a7-91c4-f5369e5702cd None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:29.401607 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3f90f-ee11-4d95-ad22-07f079ea3998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:29.402873 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3f90f-ee11-4d95-ad22-07f079ea3998 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:29.403368 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3f90f-ee11-4d95-ad22-07f079ea3998 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:29.403792 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3f90f-ee11-4d95-ad22-07f079ea3998 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:29.419338 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf3f90f-ee11-4d95-ad22-07f079ea3998 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:29.430600 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-edf3f90f-ee11-4d95-ad22-07f079ea3998 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 18:54:29.430600 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:29.430600 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:29.430600 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:29.430600 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:29.430600 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:29.430600 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:29.430600 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:29.430600 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:29.430600 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:29.430600 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:29.430600 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:29.430600 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:29.430600 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:29.430600 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:29.430600 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:29.431577 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:29.431577 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:29.431577 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:29.431577 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:29.431577 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:29.431577 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:29.431577 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:29.431577 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:29.431577 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:29.431577 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:29.431577 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:29.431577 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:29.431577 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:29.431577 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:29.431577 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:29.431577 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:29.432367 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:29.432367 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:29.432367 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:29.432367 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:29.432367 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:29.432367 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:29.432367 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:29.432367 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:29.432367 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:29.432367 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:29.432367 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 18:54:29.432367 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:29.435662 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 152/305] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:54:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:29.442159 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3f90f-ee11-4d95-ad22-07f079ea3998 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:29.505608 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da0b57-cb43-43a7-91c4-f5369e5702cd None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:29.543950 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb764484-d23f-4faf-b269-7503817f89ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:29.545263 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb764484-d23f-4faf-b269-7503817f89ae None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:29.545804 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb764484-d23f-4faf-b269-7503817f89ae None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:29.546272 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb764484-d23f-4faf-b269-7503817f89ae None admin] PATH_INFO: `/v3/users/7b11d2efc8fb4c41a3ae61083749ae9d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:29.561832 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb764484-d23f-4faf-b269-7503817f89ae None admin] RBAC: Authorizing `identity:get_user(user_id=7b11d2efc8fb4c41a3ae61083749ae9d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:29.563093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3f90f-ee11-4d95-ad22-07f079ea3998 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:29.563814 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb764484-d23f-4faf-b269-7503817f89ae None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:29.571188 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 154/306] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:54:29 2022] GET /identity/v3/users/7b11d2efc8fb4c41a3ae61083749ae9d => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:29.572489 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb764484-d23f-4faf-b269-7503817f89ae None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:29.600090 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb383636-25e5-4887-a796-815a7c24ac89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:29.601137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb383636-25e5-4887-a796-815a7c24ac89 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:29.601652 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb383636-25e5-4887-a796-815a7c24ac89 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:29.602121 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb383636-25e5-4887-a796-815a7c24ac89 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:29.603112 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb383636-25e5-4887-a796-815a7c24ac89 None admin] RBAC: Adding query filter params (name=member) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:29.603586 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb383636-25e5-4887-a796-815a7c24ac89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:29.605236 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb383636-25e5-4887-a796-815a7c24ac89 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:29.614685 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 153/307] 10.222.0.24 () {56 vars in 1101 bytes} [Mon May 16 18:54:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:29.620527 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb383636-25e5-4887-a796-815a7c24ac89 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:29.693666 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb764484-d23f-4faf-b269-7503817f89ae None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:29.733419 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd5f9fa-1c3d-4c83-9620-f5592f043851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:29.734773 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5f9fa-1c3d-4c83-9620-f5592f043851 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:29.735295 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5f9fa-1c3d-4c83-9620-f5592f043851 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:29.735735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5f9fa-1c3d-4c83-9620-f5592f043851 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:29.736711 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd5f9fa-1c3d-4c83-9620-f5592f043851 None admin] RBAC: Adding query filter params (role.id=8f0019918cbf4b05aa6de1a3c0850251, user.id=7b11d2efc8fb4c41a3ae61083749ae9d, scope.system=all) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:29.736977 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb383636-25e5-4887-a796-815a7c24ac89 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:29.737173 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd5f9fa-1c3d-4c83-9620-f5592f043851 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:29.738951 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd5f9fa-1c3d-4c83-9620-f5592f043851 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:29.745093 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 155/308] 10.222.0.24 () {56 vars in 1308 bytes} [Mon May 16 18:54:29 2022] GET /identity/v3/role_assignments?user.id=7b11d2efc8fb4c41a3ae61083749ae9d&scope.system=all&role.id=8f0019918cbf4b05aa6de1a3c0850251 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:29.782206 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a6f9e-9b68-4251-8fb2-6c990c132a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:29.783777 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a6f9e-9b68-4251-8fb2-6c990c132a1e None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:29.784221 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a6f9e-9b68-4251-8fb2-6c990c132a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:29.784750 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a6f9e-9b68-4251-8fb2-6c990c132a1e None admin] PATH_INFO: `/v3/users/877babc2744146cb8ffde2d0a9bfd5d8` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:29.786412 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a6f9e-9b68-4251-8fb2-6c990c132a1e None admin] RBAC: Authorizing `identity:get_user(user_id=877babc2744146cb8ffde2d0a9bfd5d8)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:29.788183 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a6f9e-9b68-4251-8fb2-6c990c132a1e None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:29.791007 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 154/309] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:54:29 2022] GET /identity/v3/users/877babc2744146cb8ffde2d0a9bfd5d8 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:54:29.798026 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd5f9fa-1c3d-4c83-9620-f5592f043851 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:29.908152 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd5f9fa-1c3d-4c83-9620-f5592f043851 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:29.945560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e5e73-acff-432f-9e30-1af183471f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:29.946687 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e5e73-acff-432f-9e30-1af183471f52 None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:29.947128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e5e73-acff-432f-9e30-1af183471f52 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:29.947537 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e5e73-acff-432f-9e30-1af183471f52 None admin] PATH_INFO: `/v3/system/users/877babc2744146cb8ffde2d0a9bfd5d8/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:29.949242 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e5e73-acff-432f-9e30-1af183471f52 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=877babc2744146cb8ffde2d0a9bfd5d8, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:29.950816 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e5e73-acff-432f-9e30-1af183471f52 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:29.959762 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17874944-f19e-483f-a0fb-e529082a60e2 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:29.960043 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17874944-f19e-483f-a0fb-e529082a60e2 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:29.960393 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17874944-f19e-483f-a0fb-e529082a60e2 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:29.961865 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 155/310] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:54:29.963580 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 156/311] 10.222.0.24 () {58 vars in 1334 bytes} [Mon May 16 18:54:29 2022] PUT /identity/v3/system/users/877babc2744146cb8ffde2d0a9bfd5d8/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:54:29.969791 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80808d54-fcb4-40a2-a13e-95fa663aed7c None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:29.969791 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80808d54-fcb4-40a2-a13e-95fa663aed7c None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:29.970063 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80808d54-fcb4-40a2-a13e-95fa663aed7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:29.990839 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-80808d54-fcb4-40a2-a13e-95fa663aed7c None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:29.992060 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-80808d54-fcb4-40a2-a13e-95fa663aed7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:30.068702 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 156/312] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:54:30.091653 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e5e73-acff-432f-9e30-1af183471f52 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:30.204866 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e5e73-acff-432f-9e30-1af183471f52 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:30.237459 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b33d82-f5c5-4321-b45b-b05ec87fc589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:30.238328 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b33d82-f5c5-4321-b45b-b05ec87fc589 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:30.238606 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b33d82-f5c5-4321-b45b-b05ec87fc589 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:30.238922 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b33d82-f5c5-4321-b45b-b05ec87fc589 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:30.248950 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b33d82-f5c5-4321-b45b-b05ec87fc589 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:30.256756 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-40b33d82-f5c5-4321-b45b-b05ec87fc589 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 18:54:30.256756 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:30.256756 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:30.256756 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:30.256756 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:30.256756 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:30.256756 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:30.256756 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:30.256756 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:30.256756 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:30.256756 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:30.256756 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:30.256756 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:30.256756 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:30.256756 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:30.256756 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:30.257656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:30.257656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:30.257656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:30.257656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:30.257656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:30.257656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:30.257656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:30.257656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:30.257656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:30.257656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:30.257656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:30.257656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:54:30.257656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:30.257656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:30.257656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:30.257656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:30.258467 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:30.258467 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:30.258467 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:30.258467 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:30.258467 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:30.258467 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:30.258467 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:30.258467 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:30.258467 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:30.258467 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:30.258467 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 18:54:30.258467 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:54:30.258467 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 157/313] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:54:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:30.267399 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80808d54-fcb4-40a2-a13e-95fa663aed7c None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:30.367599 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80808d54-fcb4-40a2-a13e-95fa663aed7c None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:30.400876 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543f21e-aad9-4023-aba4-47dff83cf8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:30.401964 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543f21e-aad9-4023-aba4-47dff83cf8f1 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:30.402459 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543f21e-aad9-4023-aba4-47dff83cf8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:30.402943 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543f21e-aad9-4023-aba4-47dff83cf8f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:30.403900 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543f21e-aad9-4023-aba4-47dff83cf8f1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:30.404411 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543f21e-aad9-4023-aba4-47dff83cf8f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:30.406026 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543f21e-aad9-4023-aba4-47dff83cf8f1 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:30.415164 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 157/314] 10.222.0.24 () {56 vars in 1101 bytes} [Mon May 16 18:54:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:30.422628 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b33d82-f5c5-4321-b45b-b05ec87fc589 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:30.522147 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b33d82-f5c5-4321-b45b-b05ec87fc589 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:30.555362 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e3797-31b4-4cbd-b96d-276f77bc4c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:30.556596 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e3797-31b4-4cbd-b96d-276f77bc4c6f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:30.557092 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e3797-31b4-4cbd-b96d-276f77bc4c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:30.557613 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e3797-31b4-4cbd-b96d-276f77bc4c6f None admin] PATH_INFO: `/v3/users/4ed3753f36cd4a739c9a1458edd79689` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:30.559026 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e3797-31b4-4cbd-b96d-276f77bc4c6f None admin] RBAC: Authorizing `identity:get_user(user_id=4ed3753f36cd4a739c9a1458edd79689)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:30.560746 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e3797-31b4-4cbd-b96d-276f77bc4c6f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:30.562890 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 158/315] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:54:30 2022] GET /identity/v3/users/4ed3753f36cd4a739c9a1458edd79689 => generated 297 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:30.568572 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543f21e-aad9-4023-aba4-47dff83cf8f1 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:30.669225 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543f21e-aad9-4023-aba4-47dff83cf8f1 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:30.702232 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f002c4-236b-4a8d-8069-d7f48d6f89eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:30.703182 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f002c4-236b-4a8d-8069-d7f48d6f89eb None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:30.703632 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f002c4-236b-4a8d-8069-d7f48d6f89eb None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:30.704074 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f002c4-236b-4a8d-8069-d7f48d6f89eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:30.770037 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f002c4-236b-4a8d-8069-d7f48d6f89eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:30.771878 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f002c4-236b-4a8d-8069-d7f48d6f89eb None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:30.872039 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 158/316] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:54:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:54:30.878064 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e3797-31b4-4cbd-b96d-276f77bc4c6f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:30.976715 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e3797-31b4-4cbd-b96d-276f77bc4c6f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:31.009123 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a430984-6d10-4287-8852-937eb1c692a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:31.010419 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a430984-6d10-4287-8852-937eb1c692a1 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:31.010923 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a430984-6d10-4287-8852-937eb1c692a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:31.011389 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a430984-6d10-4287-8852-937eb1c692a1 None admin] PATH_INFO: `/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:31.012765 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a430984-6d10-4287-8852-937eb1c692a1 None admin] RBAC: Authorizing `identity:get_project(project_id=4e1cc38a8ece4d619be76f0ba70f8f1b)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:31.014559 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a430984-6d10-4287-8852-937eb1c692a1 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:31.016830 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 159/317] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:54:30 2022] GET /identity/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:31.022795 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f002c4-236b-4a8d-8069-d7f48d6f89eb None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:31.121606 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f002c4-236b-4a8d-8069-d7f48d6f89eb None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:31.157238 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ead93-02c5-4dee-9a4d-58026d270c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:31.157946 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ead93-02c5-4dee-9a4d-58026d270c57 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:31.158301 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ead93-02c5-4dee-9a4d-58026d270c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:31.158504 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ead93-02c5-4dee-9a4d-58026d270c57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:31.159357 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ead93-02c5-4dee-9a4d-58026d270c57 None admin] RBAC: Adding query filter params (role.id=8f0019918cbf4b05aa6de1a3c0850251, scope.project.id=4e1cc38a8ece4d619be76f0ba70f8f1b, user.id=4ed3753f36cd4a739c9a1458edd79689) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:31.159671 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ead93-02c5-4dee-9a4d-58026d270c57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:31.161121 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ead93-02c5-4dee-9a4d-58026d270c57 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:31.168086 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 159/318] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:54:31 2022] GET /identity/v3/role_assignments?user.id=4ed3753f36cd4a739c9a1458edd79689&scope.project.id=4e1cc38a8ece4d619be76f0ba70f8f1b&role.id=8f0019918cbf4b05aa6de1a3c0850251 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:31.697817 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe04199-5701-487a-80c1-beb0d7dca70c None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:31.698273 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe04199-5701-487a-80c1-beb0d7dca70c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:31.698391 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe04199-5701-487a-80c1-beb0d7dca70c None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:31.699791 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 160/319] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:31.705265 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94a3b8-be29-4b16-be92-61405454d60b None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:31.705522 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94a3b8-be29-4b16-be92-61405454d60b None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:31.705849 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94a3b8-be29-4b16-be92-61405454d60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:31.722792 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-9a94a3b8-be29-4b16-be92-61405454d60b None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:31.723940 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-9a94a3b8-be29-4b16-be92-61405454d60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:31.790006 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 160/320] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:54:31.813336 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe04199-5701-487a-80c1-beb0d7dca70c None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:31.925397 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe04199-5701-487a-80c1-beb0d7dca70c None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:31.959116 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20237d-15dd-4e0a-ad92-2a5df712ea05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:31.959838 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20237d-15dd-4e0a-ad92-2a5df712ea05 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:31.960117 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20237d-15dd-4e0a-ad92-2a5df712ea05 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:31.960387 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20237d-15dd-4e0a-ad92-2a5df712ea05 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:31.961567 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20237d-15dd-4e0a-ad92-2a5df712ea05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:31.963063 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20237d-15dd-4e0a-ad92-2a5df712ea05 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:31.965901 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 161/321] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:54:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:31.971460 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94a3b8-be29-4b16-be92-61405454d60b None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:32.047868 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c67a82-b9f0-4f80-8345-95c920364842 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:32.048480 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c67a82-b9f0-4f80-8345-95c920364842 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:32.048563 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c67a82-b9f0-4f80-8345-95c920364842 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:32.050007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 162/322] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:32.057320 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca31016-cca6-4107-8ea2-3d593fc58e4a None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:32.057655 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca31016-cca6-4107-8ea2-3d593fc58e4a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:32.057931 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca31016-cca6-4107-8ea2-3d593fc58e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:32.075660 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-fca31016-cca6-4107-8ea2-3d593fc58e4a None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:32.076911 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-fca31016-cca6-4107-8ea2-3d593fc58e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:32.081040 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94a3b8-be29-4b16-be92-61405454d60b None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:32.115337 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15a9a9-7f47-4bdf-a9b9-9f42e5335cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:32.116019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15a9a9-7f47-4bdf-a9b9-9f42e5335cd8 None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:32.116301 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15a9a9-7f47-4bdf-a9b9-9f42e5335cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:32.116579 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15a9a9-7f47-4bdf-a9b9-9f42e5335cd8 None admin] PATH_INFO: `/v3/groups` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:32.117280 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15a9a9-7f47-4bdf-a9b9-9f42e5335cd8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:32.118788 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15a9a9-7f47-4bdf-a9b9-9f42e5335cd8 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:32.136069 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 161/323] 10.222.0.24 () {60 vars in 1134 bytes} [Mon May 16 18:54:31 2022] POST /identity/v3/groups => generated 226 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:54:32.148349 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 163/324] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:54:32.172395 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15a9a9-7f47-4bdf-a9b9-9f42e5335cd8 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:32.255324 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f6c44-60a7-45e3-a772-0cb95992c40a None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:32.255858 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f6c44-60a7-45e3-a772-0cb95992c40a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:32.256139 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f6c44-60a7-45e3-a772-0cb95992c40a None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:32.257617 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 164/325] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:32.263429 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190d071-4735-4d94-8e0b-6037ecc5d9b6 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:32.263730 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190d071-4735-4d94-8e0b-6037ecc5d9b6 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:32.263984 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190d071-4735-4d94-8e0b-6037ecc5d9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:32.277762 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15a9a9-7f47-4bdf-a9b9-9f42e5335cd8 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:32.281934 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-2190d071-4735-4d94-8e0b-6037ecc5d9b6 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:32.283183 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2190d071-4735-4d94-8e0b-6037ecc5d9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:32.313924 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75209ee6-4604-463e-96c0-c61aa39948ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:32.314753 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75209ee6-4604-463e-96c0-c61aa39948ad None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:32.315038 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75209ee6-4604-463e-96c0-c61aa39948ad None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:32.315311 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75209ee6-4604-463e-96c0-c61aa39948ad None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:32.326528 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75209ee6-4604-463e-96c0-c61aa39948ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:32.334294 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-75209ee6-4604-463e-96c0-c61aa39948ad None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 18:54:32.334294 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:32.334294 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:32.334294 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:32.334294 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:32.334294 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:32.334294 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:32.334294 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:32.334294 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:32.334294 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:32.334294 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:32.334294 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:32.334294 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:32.334294 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:32.334294 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:32.334294 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:32.335187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:32.335187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:32.335187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:32.335187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:32.335187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:32.335187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:32.335187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:32.335187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:32.335187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:32.335187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:32.335187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:32.335187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:32.335187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:32.335187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:32.335187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:32.335187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:32.335953 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:32.335953 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:32.335953 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:32.335953 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:32.335953 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:32.335953 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:32.335953 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:32.335953 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:32.335953 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:32.335953 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:32.335953 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 18:54:32.335953 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:32.337794 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 162/326] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:54:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:32.341641 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75209ee6-4604-463e-96c0-c61aa39948ad None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:32.354673 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 165/327] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:54:32.378719 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190d071-4735-4d94-8e0b-6037ecc5d9b6 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:32.456647 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75209ee6-4604-463e-96c0-c61aa39948ad None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:32.493143 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c212479-3b76-4432-9abe-10961133bbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:32.493393 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c212479-3b76-4432-9abe-10961133bbbf None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:32.493487 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c212479-3b76-4432-9abe-10961133bbbf None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:32.494607 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c212479-3b76-4432-9abe-10961133bbbf None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:32.494607 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c212479-3b76-4432-9abe-10961133bbbf None admin] RBAC: Adding query filter params (name=reader) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:32.495091 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c212479-3b76-4432-9abe-10961133bbbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:32.496399 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c212479-3b76-4432-9abe-10961133bbbf None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:32.500961 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190d071-4735-4d94-8e0b-6037ecc5d9b6 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:32.505289 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 163/328] 10.222.0.24 () {56 vars in 1101 bytes} [Mon May 16 18:54:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:54:32.511301 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c212479-3b76-4432-9abe-10961133bbbf None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:32.539932 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1ddc0-405d-4c29-8f18-fb10b039ce1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:32.541196 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1ddc0-405d-4c29-8f18-fb10b039ce1b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:32.541480 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1ddc0-405d-4c29-8f18-fb10b039ce1b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:32.542172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1ddc0-405d-4c29-8f18-fb10b039ce1b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:32.561132 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1ddc0-405d-4c29-8f18-fb10b039ce1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:32.571319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-8cc1ddc0-405d-4c29-8f18-fb10b039ce1b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 18:54:32.571319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:32.571319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:32.571319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:32.571319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:32.571319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:32.571319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:32.571319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:32.571319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:32.571319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:32.571319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:32.571319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:32.571319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:32.571319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:32.571319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:32.571319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:32.572246 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:32.572246 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:32.572246 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:32.572246 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:32.572246 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:32.572246 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:32.572246 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:32.572246 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:32.572246 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:32.572246 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:32.572246 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:32.572246 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:54:32.572246 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:32.572246 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:32.572246 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:32.572246 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:32.573035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:32.573035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:32.573035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:32.573035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:32.573035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:32.573035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:32.573035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:32.573035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:32.573035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:32.573035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:32.573035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 18:54:32.573035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:54:32.577103 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 166/329] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:54:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:32.581229 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1ddc0-405d-4c29-8f18-fb10b039ce1b None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:32.630099 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c212479-3b76-4432-9abe-10961133bbbf None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:32.663838 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f29e1c-82bb-4e4e-bead-e63b03fdd27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:32.664747 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f29e1c-82bb-4e4e-bead-e63b03fdd27e None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:32.665026 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f29e1c-82bb-4e4e-bead-e63b03fdd27e None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:32.665298 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f29e1c-82bb-4e4e-bead-e63b03fdd27e None admin] PATH_INFO: `/v3/users/7b11d2efc8fb4c41a3ae61083749ae9d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:32.666798 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f29e1c-82bb-4e4e-bead-e63b03fdd27e None admin] RBAC: Authorizing `identity:get_user(user_id=7b11d2efc8fb4c41a3ae61083749ae9d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:32.668209 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f29e1c-82bb-4e4e-bead-e63b03fdd27e None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:32.673636 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 164/330] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:54:32 2022] GET /identity/v3/users/7b11d2efc8fb4c41a3ae61083749ae9d => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:32.675680 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f29e1c-82bb-4e4e-bead-e63b03fdd27e None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:32.692400 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1ddc0-405d-4c29-8f18-fb10b039ce1b None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:32.729153 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f6b94-7ac8-4d1c-b4d0-b850648d5a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:32.730220 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f6b94-7ac8-4d1c-b4d0-b850648d5a22 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:32.730705 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f6b94-7ac8-4d1c-b4d0-b850648d5a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:32.731150 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f6b94-7ac8-4d1c-b4d0-b850648d5a22 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:32.732134 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75f6b94-7ac8-4d1c-b4d0-b850648d5a22 None admin] RBAC: Adding query filter params (name=member) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:32.732648 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75f6b94-7ac8-4d1c-b4d0-b850648d5a22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:32.734324 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75f6b94-7ac8-4d1c-b4d0-b850648d5a22 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:32.745242 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 167/331] 10.222.0.24 () {56 vars in 1101 bytes} [Mon May 16 18:54:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:32.751057 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f6b94-7ac8-4d1c-b4d0-b850648d5a22 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:32.776081 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f29e1c-82bb-4e4e-bead-e63b03fdd27e None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:32.809409 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a13ee3-2e85-44d5-adc8-88fcba49ef1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:32.810439 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a13ee3-2e85-44d5-adc8-88fcba49ef1d None admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:32.810720 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a13ee3-2e85-44d5-adc8-88fcba49ef1d None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:32.810993 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a13ee3-2e85-44d5-adc8-88fcba49ef1d None admin] PATH_INFO: `/v3/system/users/7b11d2efc8fb4c41a3ae61083749ae9d/roles/8f0019918cbf4b05aa6de1a3c0850251` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:32.813156 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a13ee3-2e85-44d5-adc8-88fcba49ef1d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7b11d2efc8fb4c41a3ae61083749ae9d, role_id=8f0019918cbf4b05aa6de1a3c0850251)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:32.814595 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a13ee3-2e85-44d5-adc8-88fcba49ef1d None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:32.833038 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 165/332] 10.222.0.24 () {58 vars in 1334 bytes} [Mon May 16 18:54:32 2022] PUT /identity/v3/system/users/7b11d2efc8fb4c41a3ae61083749ae9d/roles/8f0019918cbf4b05aa6de1a3c0850251 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:54:32.861594 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f6b94-7ac8-4d1c-b4d0-b850648d5a22 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:32.898365 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb017d0-35cf-425d-8d39-3b3117d643ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:32.899647 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb017d0-35cf-425d-8d39-3b3117d643ce None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:32.900118 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb017d0-35cf-425d-8d39-3b3117d643ce None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:32.900604 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb017d0-35cf-425d-8d39-3b3117d643ce None admin] PATH_INFO: `/v3/users/877babc2744146cb8ffde2d0a9bfd5d8` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:32.902228 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb017d0-35cf-425d-8d39-3b3117d643ce None admin] RBAC: Authorizing `identity:get_user(user_id=877babc2744146cb8ffde2d0a9bfd5d8)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:32.903947 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb017d0-35cf-425d-8d39-3b3117d643ce None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:32.906323 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 168/333] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:54:32 2022] GET /identity/v3/users/877babc2744146cb8ffde2d0a9bfd5d8 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:32.912911 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a13ee3-2e85-44d5-adc8-88fcba49ef1d None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:33.023678 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a13ee3-2e85-44d5-adc8-88fcba49ef1d None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:33.061421 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3879a-5756-41f5-b43d-a52bbc6c4995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:33.062048 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3879a-5756-41f5-b43d-a52bbc6c4995 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:33.062329 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3879a-5756-41f5-b43d-a52bbc6c4995 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:33.062599 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3879a-5756-41f5-b43d-a52bbc6c4995 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:33.063438 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3879a-5756-41f5-b43d-a52bbc6c4995 None admin] RBAC: Adding query filter params (role.id=b0e5c5e3b5f54789a5a5c4c51220c97e, user.id=877babc2744146cb8ffde2d0a9bfd5d8, scope.system=all) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:33.063750 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3879a-5756-41f5-b43d-a52bbc6c4995 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:33.065201 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3879a-5756-41f5-b43d-a52bbc6c4995 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:33.077914 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 166/334] 10.222.0.24 () {56 vars in 1308 bytes} [Mon May 16 18:54:32 2022] GET /identity/v3/role_assignments?user.id=877babc2744146cb8ffde2d0a9bfd5d8&scope.system=all&role.id=b0e5c5e3b5f54789a5a5c4c51220c97e => generated 510 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:34.610010 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2fdb3b-5aad-4fed-b006-e0e7b8368399 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:34.610536 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2fdb3b-5aad-4fed-b006-e0e7b8368399 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:34.610536 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2fdb3b-5aad-4fed-b006-e0e7b8368399 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:34.611855 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 169/335] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:34.617562 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532aa579-9a9f-4366-b21f-f3a89c3988b9 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:34.618023 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532aa579-9a9f-4366-b21f-f3a89c3988b9 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:34.618106 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532aa579-9a9f-4366-b21f-f3a89c3988b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:34.638499 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-532aa579-9a9f-4366-b21f-f3a89c3988b9 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:34.639700 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-532aa579-9a9f-4366-b21f-f3a89c3988b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:34.722541 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 167/336] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:54:34.767111 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2fdb3b-5aad-4fed-b006-e0e7b8368399 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:34.875595 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd587fe9-5f99-4617-8be0-88ac4ebe6dcd None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:34.875782 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd587fe9-5f99-4617-8be0-88ac4ebe6dcd None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:34.876711 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd587fe9-5f99-4617-8be0-88ac4ebe6dcd None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:34.880682 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 168/337] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:34.885129 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2fdb3b-5aad-4fed-b006-e0e7b8368399 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:34.886224 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9203a-2d31-42df-96e6-bdd57e5297d3 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:34.886515 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9203a-2d31-42df-96e6-bdd57e5297d3 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:34.886794 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9203a-2d31-42df-96e6-bdd57e5297d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:34.921335 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3f337-0d30-4713-b3e3-a7e59f98f3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:34.922578 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3f337-0d30-4713-b3e3-a7e59f98f3d0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:34.923076 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3f337-0d30-4713-b3e3-a7e59f98f3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:34.923549 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3f337-0d30-4713-b3e3-a7e59f98f3d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:34.925364 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-f6b9203a-2d31-42df-96e6-bdd57e5297d3 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:34.926824 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f6b9203a-2d31-42df-96e6-bdd57e5297d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:34.939635 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3f337-0d30-4713-b3e3-a7e59f98f3d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:34.947894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-04b3f337-0d30-4713-b3e3-a7e59f98f3d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 18:54:34.947894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:34.947894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:34.947894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:34.947894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:34.947894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:34.947894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:34.947894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:34.947894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:34.947894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:34.947894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:34.947894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:34.947894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:34.947894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:34.947894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:34.947894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:34.948916 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:34.948916 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:34.948916 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:34.948916 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:34.948916 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:34.948916 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:34.948916 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:34.948916 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:34.948916 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:34.948916 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:34.948916 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:34.948916 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:54:34.948916 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:34.948916 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:34.948916 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:34.948916 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:34.949769 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:34.949769 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:34.949769 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:34.949769 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:34.949769 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:34.949769 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:34.949769 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:34.949769 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:34.949769 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:34.949769 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:34.949769 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 18:54:34.949769 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:54:34.952542 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 170/338] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:54:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:34.958597 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3f337-0d30-4713-b3e3-a7e59f98f3d0 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:35.070905 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 169/339] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:54:35.122250 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3f337-0d30-4713-b3e3-a7e59f98f3d0 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:35.150969 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b9203a-2d31-42df-96e6-bdd57e5297d3 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:35.174339 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49382b96-c1ea-44b1-9f31-3abf14ee6a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:35.175028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49382b96-c1ea-44b1-9f31-3abf14ee6a76 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:35.175311 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49382b96-c1ea-44b1-9f31-3abf14ee6a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:35.175585 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49382b96-c1ea-44b1-9f31-3abf14ee6a76 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:35.176352 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49382b96-c1ea-44b1-9f31-3abf14ee6a76 None admin] RBAC: Adding query filter params (name=member) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:35.176660 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49382b96-c1ea-44b1-9f31-3abf14ee6a76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:35.178090 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49382b96-c1ea-44b1-9f31-3abf14ee6a76 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:35.196480 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 171/340] 10.222.0.24 () {56 vars in 1101 bytes} [Mon May 16 18:54:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:54:35.203506 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49382b96-c1ea-44b1-9f31-3abf14ee6a76 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:35.285735 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b9203a-2d31-42df-96e6-bdd57e5297d3 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:35.338340 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012aef5-be58-435c-a310-b531fba18260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:35.339290 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012aef5-be58-435c-a310-b531fba18260 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:35.339578 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012aef5-be58-435c-a310-b531fba18260 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:35.339849 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012aef5-be58-435c-a310-b531fba18260 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:35.354494 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012aef5-be58-435c-a310-b531fba18260 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:35.370981 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-2012aef5-be58-435c-a310-b531fba18260 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:54:35.370981 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:35.370981 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:35.370981 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:35.370981 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:35.370981 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:35.370981 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:35.370981 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:35.370981 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:35.370981 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:35.370981 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:35.370981 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:35.370981 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:35.370981 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:35.370981 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:35.370981 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:35.371882 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:35.371882 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:35.371882 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:35.371882 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:35.371882 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:35.371882 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:35.371882 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:35.371882 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:35.371882 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:35.371882 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:35.371882 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:35.371882 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:35.371882 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:35.371882 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:35.371882 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:35.371882 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:35.372655 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:35.372655 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:35.372655 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:35.372655 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:35.372655 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:35.372655 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:35.372655 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:35.372655 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:35.372655 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:35.372655 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:35.372655 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:54:35.372655 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:35.372655 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 170/341] 10.222.0.24 () {56 vars in 1114 bytes} [Mon May 16 18:54:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:54:35.377770 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49382b96-c1ea-44b1-9f31-3abf14ee6a76 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:35.394916 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012aef5-be58-435c-a310-b531fba18260 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:35.442413 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893486e-9179-441a-ae0b-eda3c167d1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:35.443105 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893486e-9179-441a-ae0b-eda3c167d1ec None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:35.443387 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893486e-9179-441a-ae0b-eda3c167d1ec None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:35.443664 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893486e-9179-441a-ae0b-eda3c167d1ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:35.540963 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012aef5-be58-435c-a310-b531fba18260 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:35.560578 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893486e-9179-441a-ae0b-eda3c167d1ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:35.562114 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893486e-9179-441a-ae0b-eda3c167d1ec None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:35.580789 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931d48a-ac70-4885-a9fa-7ce30a39d630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:35.581781 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931d48a-ac70-4885-a9fa-7ce30a39d630 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:35.582230 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931d48a-ac70-4885-a9fa-7ce30a39d630 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:35.582656 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931d48a-ac70-4885-a9fa-7ce30a39d630 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:35.583637 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2931d48a-ac70-4885-a9fa-7ce30a39d630 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:35.584089 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2931d48a-ac70-4885-a9fa-7ce30a39d630 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:35.585706 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2931d48a-ac70-4885-a9fa-7ce30a39d630 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:35.595675 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 171/342] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:54:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:35.601284 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931d48a-ac70-4885-a9fa-7ce30a39d630 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:35.677649 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 172/343] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:54:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:54:35.680363 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893486e-9179-441a-ae0b-eda3c167d1ec None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:35.706348 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931d48a-ac70-4885-a9fa-7ce30a39d630 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:35.743421 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac558c51-84b5-43a8-9a65-0db7ac964451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:35.744364 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac558c51-84b5-43a8-9a65-0db7ac964451 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:35.744921 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac558c51-84b5-43a8-9a65-0db7ac964451 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:35.745343 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac558c51-84b5-43a8-9a65-0db7ac964451 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:35.782693 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893486e-9179-441a-ae0b-eda3c167d1ec None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:35.821131 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac558c51-84b5-43a8-9a65-0db7ac964451 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:35.821131 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac558c51-84b5-43a8-9a65-0db7ac964451 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:35.824764 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df428f04-05a8-4d9a-875c-f625586cb047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:35.825680 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df428f04-05a8-4d9a-875c-f625586cb047 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:35.825958 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df428f04-05a8-4d9a-875c-f625586cb047 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:35.826224 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df428f04-05a8-4d9a-875c-f625586cb047 None admin] PATH_INFO: `/v3/projects/61523379bf5c40d6a32f35726b048037` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:35.827994 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df428f04-05a8-4d9a-875c-f625586cb047 None admin] RBAC: Authorizing `identity:get_project(project_id=61523379bf5c40d6a32f35726b048037)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:35.829269 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df428f04-05a8-4d9a-875c-f625586cb047 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:35.840286 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 173/344] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:54:35 2022] GET /identity/v3/projects/61523379bf5c40d6a32f35726b048037 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:54:35.841729 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca368f-0c1a-43a5-9199-b329cef27cc0 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:35.842014 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca368f-0c1a-43a5-9199-b329cef27cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:35.842285 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca368f-0c1a-43a5-9199-b329cef27cc0 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:35.844109 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 174/345] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:35.845070 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca368f-0c1a-43a5-9199-b329cef27cc0 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:35.966669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca368f-0c1a-43a5-9199-b329cef27cc0 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:36.026046 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 172/346] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:54:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:54:36.027221 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c753d6-4331-4eb5-ab15-f9f04d686672 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:36.027504 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c753d6-4331-4eb5-ab15-f9f04d686672 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:36.027786 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c753d6-4331-4eb5-ab15-f9f04d686672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:36.035020 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e88dd-7924-4662-afe7-398a29b91893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:36.035885 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e88dd-7924-4662-afe7-398a29b91893 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:36.036159 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e88dd-7924-4662-afe7-398a29b91893 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:36.036424 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e88dd-7924-4662-afe7-398a29b91893 None admin] PATH_INFO: `/v3/groups/83317d6c21184cea8a2cf2477edb816c` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:36.049132 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e88dd-7924-4662-afe7-398a29b91893 None admin] RBAC: Authorizing `identity:get_group(group_id=83317d6c21184cea8a2cf2477edb816c)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:36.050617 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e88dd-7924-4662-afe7-398a29b91893 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:36.052333 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 175/347] 10.222.0.24 () {56 vars in 1180 bytes} [Mon May 16 18:54:35 2022] GET /identity/v3/groups/83317d6c21184cea8a2cf2477edb816c => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:36.053092 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e88dd-7924-4662-afe7-398a29b91893 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:36.061090 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-67c753d6-4331-4eb5-ab15-f9f04d686672 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:36.062301 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-67c753d6-4331-4eb5-ab15-f9f04d686672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:36.163170 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e88dd-7924-4662-afe7-398a29b91893 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:36.201358 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be30fe-9703-4d7b-a6f0-59d94015dc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:36.202266 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be30fe-9703-4d7b-a6f0-59d94015dc10 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:36.202545 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be30fe-9703-4d7b-a6f0-59d94015dc10 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:36.202815 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be30fe-9703-4d7b-a6f0-59d94015dc10 None admin] PATH_INFO: `/v3/projects/61523379bf5c40d6a32f35726b048037` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:36.205095 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be30fe-9703-4d7b-a6f0-59d94015dc10 None admin] RBAC: Authorizing `identity:get_project(project_id=61523379bf5c40d6a32f35726b048037)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:36.206574 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be30fe-9703-4d7b-a6f0-59d94015dc10 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:36.215357 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 173/349] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:54:36.216317 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c753d6-4331-4eb5-ab15-f9f04d686672 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:36.216806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 176/349] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:54:36 2022] GET /identity/v3/projects/61523379bf5c40d6a32f35726b048037 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:36.220332 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be30fe-9703-4d7b-a6f0-59d94015dc10 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:36.333271 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be30fe-9703-4d7b-a6f0-59d94015dc10 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:36.374154 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7014176b-1fe0-4388-99a6-58f535286445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:36.375036 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014176b-1fe0-4388-99a6-58f535286445 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:36.375320 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014176b-1fe0-4388-99a6-58f535286445 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:36.375588 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014176b-1fe0-4388-99a6-58f535286445 None admin] PATH_INFO: `/v3/groups/83317d6c21184cea8a2cf2477edb816c` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:36.376905 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7014176b-1fe0-4388-99a6-58f535286445 None admin] RBAC: Authorizing `identity:get_group(group_id=83317d6c21184cea8a2cf2477edb816c)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:36.378396 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7014176b-1fe0-4388-99a6-58f535286445 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:36.380207 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 177/350] 10.222.0.24 () {56 vars in 1180 bytes} [Mon May 16 18:54:36 2022] GET /identity/v3/groups/83317d6c21184cea8a2cf2477edb816c => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:36.382339 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7014176b-1fe0-4388-99a6-58f535286445 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:36.432174 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c753d6-4331-4eb5-ab15-f9f04d686672 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:36.475670 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755aec2-197f-4016-9ad3-d34dfee9a24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:36.476436 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755aec2-197f-4016-9ad3-d34dfee9a24f None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:36.476720 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755aec2-197f-4016-9ad3-d34dfee9a24f None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:36.477131 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755aec2-197f-4016-9ad3-d34dfee9a24f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:36.478066 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755aec2-197f-4016-9ad3-d34dfee9a24f None admin] RBAC: Adding query filter params (group.id=83317d6c21184cea8a2cf2477edb816c, role.id=b0e5c5e3b5f54789a5a5c4c51220c97e, scope.project.id=61523379bf5c40d6a32f35726b048037) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:36.478371 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755aec2-197f-4016-9ad3-d34dfee9a24f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:36.480011 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755aec2-197f-4016-9ad3-d34dfee9a24f None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:36.493969 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 174/351] 10.222.0.24 () {56 vars in 1376 bytes} [Mon May 16 18:54:36 2022] GET /identity/v3/role_assignments?group.id=83317d6c21184cea8a2cf2477edb816c&scope.project.id=61523379bf5c40d6a32f35726b048037&role.id=b0e5c5e3b5f54789a5a5c4c51220c97e => generated 260 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:36.495221 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755aec2-197f-4016-9ad3-d34dfee9a24f None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:36.624694 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7014176b-1fe0-4388-99a6-58f535286445 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:36.630442 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755aec2-197f-4016-9ad3-d34dfee9a24f None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:36.666928 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8954c75-1846-42dd-a47e-b3545235f89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:36.668269 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8954c75-1846-42dd-a47e-b3545235f89a None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:36.668836 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8954c75-1846-42dd-a47e-b3545235f89a None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:36.669304 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8954c75-1846-42dd-a47e-b3545235f89a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:36.670403 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8954c75-1846-42dd-a47e-b3545235f89a None admin] RBAC: Adding query filter params (group.id=83317d6c21184cea8a2cf2477edb816c, role.id=fda97f4c5b1f4e1ba165f8dfa70ddbd6, scope.project.id=61523379bf5c40d6a32f35726b048037) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:36.670926 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8954c75-1846-42dd-a47e-b3545235f89a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:36.672656 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8954c75-1846-42dd-a47e-b3545235f89a None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:36.674298 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273a129-6f0f-4f79-a60b-cd0fffcdc92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:36.675265 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273a129-6f0f-4f79-a60b-cd0fffcdc92c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:36.675390 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273a129-6f0f-4f79-a60b-cd0fffcdc92c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:36.675670 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273a129-6f0f-4f79-a60b-cd0fffcdc92c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:36.680715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 175/352] 10.222.0.24 () {56 vars in 1376 bytes} [Mon May 16 18:54:36 2022] GET /identity/v3/role_assignments?group.id=83317d6c21184cea8a2cf2477edb816c&scope.project.id=61523379bf5c40d6a32f35726b048037&role.id=fda97f4c5b1f4e1ba165f8dfa70ddbd6 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:36.682604 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b04e9-2cd0-4a17-808c-82c3f72eecac None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:36.683173 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b04e9-2cd0-4a17-808c-82c3f72eecac None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:36.683671 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b04e9-2cd0-4a17-808c-82c3f72eecac None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:36.689955 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 176/353] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:36.692212 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e8693-4205-4ad6-bf5d-2e64db36317d None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:36.692783 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e8693-4205-4ad6-bf5d-2e64db36317d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:36.693264 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e8693-4205-4ad6-bf5d-2e64db36317d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:36.695671 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273a129-6f0f-4f79-a60b-cd0fffcdc92c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:36.707882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-d273a129-6f0f-4f79-a60b-cd0fffcdc92c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 18:54:36.707882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:36.707882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:36.707882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:36.707882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:36.707882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:36.707882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:36.707882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:36.707882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:36.707882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:36.707882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:36.707882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:36.707882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:36.707882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:36.707882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:36.707882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:36.708894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:36.708894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:36.708894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:36.708894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:36.708894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:36.708894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:36.708894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:36.708894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:36.708894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:36.708894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:36.708894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:36.708894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:54:36.708894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:36.708894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:36.708894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:36.708894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:36.709762 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:36.709762 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:36.709762 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:36.709762 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:36.709762 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:36.709762 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:36.709762 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:36.709762 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:36.709762 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:36.709762 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:36.709762 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 18:54:36.709762 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:54:36.709762 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 178/354] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:54:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:36.715756 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273a129-6f0f-4f79-a60b-cd0fffcdc92c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:36.716294 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-ec8e8693-4205-4ad6-bf5d-2e64db36317d None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:36.718148 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-ec8e8693-4205-4ad6-bf5d-2e64db36317d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:36.790225 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 177/355] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:54:36.819069 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e8693-4205-4ad6-bf5d-2e64db36317d None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:36.832064 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273a129-6f0f-4f79-a60b-cd0fffcdc92c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:36.868322 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03d3e1-6760-4ad2-a159-03f9b409c352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:36.869029 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03d3e1-6760-4ad2-a159-03f9b409c352 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:36.869303 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03d3e1-6760-4ad2-a159-03f9b409c352 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:36.869594 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03d3e1-6760-4ad2-a159-03f9b409c352 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:36.870433 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03d3e1-6760-4ad2-a159-03f9b409c352 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:36.870738 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03d3e1-6760-4ad2-a159-03f9b409c352 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:36.872532 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03d3e1-6760-4ad2-a159-03f9b409c352 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:36.881706 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 179/356] 10.222.0.24 () {56 vars in 1101 bytes} [Mon May 16 18:54:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:36.887936 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03d3e1-6760-4ad2-a159-03f9b409c352 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:36.931341 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e8693-4205-4ad6-bf5d-2e64db36317d None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:36.966389 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05714358-fecd-44f2-97c6-8404d094b788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:36.967559 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05714358-fecd-44f2-97c6-8404d094b788 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:36.967984 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05714358-fecd-44f2-97c6-8404d094b788 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:36.968419 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05714358-fecd-44f2-97c6-8404d094b788 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:36.979695 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05714358-fecd-44f2-97c6-8404d094b788 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:36.987979 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-05714358-fecd-44f2-97c6-8404d094b788 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 18:54:36.987979 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:36.987979 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:36.987979 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:36.987979 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:36.987979 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:36.987979 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:36.987979 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:36.987979 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:36.987979 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:36.987979 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:36.987979 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:36.987979 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:36.987979 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:36.987979 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:36.987979 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:36.988982 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:36.988982 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:36.988982 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:36.988982 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:36.988982 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:36.988982 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:36.988982 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:36.988982 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:36.988982 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:36.988982 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:36.988982 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:36.988982 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:36.988982 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:36.988982 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:36.988982 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:36.988982 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:36.989815 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:36.989815 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:36.989815 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:36.989815 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:36.989815 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:36.989815 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:36.989815 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:36.989815 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:36.989815 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:36.989815 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:36.989815 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 18:54:36.989815 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:36.992324 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03d3e1-6760-4ad2-a159-03f9b409c352 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:36.992754 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 178/357] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:54:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:54:36.998892 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05714358-fecd-44f2-97c6-8404d094b788 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:37.027387 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c66895-8df0-43b3-ad8f-79749128e41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:37.028409 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c66895-8df0-43b3-ad8f-79749128e41b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:37.028755 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c66895-8df0-43b3-ad8f-79749128e41b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:37.029089 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c66895-8df0-43b3-ad8f-79749128e41b None admin] PATH_INFO: `/v3/users/7b11d2efc8fb4c41a3ae61083749ae9d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:37.030437 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c66895-8df0-43b3-ad8f-79749128e41b None admin] RBAC: Authorizing `identity:get_user(user_id=7b11d2efc8fb4c41a3ae61083749ae9d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:37.032060 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c66895-8df0-43b3-ad8f-79749128e41b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:37.034110 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 180/358] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:54:36 2022] GET /identity/v3/users/7b11d2efc8fb4c41a3ae61083749ae9d => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:54:37.040875 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c66895-8df0-43b3-ad8f-79749128e41b None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:37.108389 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05714358-fecd-44f2-97c6-8404d094b788 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:37.142354 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c66895-8df0-43b3-ad8f-79749128e41b None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:37.147029 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678e91b-59f6-41b1-bdd2-f8808f5efe5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:37.147996 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678e91b-59f6-41b1-bdd2-f8808f5efe5b None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:37.148477 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678e91b-59f6-41b1-bdd2-f8808f5efe5b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:37.148958 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678e91b-59f6-41b1-bdd2-f8808f5efe5b None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:37.149999 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1678e91b-59f6-41b1-bdd2-f8808f5efe5b None admin] RBAC: Adding query filter params (name=member) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:37.150501 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1678e91b-59f6-41b1-bdd2-f8808f5efe5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:37.152172 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1678e91b-59f6-41b1-bdd2-f8808f5efe5b None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:37.164384 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 179/359] 10.222.0.24 () {56 vars in 1101 bytes} [Mon May 16 18:54:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:54:37.168874 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678e91b-59f6-41b1-bdd2-f8808f5efe5b None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:37.179024 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe8621-51ae-47eb-ab8d-f00794aa7901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:37.179697 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe8621-51ae-47eb-ab8d-f00794aa7901 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:37.179967 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe8621-51ae-47eb-ab8d-f00794aa7901 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:37.180235 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe8621-51ae-47eb-ab8d-f00794aa7901 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:37.181072 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fe8621-51ae-47eb-ab8d-f00794aa7901 None admin] RBAC: Adding query filter params (role.id=8f0019918cbf4b05aa6de1a3c0850251, user.id=7b11d2efc8fb4c41a3ae61083749ae9d, scope.system=all) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:37.181369 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fe8621-51ae-47eb-ab8d-f00794aa7901 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:37.182899 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fe8621-51ae-47eb-ab8d-f00794aa7901 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:37.195189 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 181/360] 10.222.0.24 () {56 vars in 1308 bytes} [Mon May 16 18:54:37 2022] GET /identity/v3/role_assignments?user.id=7b11d2efc8fb4c41a3ae61083749ae9d&scope.system=all&role.id=8f0019918cbf4b05aa6de1a3c0850251 => generated 510 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:54:37.199913 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c8677-48b9-4d01-b227-5df7e413f266 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:37.200623 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c8677-48b9-4d01-b227-5df7e413f266 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:37.200746 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c8677-48b9-4d01-b227-5df7e413f266 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:37.202449 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 182/361] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:37.207974 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebebab-6528-4c1b-978c-6cec92a10cd6 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:37.208191 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebebab-6528-4c1b-978c-6cec92a10cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:37.208453 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebebab-6528-4c1b-978c-6cec92a10cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:37.233524 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-a4ebebab-6528-4c1b-978c-6cec92a10cd6 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:37.234784 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a4ebebab-6528-4c1b-978c-6cec92a10cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:37.281241 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678e91b-59f6-41b1-bdd2-f8808f5efe5b None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:37.317462 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 183/362] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:54:37.318246 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa281165-2883-4e83-8473-36b63d75dcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:37.318927 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa281165-2883-4e83-8473-36b63d75dcbf None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:37.320603 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa281165-2883-4e83-8473-36b63d75dcbf None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:37.320603 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa281165-2883-4e83-8473-36b63d75dcbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:37.358929 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebebab-6528-4c1b-978c-6cec92a10cd6 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:37.393306 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa281165-2883-4e83-8473-36b63d75dcbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:37.394890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa281165-2883-4e83-8473-36b63d75dcbf None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:37.495852 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 180/363] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:54:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 18:54:37.501258 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebebab-6528-4c1b-978c-6cec92a10cd6 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:37.501410 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa281165-2883-4e83-8473-36b63d75dcbf None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:37.555624 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa1dd9-ea26-4149-8c82-e71f894ddee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:37.556882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa1dd9-ea26-4149-8c82-e71f894ddee0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:37.557450 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa1dd9-ea26-4149-8c82-e71f894ddee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:37.557929 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa1dd9-ea26-4149-8c82-e71f894ddee0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:37.579321 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aa1dd9-ea26-4149-8c82-e71f894ddee0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:37.587707 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-96aa1dd9-ea26-4149-8c82-e71f894ddee0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:54:37.587707 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:37.587707 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:37.587707 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:37.587707 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:37.587707 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:37.587707 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:37.587707 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:37.587707 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:37.587707 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:37.587707 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:37.587707 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:37.587707 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:37.587707 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:37.587707 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:37.587707 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:37.588755 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:37.588755 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:37.588755 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:37.588755 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:37.588755 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:37.588755 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:37.588755 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:37.588755 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:37.588755 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:37.588755 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:37.588755 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:37.588755 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:54:37.588755 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:37.588755 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:37.588755 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:37.588755 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:37.589550 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:37.589550 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:37.589550 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:37.589550 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:37.589550 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:37.589550 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:37.589550 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:37.589550 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:37.589550 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:37.589550 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:37.589550 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:54:37.589550 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:54:37.589550 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 184/364] 10.222.0.24 () {56 vars in 1114 bytes} [Mon May 16 18:54:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:37.599329 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa1dd9-ea26-4149-8c82-e71f894ddee0 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:37.627187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa281165-2883-4e83-8473-36b63d75dcbf None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:37.670819 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d06ca4-36c7-4312-a069-7ee87468fc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:37.671720 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d06ca4-36c7-4312-a069-7ee87468fc93 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:37.671996 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d06ca4-36c7-4312-a069-7ee87468fc93 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:37.672264 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d06ca4-36c7-4312-a069-7ee87468fc93 None admin] PATH_INFO: `/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:37.673489 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d06ca4-36c7-4312-a069-7ee87468fc93 None admin] RBAC: Authorizing `identity:get_project(project_id=4e1cc38a8ece4d619be76f0ba70f8f1b)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:37.675269 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d06ca4-36c7-4312-a069-7ee87468fc93 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:37.681956 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 181/365] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:54:37 2022] GET /identity/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:54:37.683698 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d06ca4-36c7-4312-a069-7ee87468fc93 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:37.794095 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d06ca4-36c7-4312-a069-7ee87468fc93 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:37.830729 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d1616-630c-4fb3-9d39-f687dba6a521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:37.831783 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d1616-630c-4fb3-9d39-f687dba6a521 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:37.832063 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d1616-630c-4fb3-9d39-f687dba6a521 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:37.832506 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d1616-630c-4fb3-9d39-f687dba6a521 None admin] PATH_INFO: `/v3/groups/83317d6c21184cea8a2cf2477edb816c` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:37.834308 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7d1616-630c-4fb3-9d39-f687dba6a521 None admin] RBAC: Authorizing `identity:get_group(group_id=83317d6c21184cea8a2cf2477edb816c)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:37.835792 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7d1616-630c-4fb3-9d39-f687dba6a521 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:37.837891 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 182/366] 10.222.0.24 () {56 vars in 1180 bytes} [Mon May 16 18:54:37 2022] GET /identity/v3/groups/83317d6c21184cea8a2cf2477edb816c => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:37.844590 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d1616-630c-4fb3-9d39-f687dba6a521 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:37.857375 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa1dd9-ea26-4149-8c82-e71f894ddee0 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:37.918801 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946de88-74bc-4055-8a5f-ca7822765ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:37.920006 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946de88-74bc-4055-8a5f-ca7822765ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:37.920483 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946de88-74bc-4055-8a5f-ca7822765ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:37.921589 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946de88-74bc-4055-8a5f-ca7822765ff8 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:37.922819 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946de88-74bc-4055-8a5f-ca7822765ff8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:37.923296 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946de88-74bc-4055-8a5f-ca7822765ff8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:37.925829 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946de88-74bc-4055-8a5f-ca7822765ff8 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:37.935641 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 185/367] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:54:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:37.937637 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00763494-a837-4f61-ad62-0b2de27f0f49 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:37.938221 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00763494-a837-4f61-ad62-0b2de27f0f49 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:37.939071 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00763494-a837-4f61-ad62-0b2de27f0f49 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:37.941214 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 186/368] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:37.942407 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00763494-a837-4f61-ad62-0b2de27f0f49 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:37.962943 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d1616-630c-4fb3-9d39-f687dba6a521 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:37.998163 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf65218-2b5d-4e25-a4c6-703263194c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:37.999152 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf65218-2b5d-4e25-a4c6-703263194c25 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:37.999610 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf65218-2b5d-4e25-a4c6-703263194c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:38.000059 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf65218-2b5d-4e25-a4c6-703263194c25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:38.001115 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf65218-2b5d-4e25-a4c6-703263194c25 None admin] RBAC: Adding query filter params (group.id=83317d6c21184cea8a2cf2477edb816c, role.id=b0e5c5e3b5f54789a5a5c4c51220c97e, scope.project.id=4e1cc38a8ece4d619be76f0ba70f8f1b) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:38.001781 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf65218-2b5d-4e25-a4c6-703263194c25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:38.003457 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf65218-2b5d-4e25-a4c6-703263194c25 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:38.009408 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 183/369] 10.222.0.24 () {56 vars in 1376 bytes} [Mon May 16 18:54:37 2022] GET /identity/v3/role_assignments?group.id=83317d6c21184cea8a2cf2477edb816c&scope.project.id=4e1cc38a8ece4d619be76f0ba70f8f1b&role.id=b0e5c5e3b5f54789a5a5c4c51220c97e => generated 260 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:54:38.011296 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e2dbc-907b-441a-876c-d6b0d7d15f37 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:38.011794 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e2dbc-907b-441a-876c-d6b0d7d15f37 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:38.012281 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e2dbc-907b-441a-876c-d6b0d7d15f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:38.042263 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-cc8e2dbc-907b-441a-876c-d6b0d7d15f37 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:38.043848 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-cc8e2dbc-907b-441a-876c-d6b0d7d15f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:38.066558 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00763494-a837-4f61-ad62-0b2de27f0f49 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:38.121230 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe74b899-8679-4389-9ef6-88a6cf43a732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:38.124218 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74b899-8679-4389-9ef6-88a6cf43a732 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:38.124502 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74b899-8679-4389-9ef6-88a6cf43a732 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:38.124774 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74b899-8679-4389-9ef6-88a6cf43a732 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:38.177731 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 184/370] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:54:38.220602 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe74b899-8679-4389-9ef6-88a6cf43a732 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:38.222130 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe74b899-8679-4389-9ef6-88a6cf43a732 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:38.224380 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e2dbc-907b-441a-876c-d6b0d7d15f37 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:38.389456 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e2dbc-907b-441a-876c-d6b0d7d15f37 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:38.403674 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 187/371] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:54:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:54:38.414831 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe74b899-8679-4389-9ef6-88a6cf43a732 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:38.455969 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c30608-c85e-42b9-bccd-69c2bb6b31ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:38.456805 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c30608-c85e-42b9-bccd-69c2bb6b31ea None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:38.457089 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c30608-c85e-42b9-bccd-69c2bb6b31ea None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:38.457356 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c30608-c85e-42b9-bccd-69c2bb6b31ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:38.480661 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c30608-c85e-42b9-bccd-69c2bb6b31ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:38.488419 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-e2c30608-c85e-42b9-bccd-69c2bb6b31ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:54:38.488419 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:38.488419 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:38.488419 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:38.488419 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:38.488419 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:38.488419 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:38.488419 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:38.488419 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:38.488419 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:38.488419 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:38.488419 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:38.488419 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:38.488419 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:38.488419 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:38.488419 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:38.489264 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:38.489264 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:38.489264 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:38.489264 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:38.489264 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:38.489264 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:38.489264 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:38.489264 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:38.489264 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:38.489264 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:38.489264 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:38.489264 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:38.489264 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:38.489264 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:38.489264 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:38.489264 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:38.490523 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:38.490523 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:38.490523 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:38.490523 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:38.490523 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:38.490523 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:38.490523 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:38.490523 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:38.490523 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:38.490523 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:38.490523 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:54:38.490523 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:38.492827 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 185/372] 10.222.0.24 () {56 vars in 1096 bytes} [Mon May 16 18:54:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:54:38.497712 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c30608-c85e-42b9-bccd-69c2bb6b31ea None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:38.573684 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe74b899-8679-4389-9ef6-88a6cf43a732 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:38.615227 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c45e5-17f2-42ff-ba7e-3725b956ab43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:38.616109 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c45e5-17f2-42ff-ba7e-3725b956ab43 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:38.616386 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c45e5-17f2-42ff-ba7e-3725b956ab43 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:38.616655 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c45e5-17f2-42ff-ba7e-3725b956ab43 None admin] PATH_INFO: `/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:38.618495 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c45e5-17f2-42ff-ba7e-3725b956ab43 None admin] RBAC: Authorizing `identity:get_project(project_id=4e1cc38a8ece4d619be76f0ba70f8f1b)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:38.619992 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c45e5-17f2-42ff-ba7e-3725b956ab43 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:38.621749 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 188/373] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:54:38 2022] GET /identity/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:54:38.629955 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c45e5-17f2-42ff-ba7e-3725b956ab43 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:38.688404 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c30608-c85e-42b9-bccd-69c2bb6b31ea None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:38.760398 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c45e5-17f2-42ff-ba7e-3725b956ab43 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:38.794290 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fc915-2d10-483a-9733-d2c139b68e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:38.794973 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fc915-2d10-483a-9733-d2c139b68e29 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:38.795266 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fc915-2d10-483a-9733-d2c139b68e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:38.795538 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fc915-2d10-483a-9733-d2c139b68e29 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:38.796312 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71fc915-2d10-483a-9733-d2c139b68e29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:38.796612 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71fc915-2d10-483a-9733-d2c139b68e29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:38.798068 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71fc915-2d10-483a-9733-d2c139b68e29 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:38.799900 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f36a0-d36e-49c3-8801-d633efcd7d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:38.800779 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f36a0-d36e-49c3-8801-d633efcd7d67 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:38.801057 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f36a0-d36e-49c3-8801-d633efcd7d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:38.801330 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f36a0-d36e-49c3-8801-d633efcd7d67 None admin] PATH_INFO: `/v3/groups/83317d6c21184cea8a2cf2477edb816c` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:38.802577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f36a0-d36e-49c3-8801-d633efcd7d67 None admin] RBAC: Authorizing `identity:get_group(group_id=83317d6c21184cea8a2cf2477edb816c)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:38.804036 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f36a0-d36e-49c3-8801-d633efcd7d67 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:38.805712 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 189/374] 10.222.0.24 () {56 vars in 1180 bytes} [Mon May 16 18:54:38 2022] GET /identity/v3/groups/83317d6c21184cea8a2cf2477edb816c => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:38.809494 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 186/375] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:54:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:38.811675 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f36a0-d36e-49c3-8801-d633efcd7d67 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:38.815065 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fc915-2d10-483a-9733-d2c139b68e29 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:38.916561 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f36a0-d36e-49c3-8801-d633efcd7d67 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:38.957972 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2c8d8-09db-4980-bf1c-ad68befc72c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:38.958563 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2c8d8-09db-4980-bf1c-ad68befc72c5 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:38.958843 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2c8d8-09db-4980-bf1c-ad68befc72c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:38.959115 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2c8d8-09db-4980-bf1c-ad68befc72c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:38.959959 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2c8d8-09db-4980-bf1c-ad68befc72c5 None admin] RBAC: Adding query filter params (group.id=83317d6c21184cea8a2cf2477edb816c, role.id=fda97f4c5b1f4e1ba165f8dfa70ddbd6, scope.project.id=4e1cc38a8ece4d619be76f0ba70f8f1b) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:38.960270 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2c8d8-09db-4980-bf1c-ad68befc72c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:38.961781 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2c8d8-09db-4980-bf1c-ad68befc72c5 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:38.981624 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 190/376] 10.222.0.24 () {56 vars in 1376 bytes} [Mon May 16 18:54:38 2022] GET /identity/v3/role_assignments?group.id=83317d6c21184cea8a2cf2477edb816c&scope.project.id=4e1cc38a8ece4d619be76f0ba70f8f1b&role.id=fda97f4c5b1f4e1ba165f8dfa70ddbd6 => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:39.011117 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fc915-2d10-483a-9733-d2c139b68e29 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:39.052399 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5502c28-adc7-4872-a467-471b551bf112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:39.053082 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5502c28-adc7-4872-a467-471b551bf112 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:39.053361 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5502c28-adc7-4872-a467-471b551bf112 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:39.053661 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5502c28-adc7-4872-a467-471b551bf112 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:39.144662 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5502c28-adc7-4872-a467-471b551bf112 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:39.146205 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5502c28-adc7-4872-a467-471b551bf112 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:39.273194 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 187/377] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:54:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 18:54:39.278468 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2c8d8-09db-4980-bf1c-ad68befc72c5 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:39.410157 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2c8d8-09db-4980-bf1c-ad68befc72c5 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:39.450284 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b65c4-f428-4f37-92fa-012887136e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:39.451169 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b65c4-f428-4f37-92fa-012887136e92 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:39.451449 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b65c4-f428-4f37-92fa-012887136e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:39.451723 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b65c4-f428-4f37-92fa-012887136e92 None admin] PATH_INFO: `/v3/projects/1f43cb24f4194077b63c058f20af8f90` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:39.452987 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613b65c4-f428-4f37-92fa-012887136e92 None admin] RBAC: Authorizing `identity:get_project(project_id=1f43cb24f4194077b63c058f20af8f90)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:39.454508 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613b65c4-f428-4f37-92fa-012887136e92 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:39.456553 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 191/378] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:54:39 2022] GET /identity/v3/projects/1f43cb24f4194077b63c058f20af8f90 => generated 344 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:39.461716 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5502c28-adc7-4872-a467-471b551bf112 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:39.563303 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaecff0-8f43-4318-8262-3185b5b2b33a None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:39.563484 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaecff0-8f43-4318-8262-3185b5b2b33a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:39.563758 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaecff0-8f43-4318-8262-3185b5b2b33a None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:39.565299 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 192/379] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:54:39.570277 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be85e8-433f-49ef-818c-b26a4bbafc81 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:39.570550 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be85e8-433f-49ef-818c-b26a4bbafc81 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:39.570820 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be85e8-433f-49ef-818c-b26a4bbafc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:39.592861 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5502c28-adc7-4872-a467-471b551bf112 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:39.595110 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-57be85e8-433f-49ef-818c-b26a4bbafc81 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:39.596271 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-57be85e8-433f-49ef-818c-b26a4bbafc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:39.672974 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 193/380] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:54:39.682305 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fd4ef-e575-4aec-89c6-c684f1d2046e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:39.683453 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fd4ef-e575-4aec-89c6-c684f1d2046e None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:39.683934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fd4ef-e575-4aec-89c6-c684f1d2046e None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:39.684429 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fd4ef-e575-4aec-89c6-c684f1d2046e None admin] PATH_INFO: `/v3/groups/a668911e958543b89d230a6affd5f72d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:39.696600 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be85e8-433f-49ef-818c-b26a4bbafc81 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:39.697129 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135fd4ef-e575-4aec-89c6-c684f1d2046e None admin] RBAC: Authorizing `identity:get_group(group_id=a668911e958543b89d230a6affd5f72d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:39.698924 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135fd4ef-e575-4aec-89c6-c684f1d2046e None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:39.702596 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 188/381] 10.222.0.24 () {56 vars in 1180 bytes} [Mon May 16 18:54:39 2022] GET /identity/v3/groups/a668911e958543b89d230a6affd5f72d => generated 229 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:39.723422 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fd4ef-e575-4aec-89c6-c684f1d2046e None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:39.801242 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be85e8-433f-49ef-818c-b26a4bbafc81 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:39.836556 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f76a7-6532-4bd0-9238-c5418a0204de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:39.837308 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f76a7-6532-4bd0-9238-c5418a0204de None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:39.837568 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f76a7-6532-4bd0-9238-c5418a0204de None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:39.837842 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f76a7-6532-4bd0-9238-c5418a0204de None admin] PATH_INFO: `/v3/roles/member` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:39.848791 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f76a7-6532-4bd0-9238-c5418a0204de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:39.856577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-807f76a7-6532-4bd0-9238-c5418a0204de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 18:54:39.856577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:39.856577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:39.856577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:39.856577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:39.856577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:39.856577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:39.856577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:39.856577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:39.856577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:39.856577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:39.856577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:39.856577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:39.856577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:39.856577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:39.856577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:39.857476 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:39.857476 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:39.857476 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:39.857476 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:39.857476 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:39.857476 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:39.857476 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:39.857476 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:39.857476 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:39.857476 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:39.857476 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:39.857476 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:54:39.857476 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:39.857476 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:39.857476 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:39.857476 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:39.858740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:39.858740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:39.858740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:39.858740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:39.858740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:39.858740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:39.858740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:39.858740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:39.858740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:39.858740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:39.858740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 18:54:39.858740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:54:39.858740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 194/382] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:54:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:54:39.863782 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f76a7-6532-4bd0-9238-c5418a0204de None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:39.953336 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fd4ef-e575-4aec-89c6-c684f1d2046e None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:39.967373 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f76a7-6532-4bd0-9238-c5418a0204de None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:40.000158 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056ca0c-9c2a-4319-a3ae-f5d2e6a18ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:40.000838 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056ca0c-9c2a-4319-a3ae-f5d2e6a18ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:40.001114 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056ca0c-9c2a-4319-a3ae-f5d2e6a18ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:40.001384 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056ca0c-9c2a-4319-a3ae-f5d2e6a18ee2 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:40.002161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056ca0c-9c2a-4319-a3ae-f5d2e6a18ee2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:40.002464 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056ca0c-9c2a-4319-a3ae-f5d2e6a18ee2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:40.003856 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056ca0c-9c2a-4319-a3ae-f5d2e6a18ee2 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:40.012767 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 195/383] 10.222.0.24 () {56 vars in 1101 bytes} [Mon May 16 18:54:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:40.018310 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056ca0c-9c2a-4319-a3ae-f5d2e6a18ee2 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:40.036970 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82942c7d-87b3-4c0d-bfca-0a81d46e83e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:40.037669 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82942c7d-87b3-4c0d-bfca-0a81d46e83e9 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:40.037951 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82942c7d-87b3-4c0d-bfca-0a81d46e83e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:40.038589 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82942c7d-87b3-4c0d-bfca-0a81d46e83e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:40.039431 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82942c7d-87b3-4c0d-bfca-0a81d46e83e9 None admin] RBAC: Adding query filter params (group.id=a668911e958543b89d230a6affd5f72d, role.id=5a6e54e81bb24eceb618d9ffa67f488e, scope.project.id=1f43cb24f4194077b63c058f20af8f90) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:40.039745 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82942c7d-87b3-4c0d-bfca-0a81d46e83e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:40.041222 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82942c7d-87b3-4c0d-bfca-0a81d46e83e9 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:40.052364 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 189/384] 10.222.0.24 () {56 vars in 1376 bytes} [Mon May 16 18:54:39 2022] GET /identity/v3/role_assignments?group.id=a668911e958543b89d230a6affd5f72d&scope.project.id=1f43cb24f4194077b63c058f20af8f90&role.id=5a6e54e81bb24eceb618d9ffa67f488e => generated 260 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:54:40.099860 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a389f-9cb7-4063-b977-c7749a108b39 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:40.100171 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a389f-9cb7-4063-b977-c7749a108b39 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:40.100324 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a389f-9cb7-4063-b977-c7749a108b39 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:40.102114 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 190/385] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:40.108038 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa66a2f-6653-4a3f-a9e2-2dd5b5660916 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:40.108350 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa66a2f-6653-4a3f-a9e2-2dd5b5660916 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:40.108572 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa66a2f-6653-4a3f-a9e2-2dd5b5660916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:40.127692 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056ca0c-9c2a-4319-a3ae-f5d2e6a18ee2 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:40.154765 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-daa66a2f-6653-4a3f-a9e2-2dd5b5660916 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:40.156026 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-daa66a2f-6653-4a3f-a9e2-2dd5b5660916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:40.164918 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c3e77-39a9-401b-a369-742947a7d910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:40.165813 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c3e77-39a9-401b-a369-742947a7d910 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:40.166087 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c3e77-39a9-401b-a369-742947a7d910 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:40.166351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c3e77-39a9-401b-a369-742947a7d910 None admin] PATH_INFO: `/v3/groups/83317d6c21184cea8a2cf2477edb816c` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:40.167594 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c3e77-39a9-401b-a369-742947a7d910 None admin] RBAC: Authorizing `identity:get_group(group_id=83317d6c21184cea8a2cf2477edb816c)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:40.169071 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c3e77-39a9-401b-a369-742947a7d910 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:40.171120 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 196/386] 10.222.0.24 () {56 vars in 1180 bytes} [Mon May 16 18:54:40 2022] GET /identity/v3/groups/83317d6c21184cea8a2cf2477edb816c => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:54:40.176702 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c3e77-39a9-401b-a369-742947a7d910 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:40.274206 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 191/387] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:54:40.276457 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c3e77-39a9-401b-a369-742947a7d910 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:40.311647 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a11e30-ea85-4720-919f-cb7c901d3f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:40.312537 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a11e30-ea85-4720-919f-cb7c901d3f51 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:40.312810 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a11e30-ea85-4720-919f-cb7c901d3f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:40.313078 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a11e30-ea85-4720-919f-cb7c901d3f51 None admin] PATH_INFO: `/v3/projects/61523379bf5c40d6a32f35726b048037` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:40.314344 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a11e30-ea85-4720-919f-cb7c901d3f51 None admin] RBAC: Authorizing `identity:get_project(project_id=61523379bf5c40d6a32f35726b048037)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:40.315841 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a11e30-ea85-4720-919f-cb7c901d3f51 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:40.317948 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 197/388] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:54:40 2022] GET /identity/v3/projects/61523379bf5c40d6a32f35726b048037 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:54:40.320279 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa66a2f-6653-4a3f-a9e2-2dd5b5660916 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:40.323474 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a11e30-ea85-4720-919f-cb7c901d3f51 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:40.424650 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a11e30-ea85-4720-919f-cb7c901d3f51 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:40.459495 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04833a4d-b692-4581-a5f1-1af8579e38da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:40.460390 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04833a4d-b692-4581-a5f1-1af8579e38da None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:40.460661 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04833a4d-b692-4581-a5f1-1af8579e38da None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:40.460929 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04833a4d-b692-4581-a5f1-1af8579e38da None admin] PATH_INFO: `/v3/projects/61523379bf5c40d6a32f35726b048037/groups/83317d6c21184cea8a2cf2477edb816c/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:40.462918 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04833a4d-b692-4581-a5f1-1af8579e38da None admin] RBAC: Authorizing `identity:create_grant(project_id=61523379bf5c40d6a32f35726b048037, group_id=83317d6c21184cea8a2cf2477edb816c, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:40.464461 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04833a4d-b692-4581-a5f1-1af8579e38da None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:40.471679 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa66a2f-6653-4a3f-a9e2-2dd5b5660916 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:40.489741 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 198/389] 10.222.0.24 () {58 vars in 1442 bytes} [Mon May 16 18:54:40 2022] PUT /identity/v3/projects/61523379bf5c40d6a32f35726b048037/groups/83317d6c21184cea8a2cf2477edb816c/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:54:40.517326 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213654a1-aa9b-4037-a565-aa121f2f11ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:40.518285 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213654a1-aa9b-4037-a565-aa121f2f11ce None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:40.518577 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213654a1-aa9b-4037-a565-aa121f2f11ce None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:40.518850 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213654a1-aa9b-4037-a565-aa121f2f11ce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:40.533447 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213654a1-aa9b-4037-a565-aa121f2f11ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:40.542721 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-213654a1-aa9b-4037-a565-aa121f2f11ce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:54:40.542721 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:40.542721 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:40.542721 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:40.542721 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:40.542721 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:40.542721 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:40.542721 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:40.542721 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:40.542721 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:40.542721 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:40.542721 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:40.542721 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:40.542721 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:40.542721 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:40.542721 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:40.544808 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:40.544808 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:40.544808 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:40.544808 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:40.544808 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:40.544808 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:40.544808 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:40.544808 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:40.544808 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:40.544808 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:40.544808 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:40.544808 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:40.544808 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:40.544808 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:40.544808 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:40.544808 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:40.545930 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:40.545930 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:40.545930 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:40.545930 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:40.545930 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:40.545930 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:40.545930 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:40.545930 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:40.545930 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:40.545930 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:40.545930 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:54:40.545930 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:40.545930 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 192/390] 10.222.0.24 () {56 vars in 1114 bytes} [Mon May 16 18:54:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:40.552745 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04833a4d-b692-4581-a5f1-1af8579e38da None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:40.712958 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04833a4d-b692-4581-a5f1-1af8579e38da None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:40.759688 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bc96d-ee56-4a96-b291-a94c0f0472ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:40.760408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bc96d-ee56-4a96-b291-a94c0f0472ff None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:40.760691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bc96d-ee56-4a96-b291-a94c0f0472ff None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:40.760963 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bc96d-ee56-4a96-b291-a94c0f0472ff None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:40.761861 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449bc96d-ee56-4a96-b291-a94c0f0472ff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:40.762171 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449bc96d-ee56-4a96-b291-a94c0f0472ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:40.763569 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449bc96d-ee56-4a96-b291-a94c0f0472ff None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:40.777027 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 199/391] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:54:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:40.778293 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213654a1-aa9b-4037-a565-aa121f2f11ce None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:40.897420 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213654a1-aa9b-4037-a565-aa121f2f11ce None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:40.944655 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e22bd-1ac2-42fb-a1ef-c2825ca892c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:40.945564 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e22bd-1ac2-42fb-a1ef-c2825ca892c5 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:40.945858 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e22bd-1ac2-42fb-a1ef-c2825ca892c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:40.946120 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e22bd-1ac2-42fb-a1ef-c2825ca892c5 None admin] PATH_INFO: `/v3/groups/83317d6c21184cea8a2cf2477edb816c` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:40.948333 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e22bd-1ac2-42fb-a1ef-c2825ca892c5 None admin] RBAC: Authorizing `identity:get_group(group_id=83317d6c21184cea8a2cf2477edb816c)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:40.949832 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e22bd-1ac2-42fb-a1ef-c2825ca892c5 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:40.951854 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 193/392] 10.222.0.24 () {56 vars in 1180 bytes} [Mon May 16 18:54:40 2022] GET /identity/v3/groups/83317d6c21184cea8a2cf2477edb816c => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:40.957642 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bc96d-ee56-4a96-b291-a94c0f0472ff None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:41.099063 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bc96d-ee56-4a96-b291-a94c0f0472ff None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:41.140627 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79eb536-72ff-4243-a67b-545c9d53d10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:41.141915 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79eb536-72ff-4243-a67b-545c9d53d10f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:41.142421 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79eb536-72ff-4243-a67b-545c9d53d10f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:41.142886 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79eb536-72ff-4243-a67b-545c9d53d10f None admin] PATH_INFO: `/v3/projects/61523379bf5c40d6a32f35726b048037` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:41.148113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79eb536-72ff-4243-a67b-545c9d53d10f None admin] RBAC: Authorizing `identity:get_project(project_id=61523379bf5c40d6a32f35726b048037)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:41.149897 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79eb536-72ff-4243-a67b-545c9d53d10f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:41.152189 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 200/393] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:54:40 2022] GET /identity/v3/projects/61523379bf5c40d6a32f35726b048037 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:41.158256 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e22bd-1ac2-42fb-a1ef-c2825ca892c5 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:41.296743 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e22bd-1ac2-42fb-a1ef-c2825ca892c5 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:41.323228 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977d960-8597-4edf-8d9e-7a089b5b0cc5 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:41.323856 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977d960-8597-4edf-8d9e-7a089b5b0cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:41.324355 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977d960-8597-4edf-8d9e-7a089b5b0cc5 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:41.330357 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 201/394] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:41.336036 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f14f3-ac1c-4a65-9755-441b2a5d7856 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:41.336574 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f14f3-ac1c-4a65-9755-441b2a5d7856 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:41.337180 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f14f3-ac1c-4a65-9755-441b2a5d7856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:41.346523 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a52fb-9329-4c63-8596-e9e21dade2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:41.347854 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a52fb-9329-4c63-8596-e9e21dade2dd None admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:41.348424 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a52fb-9329-4c63-8596-e9e21dade2dd None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:41.348902 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a52fb-9329-4c63-8596-e9e21dade2dd None admin] PATH_INFO: `/v3/projects/61523379bf5c40d6a32f35726b048037/groups/83317d6c21184cea8a2cf2477edb816c/roles/fda97f4c5b1f4e1ba165f8dfa70ddbd6` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:41.351861 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a52fb-9329-4c63-8596-e9e21dade2dd None admin] RBAC: Authorizing `identity:create_grant(project_id=61523379bf5c40d6a32f35726b048037, group_id=83317d6c21184cea8a2cf2477edb816c, role_id=fda97f4c5b1f4e1ba165f8dfa70ddbd6)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:41.353691 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a52fb-9329-4c63-8596-e9e21dade2dd None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:41.358859 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-e45f14f3-ac1c-4a65-9755-441b2a5d7856 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:41.360018 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e45f14f3-ac1c-4a65-9755-441b2a5d7856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:41.376807 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 194/395] 10.222.0.24 () {58 vars in 1442 bytes} [Mon May 16 18:54:41 2022] PUT /identity/v3/projects/61523379bf5c40d6a32f35726b048037/groups/83317d6c21184cea8a2cf2477edb816c/roles/fda97f4c5b1f4e1ba165f8dfa70ddbd6 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:54:41.470740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 202/396] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:54:41.498784 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a52fb-9329-4c63-8596-e9e21dade2dd None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:41.618554 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a52fb-9329-4c63-8596-e9e21dade2dd None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:41.655819 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8edfbde-7524-43fd-804c-a93f9efe72ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:41.657047 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edfbde-7524-43fd-804c-a93f9efe72ba None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:41.657552 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edfbde-7524-43fd-804c-a93f9efe72ba None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:41.658043 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edfbde-7524-43fd-804c-a93f9efe72ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:41.670207 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8edfbde-7524-43fd-804c-a93f9efe72ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:41.678400 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-f8edfbde-7524-43fd-804c-a93f9efe72ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 18:54:41.678400 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:41.678400 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:41.678400 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:41.678400 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:41.678400 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:41.678400 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:41.678400 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:41.678400 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:41.678400 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:41.678400 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:41.678400 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:41.678400 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:41.678400 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:41.678400 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:41.678400 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:41.679334 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:41.679334 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:41.679334 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:41.679334 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:41.679334 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:41.679334 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:41.679334 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:41.679334 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:41.679334 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:41.679334 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:41.679334 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:41.679334 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:41.679334 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:41.679334 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:41.679334 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:41.679334 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:41.680143 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:41.680143 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:41.680143 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:41.680143 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:41.680143 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:41.680143 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:41.680143 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:41.680143 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:41.680143 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:41.680143 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:41.680143 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 18:54:41.680143 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:41.683074 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 195/397] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:54:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:41.689339 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f14f3-ac1c-4a65-9755-441b2a5d7856 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:41.789007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f14f3-ac1c-4a65-9755-441b2a5d7856 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:41.827182 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fcda1-06a0-43ae-84e8-d68739f2ba0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:41.828671 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fcda1-06a0-43ae-84e8-d68739f2ba0f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:41.829151 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fcda1-06a0-43ae-84e8-d68739f2ba0f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:41.829661 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fcda1-06a0-43ae-84e8-d68739f2ba0f None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:41.830624 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8fcda1-06a0-43ae-84e8-d68739f2ba0f None admin] RBAC: Adding query filter params (name=member) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:41.831124 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8fcda1-06a0-43ae-84e8-d68739f2ba0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:41.832839 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8fcda1-06a0-43ae-84e8-d68739f2ba0f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:41.842122 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 203/398] 10.222.0.24 () {56 vars in 1101 bytes} [Mon May 16 18:54:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:41.848101 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8edfbde-7524-43fd-804c-a93f9efe72ba None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:41.872185 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5050fe-3c0d-4095-b003-1ccb98a1e703 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:41.872834 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5050fe-3c0d-4095-b003-1ccb98a1e703 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:41.873305 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5050fe-3c0d-4095-b003-1ccb98a1e703 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:41.875786 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 204/399] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:41.891504 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f382f73-21da-4605-947d-d8f6f2ba1190 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:41.892125 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f382f73-21da-4605-947d-d8f6f2ba1190 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:41.892596 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f382f73-21da-4605-947d-d8f6f2ba1190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:41.913648 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-1f382f73-21da-4605-947d-d8f6f2ba1190 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:41.915781 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1f382f73-21da-4605-947d-d8f6f2ba1190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:41.988807 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8edfbde-7524-43fd-804c-a93f9efe72ba None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:41.995958 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 205/400] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:54:42.036956 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c8551-7343-4381-a345-7cef70160cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:42.037864 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c8551-7343-4381-a345-7cef70160cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:42.038499 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c8551-7343-4381-a345-7cef70160cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:42.038768 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c8551-7343-4381-a345-7cef70160cb3 None admin] PATH_INFO: `/v3/groups/83317d6c21184cea8a2cf2477edb816c` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:42.042208 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c8551-7343-4381-a345-7cef70160cb3 None admin] RBAC: Authorizing `identity:get_group(group_id=83317d6c21184cea8a2cf2477edb816c)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:42.043696 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c8551-7343-4381-a345-7cef70160cb3 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:42.045691 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 196/401] 10.222.0.24 () {56 vars in 1180 bytes} [Mon May 16 18:54:41 2022] GET /identity/v3/groups/83317d6c21184cea8a2cf2477edb816c => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:42.051154 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f382f73-21da-4605-947d-d8f6f2ba1190 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:42.053266 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c8551-7343-4381-a345-7cef70160cb3 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:42.163994 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f382f73-21da-4605-947d-d8f6f2ba1190 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:42.196022 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c8551-7343-4381-a345-7cef70160cb3 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:42.200113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb279e40-0816-4bfa-8c9e-728ac39b66c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:42.201302 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb279e40-0816-4bfa-8c9e-728ac39b66c2 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:42.201838 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb279e40-0816-4bfa-8c9e-728ac39b66c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:42.202307 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb279e40-0816-4bfa-8c9e-728ac39b66c2 None admin] PATH_INFO: `/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:42.203743 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb279e40-0816-4bfa-8c9e-728ac39b66c2 None admin] RBAC: Authorizing `identity:get_project(project_id=4e1cc38a8ece4d619be76f0ba70f8f1b)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:42.205460 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb279e40-0816-4bfa-8c9e-728ac39b66c2 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:42.207808 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 206/402] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:54:42 2022] GET /identity/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:42.214851 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb279e40-0816-4bfa-8c9e-728ac39b66c2 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:42.237324 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d0e27-ebf6-4979-9b92-56ff1c98c122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:42.238272 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d0e27-ebf6-4979-9b92-56ff1c98c122 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:42.238556 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d0e27-ebf6-4979-9b92-56ff1c98c122 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:42.238828 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d0e27-ebf6-4979-9b92-56ff1c98c122 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:42.249500 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27d0e27-ebf6-4979-9b92-56ff1c98c122 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:42.257775 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-b27d0e27-ebf6-4979-9b92-56ff1c98c122 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:54:42.257775 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:42.257775 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:42.257775 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:42.257775 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:42.257775 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:42.257775 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:42.257775 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:42.257775 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:42.257775 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:42.257775 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:42.257775 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:42.257775 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:42.257775 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:42.257775 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:42.257775 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:42.258675 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:42.258675 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:42.258675 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:42.258675 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:42.258675 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:42.258675 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:42.258675 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:42.258675 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:42.258675 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:42.258675 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:42.258675 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:42.258675 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:42.258675 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:42.258675 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:42.258675 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:42.258675 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:42.259484 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:42.259484 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:42.259484 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:42.259484 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:42.259484 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:42.259484 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:42.259484 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:42.259484 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:42.259484 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:42.259484 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:42.259484 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:54:42.259484 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:42.259484 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 197/403] 10.222.0.24 () {56 vars in 1114 bytes} [Mon May 16 18:54:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:54:42.265094 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d0e27-ebf6-4979-9b92-56ff1c98c122 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:42.332674 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb279e40-0816-4bfa-8c9e-728ac39b66c2 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:42.366888 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d0e27-ebf6-4979-9b92-56ff1c98c122 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:42.370694 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a37a1-e5e5-422d-bd04-ab1918386885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:42.371863 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a37a1-e5e5-422d-bd04-ab1918386885 None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:42.372485 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a37a1-e5e5-422d-bd04-ab1918386885 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:42.372999 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a37a1-e5e5-422d-bd04-ab1918386885 None admin] PATH_INFO: `/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b/groups/83317d6c21184cea8a2cf2477edb816c/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:42.375292 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a37a1-e5e5-422d-bd04-ab1918386885 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e1cc38a8ece4d619be76f0ba70f8f1b, group_id=83317d6c21184cea8a2cf2477edb816c, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:42.376981 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a37a1-e5e5-422d-bd04-ab1918386885 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:42.402619 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 207/404] 10.222.0.24 () {58 vars in 1442 bytes} [Mon May 16 18:54:42 2022] PUT /identity/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b/groups/83317d6c21184cea8a2cf2477edb816c/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:54:42.404646 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e82e84-e96e-4a25-8d73-747726dacf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:42.405389 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e82e84-e96e-4a25-8d73-747726dacf96 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:42.405701 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e82e84-e96e-4a25-8d73-747726dacf96 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:42.405977 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e82e84-e96e-4a25-8d73-747726dacf96 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:42.406790 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e82e84-e96e-4a25-8d73-747726dacf96 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:42.407102 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e82e84-e96e-4a25-8d73-747726dacf96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:42.408640 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e82e84-e96e-4a25-8d73-747726dacf96 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:42.419918 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 198/405] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:54:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:54:42.425706 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a37a1-e5e5-422d-bd04-ab1918386885 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:42.585162 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a37a1-e5e5-422d-bd04-ab1918386885 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:42.632465 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569301b-f0d4-43cb-8659-adeac4e39cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:42.633755 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569301b-f0d4-43cb-8659-adeac4e39cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:42.634236 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569301b-f0d4-43cb-8659-adeac4e39cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:42.634732 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569301b-f0d4-43cb-8659-adeac4e39cc5 None admin] PATH_INFO: `/v3/groups/83317d6c21184cea8a2cf2477edb816c` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:42.642558 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569301b-f0d4-43cb-8659-adeac4e39cc5 None admin] RBAC: Authorizing `identity:get_group(group_id=83317d6c21184cea8a2cf2477edb816c)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:42.644396 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569301b-f0d4-43cb-8659-adeac4e39cc5 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:42.646744 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 208/406] 10.222.0.24 () {56 vars in 1180 bytes} [Mon May 16 18:54:42 2022] GET /identity/v3/groups/83317d6c21184cea8a2cf2477edb816c => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:42.652201 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e82e84-e96e-4a25-8d73-747726dacf96 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:42.796088 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e82e84-e96e-4a25-8d73-747726dacf96 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:42.836979 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b0353-9ac2-4a86-bc69-8f4e7e4a8c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:42.837920 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b0353-9ac2-4a86-bc69-8f4e7e4a8c9c None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:42.838223 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b0353-9ac2-4a86-bc69-8f4e7e4a8c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:42.838639 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b0353-9ac2-4a86-bc69-8f4e7e4a8c9c None admin] PATH_INFO: `/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:42.839854 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b0353-9ac2-4a86-bc69-8f4e7e4a8c9c None admin] RBAC: Authorizing `identity:get_project(project_id=4e1cc38a8ece4d619be76f0ba70f8f1b)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:42.841302 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b0353-9ac2-4a86-bc69-8f4e7e4a8c9c None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:42.843406 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 199/407] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:54:42 2022] GET /identity/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:42.848729 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569301b-f0d4-43cb-8659-adeac4e39cc5 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:42.947832 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569301b-f0d4-43cb-8659-adeac4e39cc5 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:42.997181 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28750c-78d0-46dd-9309-c0027d6c6851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:42.998133 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28750c-78d0-46dd-9309-c0027d6c6851 None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:42.998403 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28750c-78d0-46dd-9309-c0027d6c6851 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:42.998673 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28750c-78d0-46dd-9309-c0027d6c6851 None admin] PATH_INFO: `/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b/groups/83317d6c21184cea8a2cf2477edb816c/roles/fda97f4c5b1f4e1ba165f8dfa70ddbd6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:43.000897 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd28750c-78d0-46dd-9309-c0027d6c6851 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e1cc38a8ece4d619be76f0ba70f8f1b, group_id=83317d6c21184cea8a2cf2477edb816c, role_id=fda97f4c5b1f4e1ba165f8dfa70ddbd6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:43.002379 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd28750c-78d0-46dd-9309-c0027d6c6851 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:43.018252 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 209/408] 10.222.0.24 () {58 vars in 1442 bytes} [Mon May 16 18:54:42 2022] PUT /identity/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b/groups/83317d6c21184cea8a2cf2477edb816c/roles/fda97f4c5b1f4e1ba165f8dfa70ddbd6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:54:43.178662 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc6974-cc20-4bd5-ae74-945d7c0ffa3e None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:43.179013 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc6974-cc20-4bd5-ae74-945d7c0ffa3e None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:43.179215 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc6974-cc20-4bd5-ae74-945d7c0ffa3e None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:43.181035 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 200/409] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:43.186610 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5696816-8ebb-441c-8241-0341989f3389 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:43.187110 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5696816-8ebb-441c-8241-0341989f3389 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:43.187181 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5696816-8ebb-441c-8241-0341989f3389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:43.210850 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-d5696816-8ebb-441c-8241-0341989f3389 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:43.212108 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d5696816-8ebb-441c-8241-0341989f3389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:43.302618 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 210/410] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:54:43.326250 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc6974-cc20-4bd5-ae74-945d7c0ffa3e None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:43.432740 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc6974-cc20-4bd5-ae74-945d7c0ffa3e None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:43.469482 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dfa57a-254d-4b28-9e08-d7fc10f65fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:43.470311 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfa57a-254d-4b28-9e08-d7fc10f65fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:43.470595 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfa57a-254d-4b28-9e08-d7fc10f65fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:43.470858 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfa57a-254d-4b28-9e08-d7fc10f65fe8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:43.486088 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dfa57a-254d-4b28-9e08-d7fc10f65fe8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:43.493984 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-71dfa57a-254d-4b28-9e08-d7fc10f65fe8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:54:43.493984 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:43.493984 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:43.493984 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:43.493984 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:43.493984 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:43.493984 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:43.493984 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:43.493984 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:43.493984 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:43.493984 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:43.493984 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:43.493984 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:43.493984 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:43.493984 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:43.493984 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:43.495058 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:43.495058 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:43.495058 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:43.495058 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:43.495058 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:43.495058 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:43.495058 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:43.495058 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:43.495058 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:43.495058 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:43.495058 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:43.495058 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:43.495058 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:43.495058 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:43.495058 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:43.495058 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:43.495867 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:43.495867 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:43.495867 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:43.495867 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:43.495867 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:43.495867 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:43.495867 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:43.495867 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:43.495867 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:43.495867 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:43.495867 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:54:43.495867 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:43.495867 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 201/411] 10.222.0.24 () {56 vars in 1096 bytes} [Mon May 16 18:54:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:43.501666 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5696816-8ebb-441c-8241-0341989f3389 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:43.616777 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5696816-8ebb-441c-8241-0341989f3389 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:43.657544 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e82358-365d-4f3b-92f7-c11c88dd4fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:43.658230 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e82358-365d-4f3b-92f7-c11c88dd4fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:43.658506 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e82358-365d-4f3b-92f7-c11c88dd4fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:43.658772 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e82358-365d-4f3b-92f7-c11c88dd4fb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:43.659529 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e82358-365d-4f3b-92f7-c11c88dd4fb6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:43.659831 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e82358-365d-4f3b-92f7-c11c88dd4fb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:43.661211 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e82358-365d-4f3b-92f7-c11c88dd4fb6 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:43.671409 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 211/412] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:54:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:43.677217 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dfa57a-254d-4b28-9e08-d7fc10f65fe8 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:43.711747 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62e1af-57aa-4382-8938-46ed647a6079 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:43.712024 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62e1af-57aa-4382-8938-46ed647a6079 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:43.712189 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62e1af-57aa-4382-8938-46ed647a6079 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:43.713997 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 212/413] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:43.720683 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22619161-be37-4526-afab-00c653e2b21a None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:43.720969 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22619161-be37-4526-afab-00c653e2b21a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:43.721230 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22619161-be37-4526-afab-00c653e2b21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:43.740315 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-22619161-be37-4526-afab-00c653e2b21a None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:43.741500 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-22619161-be37-4526-afab-00c653e2b21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:43.781920 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dfa57a-254d-4b28-9e08-d7fc10f65fe8 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:43.813905 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 213/414] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:54:43.822297 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abcd33-11ef-406d-8f41-e8089b966f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:43.823340 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abcd33-11ef-406d-8f41-e8089b966f3e None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:43.823616 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abcd33-11ef-406d-8f41-e8089b966f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:43.823882 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abcd33-11ef-406d-8f41-e8089b966f3e None admin] PATH_INFO: `/v3/groups/a668911e958543b89d230a6affd5f72d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:43.825081 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57abcd33-11ef-406d-8f41-e8089b966f3e None admin] RBAC: Authorizing `identity:get_group(group_id=a668911e958543b89d230a6affd5f72d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:43.826580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57abcd33-11ef-406d-8f41-e8089b966f3e None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:43.828505 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 202/415] 10.222.0.24 () {56 vars in 1180 bytes} [Mon May 16 18:54:43 2022] GET /identity/v3/groups/a668911e958543b89d230a6affd5f72d => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:43.834083 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22619161-be37-4526-afab-00c653e2b21a None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:43.845782 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abcd33-11ef-406d-8f41-e8089b966f3e None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:43.931967 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22619161-be37-4526-afab-00c653e2b21a None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:43.950032 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abcd33-11ef-406d-8f41-e8089b966f3e None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:43.970043 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6312006-39d4-4bd7-89d3-ef83ccaad9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:43.970854 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6312006-39d4-4bd7-89d3-ef83ccaad9a4 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:43.971127 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6312006-39d4-4bd7-89d3-ef83ccaad9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:43.971395 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6312006-39d4-4bd7-89d3-ef83ccaad9a4 None admin] PATH_INFO: `/v3/projects/1f43cb24f4194077b63c058f20af8f90` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:43.972863 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6312006-39d4-4bd7-89d3-ef83ccaad9a4 None admin] RBAC: Authorizing `identity:get_project(project_id=1f43cb24f4194077b63c058f20af8f90)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:43.974980 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6312006-39d4-4bd7-89d3-ef83ccaad9a4 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:43.981356 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 214/416] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:54:43 2022] GET /identity/v3/projects/1f43cb24f4194077b63c058f20af8f90 => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:43.990938 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6312006-39d4-4bd7-89d3-ef83ccaad9a4 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:44.000908 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85406f1b-74ff-4a90-b2e5-4dbf521aaa7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:44.001801 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85406f1b-74ff-4a90-b2e5-4dbf521aaa7a None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:44.002078 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85406f1b-74ff-4a90-b2e5-4dbf521aaa7a None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:44.002349 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85406f1b-74ff-4a90-b2e5-4dbf521aaa7a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:44.018845 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85406f1b-74ff-4a90-b2e5-4dbf521aaa7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:44.034939 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-85406f1b-74ff-4a90-b2e5-4dbf521aaa7a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 18:54:44.034939 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:44.034939 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:44.034939 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:44.034939 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:44.034939 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:44.034939 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:44.034939 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:44.034939 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:44.034939 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:44.034939 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:44.034939 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:44.034939 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:44.034939 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:44.034939 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:44.034939 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:44.037007 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:44.037007 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:44.037007 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:44.037007 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:44.037007 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:44.037007 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:44.037007 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:44.037007 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:44.037007 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:44.037007 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:44.037007 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:44.037007 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:44.037007 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:44.037007 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:44.037007 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:44.037007 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:44.039284 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:44.039284 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:44.039284 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:44.039284 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:44.039284 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:44.039284 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:44.039284 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:44.039284 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:44.039284 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:44.039284 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:44.039284 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 18:54:44.039284 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:44.039284 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 203/417] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:54:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:44.051644 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85406f1b-74ff-4a90-b2e5-4dbf521aaa7a None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:44.136881 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6312006-39d4-4bd7-89d3-ef83ccaad9a4 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:44.185834 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c018774-b731-483a-893d-884002445741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:44.187003 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c018774-b731-483a-893d-884002445741 None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:44.187840 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c018774-b731-483a-893d-884002445741 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:44.188245 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c018774-b731-483a-893d-884002445741 None admin] PATH_INFO: `/v3/projects/1f43cb24f4194077b63c058f20af8f90/groups/a668911e958543b89d230a6affd5f72d/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:44.190889 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c018774-b731-483a-893d-884002445741 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f43cb24f4194077b63c058f20af8f90, group_id=a668911e958543b89d230a6affd5f72d, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:44.192769 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c018774-b731-483a-893d-884002445741 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:44.221792 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 215/418] 10.222.0.24 () {58 vars in 1442 bytes} [Mon May 16 18:54:43 2022] PUT /identity/v3/projects/1f43cb24f4194077b63c058f20af8f90/groups/a668911e958543b89d230a6affd5f72d/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:54:44.255248 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85406f1b-74ff-4a90-b2e5-4dbf521aaa7a None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:44.298832 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55699ee1-eb5b-45fe-97d1-1c5b3182f11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:44.299806 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55699ee1-eb5b-45fe-97d1-1c5b3182f11d None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:44.300254 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55699ee1-eb5b-45fe-97d1-1c5b3182f11d None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:44.300663 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55699ee1-eb5b-45fe-97d1-1c5b3182f11d None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:44.301575 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55699ee1-eb5b-45fe-97d1-1c5b3182f11d None admin] RBAC: Adding query filter params (name=member) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:44.302017 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55699ee1-eb5b-45fe-97d1-1c5b3182f11d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:44.303534 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55699ee1-eb5b-45fe-97d1-1c5b3182f11d None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:44.315684 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 204/419] 10.222.0.24 () {56 vars in 1101 bytes} [Mon May 16 18:54:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:44.321090 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c018774-b731-483a-893d-884002445741 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:44.431151 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c018774-b731-483a-893d-884002445741 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:44.472632 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f993b4-b14c-493e-9832-151868fae8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:44.473666 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f993b4-b14c-493e-9832-151868fae8e3 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:44.474104 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f993b4-b14c-493e-9832-151868fae8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:44.474527 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f993b4-b14c-493e-9832-151868fae8e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:44.561128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f993b4-b14c-493e-9832-151868fae8e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:44.562858 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f993b4-b14c-493e-9832-151868fae8e3 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:44.673524 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 216/420] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:54:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 18:54:44.678815 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55699ee1-eb5b-45fe-97d1-1c5b3182f11d None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:44.684330 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6bb05-44dd-4cd2-a51d-1b10e5f601de None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:44.684330 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6bb05-44dd-4cd2-a51d-1b10e5f601de None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:44.684330 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6bb05-44dd-4cd2-a51d-1b10e5f601de None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:44.685683 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 217/421] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:54:44.691408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9c524-b963-478d-bf94-337902033456 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:44.691408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9c524-b963-478d-bf94-337902033456 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:44.691693 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9c524-b963-478d-bf94-337902033456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:44.715416 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-b4a9c524-b963-478d-bf94-337902033456 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:44.716612 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b4a9c524-b963-478d-bf94-337902033456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:44.784671 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 218/422] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:54:44.792802 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55699ee1-eb5b-45fe-97d1-1c5b3182f11d None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:44.810240 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9c524-b963-478d-bf94-337902033456 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:44.829713 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9cc7e-7444-4f01-9379-a6aeb1f174c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:44.830967 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9cc7e-7444-4f01-9379-a6aeb1f174c8 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:44.831415 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9cc7e-7444-4f01-9379-a6aeb1f174c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:44.831888 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9cc7e-7444-4f01-9379-a6aeb1f174c8 None admin] PATH_INFO: `/v3/projects/61523379bf5c40d6a32f35726b048037` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:44.833259 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a9cc7e-7444-4f01-9379-a6aeb1f174c8 None admin] RBAC: Authorizing `identity:get_project(project_id=61523379bf5c40d6a32f35726b048037)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:44.835005 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a9cc7e-7444-4f01-9379-a6aeb1f174c8 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:44.837318 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 205/423] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:54:44 2022] GET /identity/v3/projects/61523379bf5c40d6a32f35726b048037 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:54:44.842386 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9cc7e-7444-4f01-9379-a6aeb1f174c8 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:44.952381 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9cc7e-7444-4f01-9379-a6aeb1f174c8 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:44.988651 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9956ca4-1544-4557-9b12-d2384a8fe77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:44.989861 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9956ca4-1544-4557-9b12-d2384a8fe77c None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:44.990667 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9956ca4-1544-4557-9b12-d2384a8fe77c None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:44.991112 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9956ca4-1544-4557-9b12-d2384a8fe77c None admin] PATH_INFO: `/v3/groups/83317d6c21184cea8a2cf2477edb816c` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:44.992873 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9956ca4-1544-4557-9b12-d2384a8fe77c None admin] RBAC: Authorizing `identity:get_group(group_id=83317d6c21184cea8a2cf2477edb816c)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:44.994700 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9956ca4-1544-4557-9b12-d2384a8fe77c None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:44.996861 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 206/424] 10.222.0.24 () {56 vars in 1180 bytes} [Mon May 16 18:54:44 2022] GET /identity/v3/groups/83317d6c21184cea8a2cf2477edb816c => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:54:45.001442 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9c524-b963-478d-bf94-337902033456 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:45.002372 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9956ca4-1544-4557-9b12-d2384a8fe77c None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:45.074753 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20021f13-c3a6-439f-a4f0-bea75a60f583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:45.075105 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20021f13-c3a6-439f-a4f0-bea75a60f583 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:45.075391 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20021f13-c3a6-439f-a4f0-bea75a60f583 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:45.075670 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20021f13-c3a6-439f-a4f0-bea75a60f583 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:45.102449 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20021f13-c3a6-439f-a4f0-bea75a60f583 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:45.109386 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9956ca4-1544-4557-9b12-d2384a8fe77c None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:45.110979 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-20021f13-c3a6-439f-a4f0-bea75a60f583 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:54:45.110979 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:45.110979 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:45.110979 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:45.110979 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:45.110979 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:45.110979 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:45.110979 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:45.110979 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:45.110979 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:45.110979 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:45.110979 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:45.110979 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:45.110979 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:45.110979 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:45.110979 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:45.111846 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:45.111846 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:45.111846 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:45.111846 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:45.111846 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:45.111846 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:45.111846 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:45.111846 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:45.111846 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:45.111846 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:45.111846 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:45.111846 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:54:45.111846 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:45.111846 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:45.111846 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:45.111846 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:45.112763 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:45.112763 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:45.112763 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:45.112763 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:45.112763 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:45.112763 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:45.112763 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:45.112763 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:45.112763 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:45.112763 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:45.112763 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:54:45.112763 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:54:45.112763 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 219/425] 10.222.0.24 () {56 vars in 1114 bytes} [Mon May 16 18:54:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:54:45.118796 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20021f13-c3a6-439f-a4f0-bea75a60f583 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:45.148348 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fecbf8a-0078-4c64-bb98-081be4daf25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:45.149258 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecbf8a-0078-4c64-bb98-081be4daf25b None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:45.149704 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecbf8a-0078-4c64-bb98-081be4daf25b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:45.150111 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecbf8a-0078-4c64-bb98-081be4daf25b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:45.151518 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fecbf8a-0078-4c64-bb98-081be4daf25b None admin] RBAC: Adding query filter params (group.id=83317d6c21184cea8a2cf2477edb816c, role.id=b0e5c5e3b5f54789a5a5c4c51220c97e, scope.project.id=61523379bf5c40d6a32f35726b048037) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:45.151977 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fecbf8a-0078-4c64-bb98-081be4daf25b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:45.153734 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fecbf8a-0078-4c64-bb98-081be4daf25b None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:45.161027 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 207/426] 10.222.0.24 () {56 vars in 1376 bytes} [Mon May 16 18:54:45 2022] GET /identity/v3/role_assignments?group.id=83317d6c21184cea8a2cf2477edb816c&scope.project.id=61523379bf5c40d6a32f35726b048037&role.id=b0e5c5e3b5f54789a5a5c4c51220c97e => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:54:45.250383 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20021f13-c3a6-439f-a4f0-bea75a60f583 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:45.293221 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f75054-2d5c-4bbe-87b4-5ef86b73b4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:45.293945 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f75054-2d5c-4bbe-87b4-5ef86b73b4c1 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:45.294228 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f75054-2d5c-4bbe-87b4-5ef86b73b4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:45.294498 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f75054-2d5c-4bbe-87b4-5ef86b73b4c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:45.295264 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f75054-2d5c-4bbe-87b4-5ef86b73b4c1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:45.295569 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f75054-2d5c-4bbe-87b4-5ef86b73b4c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:45.296974 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f75054-2d5c-4bbe-87b4-5ef86b73b4c1 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:45.305926 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 220/427] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:54:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:54:45.311455 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fecbf8a-0078-4c64-bb98-081be4daf25b None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:45.469649 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fecbf8a-0078-4c64-bb98-081be4daf25b None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:45.511952 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99d6fb-8638-4b96-affb-5645bf902d2c None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:45.512340 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99d6fb-8638-4b96-affb-5645bf902d2c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:45.512937 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99d6fb-8638-4b96-affb-5645bf902d2c None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:45.513799 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de01cb-f997-47c7-aafb-3c820bc70a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:45.514466 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de01cb-f997-47c7-aafb-3c820bc70a04 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:45.514746 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de01cb-f997-47c7-aafb-3c820bc70a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:45.515021 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de01cb-f997-47c7-aafb-3c820bc70a04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:45.515305 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 221/428] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:45.521586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5746329-4a65-4887-a65f-bf944bd493ac None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:45.521586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5746329-4a65-4887-a65f-bf944bd493ac None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:45.521586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5746329-4a65-4887-a65f-bf944bd493ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:45.542268 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-b5746329-4a65-4887-a65f-bf944bd493ac None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:45.546629 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b5746329-4a65-4887-a65f-bf944bd493ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:45.599973 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de01cb-f997-47c7-aafb-3c820bc70a04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:45.601615 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de01cb-f997-47c7-aafb-3c820bc70a04 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:45.630169 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 222/429] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:54:45.654162 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5746329-4a65-4887-a65f-bf944bd493ac None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:45.718243 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 208/430] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:54:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:54:45.726701 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de01cb-f997-47c7-aafb-3c820bc70a04 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:45.771947 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5746329-4a65-4887-a65f-bf944bd493ac None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:45.808715 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733b9ba-47a6-4fd0-8725-6a0941607a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:45.809524 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733b9ba-47a6-4fd0-8725-6a0941607a14 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:45.809863 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733b9ba-47a6-4fd0-8725-6a0941607a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:45.810088 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733b9ba-47a6-4fd0-8725-6a0941607a14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:45.823949 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9733b9ba-47a6-4fd0-8725-6a0941607a14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:45.826357 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de01cb-f997-47c7-aafb-3c820bc70a04 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:45.831665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-9733b9ba-47a6-4fd0-8725-6a0941607a14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 18:54:45.831665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:45.831665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:45.831665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:45.831665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:45.831665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:45.831665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:45.831665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:45.831665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:45.831665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:45.831665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:45.831665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:45.831665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:45.831665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:45.831665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:45.831665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:45.832549 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:45.832549 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:45.832549 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:45.832549 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:45.832549 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:45.832549 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:45.832549 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:45.832549 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:45.832549 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:45.832549 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:45.832549 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:45.832549 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:54:45.832549 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:45.832549 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:45.832549 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:45.832549 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:45.833342 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:45.833342 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:45.833342 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:45.833342 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:45.833342 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:45.833342 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:45.833342 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:45.833342 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:45.833342 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:45.833342 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:45.833342 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 18:54:45.833342 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:54:45.833342 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 223/431] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:54:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:54:45.839018 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733b9ba-47a6-4fd0-8725-6a0941607a14 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:45.866844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb87565-5637-4fc1-bdbe-9997d5892bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:45.867746 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb87565-5637-4fc1-bdbe-9997d5892bca None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:45.868055 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb87565-5637-4fc1-bdbe-9997d5892bca None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:45.868324 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb87565-5637-4fc1-bdbe-9997d5892bca None admin] PATH_INFO: `/v3/projects/61523379bf5c40d6a32f35726b048037` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:45.869727 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb87565-5637-4fc1-bdbe-9997d5892bca None admin] RBAC: Authorizing `identity:get_project(project_id=61523379bf5c40d6a32f35726b048037)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:45.871240 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb87565-5637-4fc1-bdbe-9997d5892bca None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:45.873822 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 209/432] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:54:45 2022] GET /identity/v3/projects/61523379bf5c40d6a32f35726b048037 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:45.878584 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb87565-5637-4fc1-bdbe-9997d5892bca None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:45.946017 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733b9ba-47a6-4fd0-8725-6a0941607a14 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:45.992756 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68132272-5009-4bc8-9029-1b528085d93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:45.993593 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68132272-5009-4bc8-9029-1b528085d93e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:45.993854 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68132272-5009-4bc8-9029-1b528085d93e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:45.994635 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68132272-5009-4bc8-9029-1b528085d93e None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:45.995674 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68132272-5009-4bc8-9029-1b528085d93e None admin] RBAC: Adding query filter params (name=member) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:45.995980 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68132272-5009-4bc8-9029-1b528085d93e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:45.998186 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68132272-5009-4bc8-9029-1b528085d93e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:46.002418 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb87565-5637-4fc1-bdbe-9997d5892bca None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:46.012947 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 224/433] 10.222.0.24 () {56 vars in 1101 bytes} [Mon May 16 18:54:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:54:46.019370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68132272-5009-4bc8-9029-1b528085d93e None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:46.056065 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec9583d-bd8c-4bff-95f1-6bbc6c9e6037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:46.057001 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9583d-bd8c-4bff-95f1-6bbc6c9e6037 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:46.057286 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9583d-bd8c-4bff-95f1-6bbc6c9e6037 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:46.057565 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9583d-bd8c-4bff-95f1-6bbc6c9e6037 None admin] PATH_INFO: `/v3/groups/83317d6c21184cea8a2cf2477edb816c` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:46.058762 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec9583d-bd8c-4bff-95f1-6bbc6c9e6037 None admin] RBAC: Authorizing `identity:get_group(group_id=83317d6c21184cea8a2cf2477edb816c)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:46.060236 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec9583d-bd8c-4bff-95f1-6bbc6c9e6037 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:46.062197 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 210/434] 10.222.0.24 () {56 vars in 1180 bytes} [Mon May 16 18:54:45 2022] GET /identity/v3/groups/83317d6c21184cea8a2cf2477edb816c => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:46.068703 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec9583d-bd8c-4bff-95f1-6bbc6c9e6037 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:46.133851 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68132272-5009-4bc8-9029-1b528085d93e None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:46.171350 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2688777-4478-4bc9-9d55-20cc00743a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:46.172224 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2688777-4478-4bc9-9d55-20cc00743a19 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:46.172641 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2688777-4478-4bc9-9d55-20cc00743a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:46.173048 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2688777-4478-4bc9-9d55-20cc00743a19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:46.187392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec9583d-bd8c-4bff-95f1-6bbc6c9e6037 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:46.221929 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a69e8-d178-4f70-826d-045ae05c464a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:46.222605 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a69e8-d178-4f70-826d-045ae05c464a None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:46.223046 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a69e8-d178-4f70-826d-045ae05c464a None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:46.223329 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a69e8-d178-4f70-826d-045ae05c464a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:46.224162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a69e8-d178-4f70-826d-045ae05c464a None admin] RBAC: Adding query filter params (group.id=83317d6c21184cea8a2cf2477edb816c, role.id=fda97f4c5b1f4e1ba165f8dfa70ddbd6, scope.project.id=61523379bf5c40d6a32f35726b048037) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:46.224477 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a69e8-d178-4f70-826d-045ae05c464a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:46.225955 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a69e8-d178-4f70-826d-045ae05c464a None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:46.231623 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 211/435] 10.222.0.24 () {56 vars in 1376 bytes} [Mon May 16 18:54:46 2022] GET /identity/v3/role_assignments?group.id=83317d6c21184cea8a2cf2477edb816c&scope.project.id=61523379bf5c40d6a32f35726b048037&role.id=fda97f4c5b1f4e1ba165f8dfa70ddbd6 => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:46.249252 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad538423-9c2c-45a0-a998-487f88446503 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:46.249252 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad538423-9c2c-45a0-a998-487f88446503 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:46.249252 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad538423-9c2c-45a0-a998-487f88446503 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:46.249252 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 212/436] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:46.251727 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93abb52-3a00-488a-bed2-fbf4622f7e66 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:46.251727 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93abb52-3a00-488a-bed2-fbf4622f7e66 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:46.251727 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93abb52-3a00-488a-bed2-fbf4622f7e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:46.257251 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2688777-4478-4bc9-9d55-20cc00743a19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:46.258819 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2688777-4478-4bc9-9d55-20cc00743a19 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:46.269163 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-a93abb52-3a00-488a-bed2-fbf4622f7e66 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:46.270646 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a93abb52-3a00-488a-bed2-fbf4622f7e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:46.363568 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 213/437] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:54:46.375008 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 225/438] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:54:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:54:46.380678 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93abb52-3a00-488a-bed2-fbf4622f7e66 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:46.391104 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2688777-4478-4bc9-9d55-20cc00743a19 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:46.487302 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93abb52-3a00-488a-bed2-fbf4622f7e66 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:46.528629 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2688777-4478-4bc9-9d55-20cc00743a19 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:46.532156 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358941f-655f-47c1-abc7-8f7ff66321d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:46.533101 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358941f-655f-47c1-abc7-8f7ff66321d7 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:46.533334 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358941f-655f-47c1-abc7-8f7ff66321d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:46.533626 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358941f-655f-47c1-abc7-8f7ff66321d7 None admin] PATH_INFO: `/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:46.534820 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8358941f-655f-47c1-abc7-8f7ff66321d7 None admin] RBAC: Authorizing `identity:get_project(project_id=4e1cc38a8ece4d619be76f0ba70f8f1b)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:46.536470 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8358941f-655f-47c1-abc7-8f7ff66321d7 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:46.539098 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 214/439] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:54:46 2022] GET /identity/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:46.545679 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358941f-655f-47c1-abc7-8f7ff66321d7 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:46.569833 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d85ee-f428-4384-a238-47f3de694cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:46.571060 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d85ee-f428-4384-a238-47f3de694cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:46.571557 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d85ee-f428-4384-a238-47f3de694cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:46.571832 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d85ee-f428-4384-a238-47f3de694cb1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:46.585625 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d85ee-f428-4384-a238-47f3de694cb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:46.594118 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-0f3d85ee-f428-4384-a238-47f3de694cb1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:54:46.594118 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:46.594118 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:46.594118 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:46.594118 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:46.594118 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:46.594118 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:46.594118 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:46.594118 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:46.594118 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:46.594118 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:46.594118 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:46.594118 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:46.594118 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:46.594118 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:46.594118 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:46.594992 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:46.594992 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:46.594992 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:46.594992 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:46.594992 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:46.594992 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:46.594992 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:46.594992 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:46.594992 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:46.594992 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:46.594992 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:46.594992 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:54:46.594992 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:46.594992 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:46.594992 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:46.594992 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:46.595751 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:46.595751 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:46.595751 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:46.595751 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:46.595751 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:46.595751 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:46.595751 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:46.595751 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:46.595751 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:46.595751 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:46.595751 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:54:46.595751 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:54:46.597359 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 226/440] 10.222.0.24 () {56 vars in 1114 bytes} [Mon May 16 18:54:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:46.602367 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d85ee-f428-4384-a238-47f3de694cb1 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:46.667746 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358941f-655f-47c1-abc7-8f7ff66321d7 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:46.704019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c0ade-d2de-47f7-aed1-cae59f7a6d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:46.705163 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c0ade-d2de-47f7-aed1-cae59f7a6d70 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:46.705448 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c0ade-d2de-47f7-aed1-cae59f7a6d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:46.705735 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c0ade-d2de-47f7-aed1-cae59f7a6d70 None admin] PATH_INFO: `/v3/groups/83317d6c21184cea8a2cf2477edb816c` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:46.707555 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c0ade-d2de-47f7-aed1-cae59f7a6d70 None admin] RBAC: Authorizing `identity:get_group(group_id=83317d6c21184cea8a2cf2477edb816c)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:46.709004 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c0ade-d2de-47f7-aed1-cae59f7a6d70 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:46.711045 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 215/441] 10.222.0.24 () {56 vars in 1180 bytes} [Mon May 16 18:54:46 2022] GET /identity/v3/groups/83317d6c21184cea8a2cf2477edb816c => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:54:46.716563 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c0ade-d2de-47f7-aed1-cae59f7a6d70 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:46.717470 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d85ee-f428-4384-a238-47f3de694cb1 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:46.752340 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8834f1-d5ea-4424-bf1c-46a8df6d4cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:46.753389 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8834f1-d5ea-4424-bf1c-46a8df6d4cbb None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:46.753957 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8834f1-d5ea-4424-bf1c-46a8df6d4cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:46.754357 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8834f1-d5ea-4424-bf1c-46a8df6d4cbb None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:46.755104 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8834f1-d5ea-4424-bf1c-46a8df6d4cbb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:46.755407 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8834f1-d5ea-4424-bf1c-46a8df6d4cbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:46.757076 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8834f1-d5ea-4424-bf1c-46a8df6d4cbb None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:46.764715 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 227/442] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:54:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:46.770103 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8834f1-d5ea-4424-bf1c-46a8df6d4cbb None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:46.808421 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c0ade-d2de-47f7-aed1-cae59f7a6d70 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:46.842539 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eadc6c9-0884-46de-ad41-3f5e7c10e3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:46.843217 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadc6c9-0884-46de-ad41-3f5e7c10e3a1 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:46.843498 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadc6c9-0884-46de-ad41-3f5e7c10e3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:46.843766 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadc6c9-0884-46de-ad41-3f5e7c10e3a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:46.844617 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eadc6c9-0884-46de-ad41-3f5e7c10e3a1 None admin] RBAC: Adding query filter params (group.id=83317d6c21184cea8a2cf2477edb816c, role.id=b0e5c5e3b5f54789a5a5c4c51220c97e, scope.project.id=4e1cc38a8ece4d619be76f0ba70f8f1b) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:46.844923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eadc6c9-0884-46de-ad41-3f5e7c10e3a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:46.846598 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eadc6c9-0884-46de-ad41-3f5e7c10e3a1 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:46.852977 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 216/443] 10.222.0.24 () {56 vars in 1376 bytes} [Mon May 16 18:54:46 2022] GET /identity/v3/role_assignments?group.id=83317d6c21184cea8a2cf2477edb816c&scope.project.id=4e1cc38a8ece4d619be76f0ba70f8f1b&role.id=b0e5c5e3b5f54789a5a5c4c51220c97e => generated 611 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:54:46.879040 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8834f1-d5ea-4424-bf1c-46a8df6d4cbb None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:46.914147 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229a18c-83eb-4be6-83a8-47aef1a37f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:46.914819 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229a18c-83eb-4be6-83a8-47aef1a37f15 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:46.915101 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229a18c-83eb-4be6-83a8-47aef1a37f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:46.915328 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229a18c-83eb-4be6-83a8-47aef1a37f15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:46.988081 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229a18c-83eb-4be6-83a8-47aef1a37f15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:46.989583 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229a18c-83eb-4be6-83a8-47aef1a37f15 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:47.016660 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62b82b-867f-4e0e-b026-42f4cd412eb1 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:47.016999 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62b82b-867f-4e0e-b026-42f4cd412eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:47.017184 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62b82b-867f-4e0e-b026-42f4cd412eb1 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:47.018832 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 217/444] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:54:47.024549 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d9e3d-f755-4d7b-9ddc-bb022afb8793 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:47.024860 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d9e3d-f755-4d7b-9ddc-bb022afb8793 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:47.025100 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d9e3d-f755-4d7b-9ddc-bb022afb8793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:47.042606 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-2a3d9e3d-f755-4d7b-9ddc-bb022afb8793 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:47.043790 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-2a3d9e3d-f755-4d7b-9ddc-bb022afb8793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:47.092187 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 228/445] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:54:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 18:54:47.097939 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229a18c-83eb-4be6-83a8-47aef1a37f15 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:47.133715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 218/446] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:54:47.159022 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d9e3d-f755-4d7b-9ddc-bb022afb8793 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:47.208212 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229a18c-83eb-4be6-83a8-47aef1a37f15 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:47.248920 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277a2f0-9612-4b35-84c0-a7f12d6207a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:47.249821 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277a2f0-9612-4b35-84c0-a7f12d6207a0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:47.250094 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277a2f0-9612-4b35-84c0-a7f12d6207a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:47.250363 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277a2f0-9612-4b35-84c0-a7f12d6207a0 None admin] PATH_INFO: `/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:47.251523 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4277a2f0-9612-4b35-84c0-a7f12d6207a0 None admin] RBAC: Authorizing `identity:get_project(project_id=4e1cc38a8ece4d619be76f0ba70f8f1b)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:47.252983 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4277a2f0-9612-4b35-84c0-a7f12d6207a0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:47.254701 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 229/447] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:54:47 2022] GET /identity/v3/projects/4e1cc38a8ece4d619be76f0ba70f8f1b => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:47.260078 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277a2f0-9612-4b35-84c0-a7f12d6207a0 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:47.263016 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d9e3d-f755-4d7b-9ddc-bb022afb8793 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:47.294762 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556cbd95-eead-4f43-a23d-29c5196ee506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:47.295567 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556cbd95-eead-4f43-a23d-29c5196ee506 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:47.295848 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556cbd95-eead-4f43-a23d-29c5196ee506 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:47.296120 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556cbd95-eead-4f43-a23d-29c5196ee506 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:47.305902 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556cbd95-eead-4f43-a23d-29c5196ee506 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:47.313718 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-556cbd95-eead-4f43-a23d-29c5196ee506 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:54:47.313718 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:47.313718 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:47.313718 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:47.313718 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:47.313718 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:47.313718 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:47.313718 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:47.313718 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:47.313718 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:47.313718 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:47.313718 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:47.313718 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:47.313718 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:47.313718 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:47.313718 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:47.314603 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:47.314603 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:47.314603 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:47.314603 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:47.314603 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:47.314603 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:47.314603 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:47.314603 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:47.314603 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:47.314603 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:47.314603 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:47.314603 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:47.314603 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:47.314603 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:47.314603 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:47.314603 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:47.315395 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:47.315395 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:47.315395 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:47.315395 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:47.315395 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:47.315395 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:47.315395 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:47.315395 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:47.315395 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:47.315395 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:47.315395 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:54:47.315395 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:47.315395 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 219/448] 10.222.0.24 () {56 vars in 1096 bytes} [Mon May 16 18:54:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:47.320622 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556cbd95-eead-4f43-a23d-29c5196ee506 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:47.352352 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277a2f0-9612-4b35-84c0-a7f12d6207a0 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:47.385052 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a1532-ad85-4bdf-978b-a97dfd3f0a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:47.385936 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a1532-ad85-4bdf-978b-a97dfd3f0a5f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:47.386239 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a1532-ad85-4bdf-978b-a97dfd3f0a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:47.386495 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a1532-ad85-4bdf-978b-a97dfd3f0a5f None admin] PATH_INFO: `/v3/groups/83317d6c21184cea8a2cf2477edb816c` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:47.387708 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612a1532-ad85-4bdf-978b-a97dfd3f0a5f None admin] RBAC: Authorizing `identity:get_group(group_id=83317d6c21184cea8a2cf2477edb816c)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:47.389155 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612a1532-ad85-4bdf-978b-a97dfd3f0a5f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:47.390841 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 230/449] 10.222.0.24 () {56 vars in 1180 bytes} [Mon May 16 18:54:47 2022] GET /identity/v3/groups/83317d6c21184cea8a2cf2477edb816c => generated 226 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:54:47.396628 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a1532-ad85-4bdf-978b-a97dfd3f0a5f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:47.421850 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556cbd95-eead-4f43-a23d-29c5196ee506 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:47.452769 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d42bc6-a6d2-43a1-bf0b-c0134fcd7743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:47.453427 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d42bc6-a6d2-43a1-bf0b-c0134fcd7743 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:47.453757 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d42bc6-a6d2-43a1-bf0b-c0134fcd7743 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:47.454036 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d42bc6-a6d2-43a1-bf0b-c0134fcd7743 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:47.454770 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d42bc6-a6d2-43a1-bf0b-c0134fcd7743 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:47.455069 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d42bc6-a6d2-43a1-bf0b-c0134fcd7743 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:47.456460 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d42bc6-a6d2-43a1-bf0b-c0134fcd7743 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:47.464207 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 220/450] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:54:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:47.469656 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d42bc6-a6d2-43a1-bf0b-c0134fcd7743 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:47.496675 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a1532-ad85-4bdf-978b-a97dfd3f0a5f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:47.529322 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fcc05e-f31d-4a31-aa86-7a0e4ee65dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:47.530022 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fcc05e-f31d-4a31-aa86-7a0e4ee65dcf None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:47.530301 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fcc05e-f31d-4a31-aa86-7a0e4ee65dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:47.530569 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fcc05e-f31d-4a31-aa86-7a0e4ee65dcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:47.531401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fcc05e-f31d-4a31-aa86-7a0e4ee65dcf None admin] RBAC: Adding query filter params (group.id=83317d6c21184cea8a2cf2477edb816c, role.id=fda97f4c5b1f4e1ba165f8dfa70ddbd6, scope.project.id=4e1cc38a8ece4d619be76f0ba70f8f1b) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:47.531709 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fcc05e-f31d-4a31-aa86-7a0e4ee65dcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:47.533154 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fcc05e-f31d-4a31-aa86-7a0e4ee65dcf None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:47.539203 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 231/451] 10.222.0.24 () {56 vars in 1376 bytes} [Mon May 16 18:54:47 2022] GET /identity/v3/role_assignments?group.id=83317d6c21184cea8a2cf2477edb816c&scope.project.id=4e1cc38a8ece4d619be76f0ba70f8f1b&role.id=fda97f4c5b1f4e1ba165f8dfa70ddbd6 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:54:47.562480 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d42bc6-a6d2-43a1-bf0b-c0134fcd7743 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:47.597765 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2fa13-489e-4461-8ca8-a1d79c60f8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:47.598414 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2fa13-489e-4461-8ca8-a1d79c60f8d8 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:47.598690 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2fa13-489e-4461-8ca8-a1d79c60f8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:47.598957 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2fa13-489e-4461-8ca8-a1d79c60f8d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:47.670499 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d2fa13-489e-4461-8ca8-a1d79c60f8d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:47.671975 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d2fa13-489e-4461-8ca8-a1d79c60f8d8 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:47.776657 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 221/452] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:54:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 18:54:47.782230 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fcc05e-f31d-4a31-aa86-7a0e4ee65dcf None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:47.882568 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fcc05e-f31d-4a31-aa86-7a0e4ee65dcf None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:47.915393 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf889b9-9c68-4ea1-ac4d-783a15159524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:47.916361 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf889b9-9c68-4ea1-ac4d-783a15159524 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:47.916638 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf889b9-9c68-4ea1-ac4d-783a15159524 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:47.916929 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf889b9-9c68-4ea1-ac4d-783a15159524 None admin] PATH_INFO: `/v3/projects/1f43cb24f4194077b63c058f20af8f90` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:47.918157 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf889b9-9c68-4ea1-ac4d-783a15159524 None admin] RBAC: Authorizing `identity:get_project(project_id=1f43cb24f4194077b63c058f20af8f90)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:47.919597 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf889b9-9c68-4ea1-ac4d-783a15159524 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:47.921370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 232/453] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:54:47 2022] GET /identity/v3/projects/1f43cb24f4194077b63c058f20af8f90 => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:47.926933 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2fa13-489e-4461-8ca8-a1d79c60f8d8 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:48.024269 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2fa13-489e-4461-8ca8-a1d79c60f8d8 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:48.063095 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6ae7f-cb92-480d-bd0a-787047a656a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:48.063953 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6ae7f-cb92-480d-bd0a-787047a656a3 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:48.064233 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6ae7f-cb92-480d-bd0a-787047a656a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:48.064503 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6ae7f-cb92-480d-bd0a-787047a656a3 None admin] PATH_INFO: `/v3/groups/a668911e958543b89d230a6affd5f72d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:48.065757 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6ae7f-cb92-480d-bd0a-787047a656a3 None admin] RBAC: Authorizing `identity:get_group(group_id=a668911e958543b89d230a6affd5f72d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:48.067568 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6ae7f-cb92-480d-bd0a-787047a656a3 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:48.069266 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 222/454] 10.222.0.24 () {56 vars in 1180 bytes} [Mon May 16 18:54:47 2022] GET /identity/v3/groups/a668911e958543b89d230a6affd5f72d => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:48.075319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf889b9-9c68-4ea1-ac4d-783a15159524 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:48.187962 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf889b9-9c68-4ea1-ac4d-783a15159524 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:48.221764 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df07d4-3da0-40be-8daf-1188b3d6dee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:48.222411 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df07d4-3da0-40be-8daf-1188b3d6dee9 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:48.222693 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df07d4-3da0-40be-8daf-1188b3d6dee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:48.222961 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df07d4-3da0-40be-8daf-1188b3d6dee9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:48.223801 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df07d4-3da0-40be-8daf-1188b3d6dee9 None admin] RBAC: Adding query filter params (group.id=a668911e958543b89d230a6affd5f72d, role.id=5a6e54e81bb24eceb618d9ffa67f488e, scope.project.id=1f43cb24f4194077b63c058f20af8f90) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:48.224113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df07d4-3da0-40be-8daf-1188b3d6dee9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:48.225782 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df07d4-3da0-40be-8daf-1188b3d6dee9 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:48.231623 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 233/455] 10.222.0.24 () {56 vars in 1376 bytes} [Mon May 16 18:54:48 2022] GET /identity/v3/role_assignments?group.id=a668911e958543b89d230a6affd5f72d&scope.project.id=1f43cb24f4194077b63c058f20af8f90&role.id=5a6e54e81bb24eceb618d9ffa67f488e => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:50.901687 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3b20d-3ad4-466b-8361-6c30c9ba6af5 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:50.902254 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3b20d-3ad4-466b-8361-6c30c9ba6af5 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:50.902254 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3b20d-3ad4-466b-8361-6c30c9ba6af5 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:50.903876 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 223/456] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:50.909636 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bfa3a9-d5d3-4d86-98ba-5fc8dff042bb None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:50.910053 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bfa3a9-d5d3-4d86-98ba-5fc8dff042bb None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:50.910292 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bfa3a9-d5d3-4d86-98ba-5fc8dff042bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:50.930905 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-35bfa3a9-d5d3-4d86-98ba-5fc8dff042bb None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:50.932340 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-35bfa3a9-d5d3-4d86-98ba-5fc8dff042bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:51.012206 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 234/457] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:54:51.037436 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f30286-b118-4abc-b898-6b6e7835483f None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:51.038460 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f30286-b118-4abc-b898-6b6e7835483f None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:51.038956 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f30286-b118-4abc-b898-6b6e7835483f None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:51.040763 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 224/458] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:51.046411 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce99bd3-e2f4-42e6-868e-e2612385034e None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:51.046947 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce99bd3-e2f4-42e6-868e-e2612385034e None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:51.047412 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce99bd3-e2f4-42e6-868e-e2612385034e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:51.051892 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f30286-b118-4abc-b898-6b6e7835483f None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:51.086542 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-cce99bd3-e2f4-42e6-868e-e2612385034e None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:51.088129 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-cce99bd3-e2f4-42e6-868e-e2612385034e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:51.151021 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f30286-b118-4abc-b898-6b6e7835483f None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:51.184454 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0c408-9a63-4ad2-bb71-ff4d36092f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:51.185266 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0c408-9a63-4ad2-bb71-ff4d36092f5e None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:51.185561 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0c408-9a63-4ad2-bb71-ff4d36092f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:51.185831 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0c408-9a63-4ad2-bb71-ff4d36092f5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:51.196106 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0c408-9a63-4ad2-bb71-ff4d36092f5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:51.197698 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0c408-9a63-4ad2-bb71-ff4d36092f5e None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:51.215023 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-c8e0c408-9a63-4ad2-bb71-ff4d36092f5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:54:51.215023 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:51.215023 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:51.215023 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:51.215023 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:51.215023 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:51.215023 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:51.215023 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:51.215023 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:51.215023 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:51.215023 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:51.215023 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:51.215023 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:54:51.215023 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:54:51.215023 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:54:51.215896 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:54:51.215896 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:51.215896 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:51.215896 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:51.215896 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:51.215896 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:51.215896 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:51.215896 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:51.215896 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:51.215896 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:51.215896 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:51.215896 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:51.215896 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:51.215896 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:51.215896 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:51.215896 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:51.215896 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:51.216722 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:54:51.216722 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:54:51.216722 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:54:51.216722 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:51.216722 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 225/459] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:54:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:54:51.223071 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0c408-9a63-4ad2-bb71-ff4d36092f5e None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:51.253360 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 235/460] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:54:51.286943 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce99bd3-e2f4-42e6-868e-e2612385034e None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:51.358778 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0c408-9a63-4ad2-bb71-ff4d36092f5e None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:51.394699 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44303160-ab90-4f3b-bf33-cc33d66774e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:51.395373 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44303160-ab90-4f3b-bf33-cc33d66774e5 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:51.395648 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44303160-ab90-4f3b-bf33-cc33d66774e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:51.395912 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44303160-ab90-4f3b-bf33-cc33d66774e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:51.396628 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44303160-ab90-4f3b-bf33-cc33d66774e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:51.396925 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44303160-ab90-4f3b-bf33-cc33d66774e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:51.398331 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44303160-ab90-4f3b-bf33-cc33d66774e5 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:51.415590 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 226/461] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:54:51.417342 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44303160-ab90-4f3b-bf33-cc33d66774e5 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:51.454053 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce99bd3-e2f4-42e6-868e-e2612385034e None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:51.498797 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e7cfab-94c7-4049-ad74-7c5b81b2994e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:51.499892 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7cfab-94c7-4049-ad74-7c5b81b2994e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:51.500303 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7cfab-94c7-4049-ad74-7c5b81b2994e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:51.500714 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7cfab-94c7-4049-ad74-7c5b81b2994e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:51.514722 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44303160-ab90-4f3b-bf33-cc33d66774e5 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:51.522682 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e7cfab-94c7-4049-ad74-7c5b81b2994e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:51.524379 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e7cfab-94c7-4049-ad74-7c5b81b2994e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:51.549062 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3fa0f3-aa97-47b9-b32d-d16a9371cae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:51.549991 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fa0f3-aa97-47b9-b32d-d16a9371cae5 None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:51.550405 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fa0f3-aa97-47b9-b32d-d16a9371cae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:51.551209 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fa0f3-aa97-47b9-b32d-d16a9371cae5 None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:51.551919 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3fa0f3-aa97-47b9-b32d-d16a9371cae5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:51.553494 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3fa0f3-aa97-47b9-b32d-d16a9371cae5 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:51.555128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-f6e7cfab-94c7-4049-ad74-7c5b81b2994e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:54:51.555128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:51.555128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:51.555128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:51.555128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:51.555128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:51.555128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:51.555128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:51.555128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:51.555128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:51.555128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:51.555128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:51.555128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:54:51.555128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:54:51.555128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:54:51.556102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:54:51.556102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:51.556102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:51.556102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:51.556102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:51.556102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:51.556102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:51.556102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:51.556102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:54:51.556102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:51.556102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:51.556102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:51.556102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:51.556102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:51.556102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:51.556102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:51.556102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:51.556950 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:54:51.556950 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:54:51.556950 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:54:51.556950 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:54:51.559049 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 236/462] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:54:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:54:51.560951 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521d9d9-1292-4c5d-9a6f-40e5382b3395 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:51.561913 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521d9d9-1292-4c5d-9a6f-40e5382b3395 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:51.562191 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521d9d9-1292-4c5d-9a6f-40e5382b3395 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:51.563845 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 237/463] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:51.565292 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964be14-3291-4678-bc00-f06c45f9bb39 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:51.565814 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964be14-3291-4678-bc00-f06c45f9bb39 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:51.566359 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964be14-3291-4678-bc00-f06c45f9bb39 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:51.568013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 238/464] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:51.568917 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964be14-3291-4678-bc00-f06c45f9bb39 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:51.581217 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 227/465] 10.222.0.24 () {60 vars in 1132 bytes} [Mon May 16 18:54:51 2022] POST /identity/v3/users => generated 246 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:54:51.582855 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7d665-0548-4e79-9510-8f76589915e7 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:51.583143 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7d665-0548-4e79-9510-8f76589915e7 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:51.583419 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7d665-0548-4e79-9510-8f76589915e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:51.603490 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-09e7d665-0548-4e79-9510-8f76589915e7 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:51.604776 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-09e7d665-0548-4e79-9510-8f76589915e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:51.691879 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 228/466] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:54:51.699093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27541c-366c-4c08-8b41-c56423e6cff0 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:51.701164 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27541c-366c-4c08-8b41-c56423e6cff0 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:51.702906 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27541c-366c-4c08-8b41-c56423e6cff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:51.729075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964be14-3291-4678-bc00-f06c45f9bb39 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:51.730745 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-8f27541c-366c-4c08-8b41-c56423e6cff0 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:51.733186 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-8f27541c-366c-4c08-8b41-c56423e6cff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:51.775407 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c6921-5568-43a9-8a0d-9f56353fa55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:51.776396 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c6921-5568-43a9-8a0d-9f56353fa55f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:51.776678 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c6921-5568-43a9-8a0d-9f56353fa55f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:51.776952 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c6921-5568-43a9-8a0d-9f56353fa55f None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:51.777728 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c6921-5568-43a9-8a0d-9f56353fa55f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:51.778169 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c6921-5568-43a9-8a0d-9f56353fa55f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:51.780532 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c6921-5568-43a9-8a0d-9f56353fa55f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:51.794039 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 239/467] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:51.795073 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c6921-5568-43a9-8a0d-9f56353fa55f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:51.821158 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 229/468] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:54:51.823921 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27541c-366c-4c08-8b41-c56423e6cff0 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:51.906540 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c6921-5568-43a9-8a0d-9f56353fa55f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:51.935629 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27541c-366c-4c08-8b41-c56423e6cff0 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:51.941658 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0a35a-8f0a-4405-9734-ed1e07a49593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:51.943041 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0a35a-8f0a-4405-9734-ed1e07a49593 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:51.943474 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0a35a-8f0a-4405-9734-ed1e07a49593 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:51.943884 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0a35a-8f0a-4405-9734-ed1e07a49593 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:51.955992 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0a35a-8f0a-4405-9734-ed1e07a49593 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:51.957715 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0a35a-8f0a-4405-9734-ed1e07a49593 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:51.970857 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a624d-177b-4d20-9a86-071e5cc42b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:51.971867 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a624d-177b-4d20-9a86-071e5cc42b13 None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:51.972402 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a624d-177b-4d20-9a86-071e5cc42b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:51.972867 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a624d-177b-4d20-9a86-071e5cc42b13 None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:51.973806 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a624d-177b-4d20-9a86-071e5cc42b13 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:51.975270 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-73f0a35a-8f0a-4405-9734-ed1e07a49593 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:54:51.975270 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:51.975270 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:51.975270 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:51.975270 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:51.975270 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:51.975270 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:51.975270 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:51.975270 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:51.975270 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:51.975270 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:51.975270 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:51.975270 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:54:51.975270 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:54:51.975270 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:54:51.976128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:54:51.976128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:51.976128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:51.976128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:51.976128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:51.976128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:51.976128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:51.976128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:51.976128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:54:51.976128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:51.976128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:51.976128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:51.976128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:51.976128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:51.976128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:51.976128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:51.976128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:51.977000 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:54:51.977000 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:54:51.977000 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:54:51.977000 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:54:51.977205 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a624d-177b-4d20-9a86-071e5cc42b13 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:51.979334 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 240/469] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:54:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:51.980358 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0a35a-8f0a-4405-9734-ed1e07a49593 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:52.001474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 230/470] 10.222.0.24 () {60 vars in 1132 bytes} [Mon May 16 18:54:51 2022] POST /identity/v3/users => generated 248 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:54:52.002663 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a624d-177b-4d20-9a86-071e5cc42b13 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:52.115270 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a624d-177b-4d20-9a86-071e5cc42b13 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:52.150771 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ca0d3-efd8-444d-a75c-535c351e42a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:52.151906 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ca0d3-efd8-444d-a75c-535c351e42a1 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:52.152424 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ca0d3-efd8-444d-a75c-535c351e42a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:52.152883 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ca0d3-efd8-444d-a75c-535c351e42a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:52.153838 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ca0d3-efd8-444d-a75c-535c351e42a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:52.154348 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ca0d3-efd8-444d-a75c-535c351e42a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:52.155940 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ca0d3-efd8-444d-a75c-535c351e42a1 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:52.157084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0a35a-8f0a-4405-9734-ed1e07a49593 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:52.170557 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 231/471] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:54:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:52.178621 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ca0d3-efd8-444d-a75c-535c351e42a1 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:52.214511 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16748e-859a-4b55-b2a7-6709d9be5fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:52.215317 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16748e-859a-4b55-b2a7-6709d9be5fbd None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:52.215317 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16748e-859a-4b55-b2a7-6709d9be5fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:52.215475 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16748e-859a-4b55-b2a7-6709d9be5fbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:52.235629 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d16748e-859a-4b55-b2a7-6709d9be5fbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:52.237239 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d16748e-859a-4b55-b2a7-6709d9be5fbd None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:52.263693 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-7d16748e-859a-4b55-b2a7-6709d9be5fbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:54:52.263693 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:52.263693 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:52.263693 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:52.263693 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:52.263693 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:52.263693 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:52.263693 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:52.263693 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:52.263693 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:52.263693 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:52.263693 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:52.263693 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:54:52.263693 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:54:52.263693 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:54:52.264611 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:54:52.264611 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:52.264611 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:52.264611 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:52.264611 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:52.264611 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:52.264611 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:52.264611 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:52.264611 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:54:52.264611 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:52.264611 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:52.264611 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:52.264611 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:52.264611 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:52.264611 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:52.264611 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:52.264611 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:52.265729 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:54:52.265729 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:54:52.265729 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:54:52.265729 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:54:52.265729 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 241/472] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:54:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:52.271435 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16748e-859a-4b55-b2a7-6709d9be5fbd None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:52.327885 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ca0d3-efd8-444d-a75c-535c351e42a1 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:52.363876 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaab93d-1518-47b8-8904-f3648d160cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:52.364785 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaab93d-1518-47b8-8904-f3648d160cb0 None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:52.365290 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaab93d-1518-47b8-8904-f3648d160cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:52.365728 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaab93d-1518-47b8-8904-f3648d160cb0 None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:52.366565 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaab93d-1518-47b8-8904-f3648d160cb0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:52.368151 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaab93d-1518-47b8-8904-f3648d160cb0 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:52.376493 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16748e-859a-4b55-b2a7-6709d9be5fbd None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:52.394226 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 232/473] 10.222.0.24 () {60 vars in 1132 bytes} [Mon May 16 18:54:52 2022] POST /identity/v3/users => generated 248 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:54:52.417048 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db483e-09a1-4dee-9a4c-a475e76064bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:52.417874 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db483e-09a1-4dee-9a4c-a475e76064bb None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:52.418228 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db483e-09a1-4dee-9a4c-a475e76064bb None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:52.418566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db483e-09a1-4dee-9a4c-a475e76064bb None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:52.419389 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db483e-09a1-4dee-9a4c-a475e76064bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:52.419774 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db483e-09a1-4dee-9a4c-a475e76064bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:52.421279 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db483e-09a1-4dee-9a4c-a475e76064bb None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:52.434341 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 242/474] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:54:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:52.439877 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaab93d-1518-47b8-8904-f3648d160cb0 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:52.442356 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44947f-ffeb-410d-8eb1-6e8e4e42ca37 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:52.442644 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44947f-ffeb-410d-8eb1-6e8e4e42ca37 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:52.442919 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44947f-ffeb-410d-8eb1-6e8e4e42ca37 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:52.445360 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 243/475] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:54:52.449730 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607015bb-d469-4708-a78b-eba44820f53e None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:52.450014 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607015bb-d469-4708-a78b-eba44820f53e None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:52.450291 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607015bb-d469-4708-a78b-eba44820f53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:52.467424 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-607015bb-d469-4708-a78b-eba44820f53e None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:52.468553 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-607015bb-d469-4708-a78b-eba44820f53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:52.548590 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 244/476] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:54:52.572014 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607015bb-d469-4708-a78b-eba44820f53e None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:52.581179 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaab93d-1518-47b8-8904-f3648d160cb0 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:52.626239 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4f2a5-ca0f-456f-8c65-eaa7612e0375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:52.627094 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4f2a5-ca0f-456f-8c65-eaa7612e0375 None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:52.627444 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4f2a5-ca0f-456f-8c65-eaa7612e0375 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:52.628001 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4f2a5-ca0f-456f-8c65-eaa7612e0375 None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:52.628754 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4f2a5-ca0f-456f-8c65-eaa7612e0375 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:52.631666 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4f2a5-ca0f-456f-8c65-eaa7612e0375 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:52.659087 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 233/477] 10.222.0.24 () {60 vars in 1132 bytes} [Mon May 16 18:54:52 2022] POST /identity/v3/users => generated 249 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:54:52.694857 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607015bb-d469-4708-a78b-eba44820f53e None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:52.733152 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a880af8-a0ca-4836-9050-ec62e2a0feb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:52.733788 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a880af8-a0ca-4836-9050-ec62e2a0feb0 None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:52.734074 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a880af8-a0ca-4836-9050-ec62e2a0feb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:52.734349 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a880af8-a0ca-4836-9050-ec62e2a0feb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:52.735114 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a880af8-a0ca-4836-9050-ec62e2a0feb0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:52.736703 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a880af8-a0ca-4836-9050-ec62e2a0feb0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:52.745144 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.sql.core [None req-3a880af8-a0ca-4836-9050-ec62e2a0feb0 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 16 18:54:52.745144 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 16 18:54:52.745144 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [parameters: {'id': '5d10e2c338d241ccbba248d5651026e5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 16 18:54:52.745144 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80021) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 16 18:54:52.763004 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-3a880af8-a0ca-4836-9050-ec62e2a0feb0 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 16 18:54:52.763004 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:52.763004 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 18:54:52.763004 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 18:54:52.763004 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 18:54:52.763004 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 18:54:52.763004 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 18:54:52.763004 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application result = self._query(query) May 16 18:54:52.763004 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 18:54:52.763004 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application conn.query(q) May 16 18:54:52.763004 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 18:54:52.763004 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 18:54:52.763004 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 18:54:52.763004 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application result.read() May 16 18:54:52.763004 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 18:54:52.763932 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 18:54:52.763932 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 18:54:52.763932 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 18:54:52.763932 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 18:54:52.763932 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 18:54:52.763932 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 18:54:52.763932 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 18:54:52.763932 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 16 18:54:52.763932 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:54:52.763932 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 16 18:54:52.763932 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:54:52.763932 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:52.763932 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 16 18:54:52.763932 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 16 18:54:52.763932 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 16 18:54:52.763932 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return ref.to_dict() May 16 18:54:52.763932 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 18:54:52.763932 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application next(self.gen) May 16 18:54:52.764826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 16 18:54:52.764826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application yield resource May 16 18:54:52.764826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 18:54:52.764826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application next(self.gen) May 16 18:54:52.764826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 16 18:54:52.764826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self.session.rollback() May 16 18:54:52.764826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 16 18:54:52.764826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self.force_reraise() May 16 18:54:52.764826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 16 18:54:52.764826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise self.value May 16 18:54:52.764826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 16 18:54:52.764826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 16 18:54:52.764826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 16 18:54:52.764826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application session.commit() May 16 18:54:52.764826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 16 18:54:52.764826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 16 18:54:52.764826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 16 18:54:52.766370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._prepare_impl() May 16 18:54:52.766370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 16 18:54:52.766370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self.session.flush() May 16 18:54:52.766370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 16 18:54:52.766370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._flush(objects) May 16 18:54:52.766370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 16 18:54:52.766370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 16 18:54:52.766370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 16 18:54:52.766370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application compat.raise_( May 16 18:54:52.766370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 18:54:52.766370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception May 16 18:54:52.766370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 16 18:54:52.766370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application flush_context.execute() May 16 18:54:52.766370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 16 18:54:52.766370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rec.execute(self) May 16 18:54:52.766370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 16 18:54:52.766370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 16 18:54:52.767221 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 16 18:54:52.767221 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application _emit_insert_statements( May 16 18:54:52.767221 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 16 18:54:52.767221 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application c = connection._execute_20( May 16 18:54:52.767221 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 16 18:54:52.767221 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 16 18:54:52.767221 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 16 18:54:52.767221 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 16 18:54:52.767221 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 16 18:54:52.767221 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ret = self._execute_context( May 16 18:54:52.767221 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 16 18:54:52.767221 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 16 18:54:52.767221 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 16 18:54:52.767221 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 16 18:54:52.767221 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 18:54:52.767221 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception May 16 18:54:52.768007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 18:54:52.768007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 18:54:52.768007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 18:54:52.768007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 18:54:52.768007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 18:54:52.768007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application result = self._query(query) May 16 18:54:52.768007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 18:54:52.768007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application conn.query(q) May 16 18:54:52.768007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 18:54:52.768007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 18:54:52.768007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 18:54:52.768007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application result.read() May 16 18:54:52.768007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 18:54:52.768007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 18:54:52.768007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 18:54:52.768007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 18:54:52.768777 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 18:54:52.768777 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 18:54:52.768777 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 18:54:52.768777 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 18:54:52.768777 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 16 18:54:52.768777 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 16 18:54:52.768777 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [parameters: {'id': '5d10e2c338d241ccbba248d5651026e5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 16 18:54:52.768777 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 16 18:54:52.768777 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:54:52.768777 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:54:52.768777 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:54:52.768777 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:52.768777 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:52.768777 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:52.768777 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:52.768777 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:52.770656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:52.770656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:52.770656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:52.770656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:52.770656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:52.770656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:52.770656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 16 18:54:52.770656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 16 18:54:52.770656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:52.770656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:52.770656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 16 18:54:52.770656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 16 18:54:52.770656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 16 18:54:52.770656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 16 18:54:52.770656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 16 18:54:52.770656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:54:52.771996 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 245/478] 10.222.0.24 () {60 vars in 1131 bytes} [Mon May 16 18:54:52 2022] POST /identity/v3/roles => generated 144 bytes in 193 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:52.772060 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4f2a5-ca0f-456f-8c65-eaa7612e0375 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:52.901056 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4f2a5-ca0f-456f-8c65-eaa7612e0375 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:52.935102 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed0820-490e-4222-8264-0a9253f4a111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:52.935933 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed0820-490e-4222-8264-0a9253f4a111 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:52.936465 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed0820-490e-4222-8264-0a9253f4a111 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:52.936465 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed0820-490e-4222-8264-0a9253f4a111 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:52.946710 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ed0820-490e-4222-8264-0a9253f4a111 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:52.954934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-49ed0820-490e-4222-8264-0a9253f4a111 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:54:52.954934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:52.954934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:52.954934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:52.954934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:52.954934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:52.954934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:52.954934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:52.954934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:52.954934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:52.954934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:52.954934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:52.954934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:52.954934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:52.954934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:52.954934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:52.956672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:52.956672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:52.956672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:52.956672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:52.956672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:52.956672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:52.956672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:52.956672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:52.956672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:52.956672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:52.956672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:52.956672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:52.956672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:52.956672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:52.956672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:52.956672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:52.958379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:52.958379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:52.958379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:52.958379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:52.958379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:52.958379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:52.958379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:52.958379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:52.958379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:52.958379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:52.958379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:54:52.958379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:52.958379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 234/479] 10.222.0.24 () {56 vars in 1114 bytes} [Mon May 16 18:54:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:52.962249 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a880af8-a0ca-4836-9050-ec62e2a0feb0 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:53.065804 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a880af8-a0ca-4836-9050-ec62e2a0feb0 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:53.099193 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f281329-6d47-4778-8765-182d4cada98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:53.099870 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f281329-6d47-4778-8765-182d4cada98c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:53.100205 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f281329-6d47-4778-8765-182d4cada98c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:53.100477 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f281329-6d47-4778-8765-182d4cada98c None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:53.101291 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f281329-6d47-4778-8765-182d4cada98c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:53.101623 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f281329-6d47-4778-8765-182d4cada98c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:53.103011 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f281329-6d47-4778-8765-182d4cada98c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:53.112039 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 246/480] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:54:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:54.225250 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b54191-41fc-4c9a-ab08-c6f7d9f9c7ac None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:54.225945 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b54191-41fc-4c9a-ab08-c6f7d9f9c7ac None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:54.225945 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b54191-41fc-4c9a-ab08-c6f7d9f9c7ac None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:54.227421 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 235/481] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:54.239218 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a929c-10ad-4bac-be0e-a68ad67528b3 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:54.239767 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a929c-10ad-4bac-be0e-a68ad67528b3 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:54.239767 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a929c-10ad-4bac-be0e-a68ad67528b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:54.260935 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-589a929c-10ad-4bac-be0e-a68ad67528b3 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:54.262236 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-589a929c-10ad-4bac-be0e-a68ad67528b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:54.342024 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 247/482] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:54:54.377140 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b54191-41fc-4c9a-ab08-c6f7d9f9c7ac None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:54.506304 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b54191-41fc-4c9a-ab08-c6f7d9f9c7ac None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:54.551535 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1fb739-6051-4992-97d0-19f44546798e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:54.552836 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1fb739-6051-4992-97d0-19f44546798e None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:54.553326 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1fb739-6051-4992-97d0-19f44546798e None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:54.553818 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1fb739-6051-4992-97d0-19f44546798e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:54.567256 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1fb739-6051-4992-97d0-19f44546798e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:54.575420 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-6c1fb739-6051-4992-97d0-19f44546798e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 18:54:54.575420 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:54.575420 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:54.575420 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:54.575420 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:54.575420 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:54.575420 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:54.575420 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:54.575420 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:54.575420 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:54.575420 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:54.575420 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:54.575420 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:54.575420 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:54.575420 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:54.575420 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:54.576637 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:54.576637 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:54.576637 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:54.576637 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:54.576637 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:54.576637 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:54.576637 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:54.576637 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:54.576637 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:54.576637 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:54.576637 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:54.576637 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:54.576637 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:54.576637 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:54.576637 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:54.576637 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:54.577507 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:54.577507 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:54.577507 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:54.577507 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:54.577507 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:54.577507 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:54.577507 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:54.577507 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:54.577507 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:54.577507 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:54.577507 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 18:54:54.577507 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:54.581294 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 236/483] 10.222.0.24 () {56 vars in 1102 bytes} [Mon May 16 18:54:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:54.582787 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a929c-10ad-4bac-be0e-a68ad67528b3 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:54.723516 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a929c-10ad-4bac-be0e-a68ad67528b3 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:54.758016 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2173a-1612-4dd3-b881-7481b6ff3d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:54.758615 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2173a-1612-4dd3-b881-7481b6ff3d7f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:54.758898 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2173a-1612-4dd3-b881-7481b6ff3d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:54.759174 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2173a-1612-4dd3-b881-7481b6ff3d7f None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:54.759959 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e2173a-1612-4dd3-b881-7481b6ff3d7f None admin] RBAC: Adding query filter params (name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:54.760267 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e2173a-1612-4dd3-b881-7481b6ff3d7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:54.761698 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e2173a-1612-4dd3-b881-7481b6ff3d7f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:54.770129 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 248/484] 10.222.0.24 () {56 vars in 1103 bytes} [Mon May 16 18:54:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:54.775693 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1fb739-6051-4992-97d0-19f44546798e None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:54.906732 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1fb739-6051-4992-97d0-19f44546798e None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:54.944505 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db691a-5809-4963-a036-f4b3ac589ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:54.945322 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db691a-5809-4963-a036-f4b3ac589ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:54.945651 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db691a-5809-4963-a036-f4b3ac589ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:54.945929 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db691a-5809-4963-a036-f4b3ac589ff4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:54.956481 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db691a-5809-4963-a036-f4b3ac589ff4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:54.958148 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db691a-5809-4963-a036-f4b3ac589ff4 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:54.975425 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-a4db691a-5809-4963-a036-f4b3ac589ff4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:54:54.975425 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:54.975425 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:54.975425 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:54.975425 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:54.975425 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:54.975425 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:54.975425 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:54.975425 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:54.975425 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:54.975425 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:54.975425 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:54.975425 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:54:54.975425 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:54:54.975425 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:54:54.976298 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:54:54.976298 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:54.976298 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:54.976298 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:54.976298 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:54.976298 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:54.976298 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:54.976298 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:54.976298 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:54.976298 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:54.976298 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:54.976298 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:54.976298 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:54.976298 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:54.976298 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:54.976298 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:54.976298 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:54.977134 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:54:54.977134 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:54:54.977134 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:54:54.977134 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:54.977134 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 237/485] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:54:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:54.982400 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2173a-1612-4dd3-b881-7481b6ff3d7f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:54.999748 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ce848-c92a-4588-9355-1ee2ee99a043 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:55.000258 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ce848-c92a-4588-9355-1ee2ee99a043 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:55.000668 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ce848-c92a-4588-9355-1ee2ee99a043 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:55.003538 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 238/486] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:54:55.007707 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f7b29-927b-4b1b-b993-bf5b11bb111b None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:55.008212 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f7b29-927b-4b1b-b993-bf5b11bb111b None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:55.008619 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f7b29-927b-4b1b-b993-bf5b11bb111b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:55.025963 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-617f7b29-927b-4b1b-b993-bf5b11bb111b None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:55.027350 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-617f7b29-927b-4b1b-b993-bf5b11bb111b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:55.081340 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2173a-1612-4dd3-b881-7481b6ff3d7f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:55.122135 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b56342-abc9-4707-942e-ae0c40bd09da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:55.123135 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b56342-abc9-4707-942e-ae0c40bd09da None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:55.123557 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b56342-abc9-4707-942e-ae0c40bd09da None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:55.123994 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b56342-abc9-4707-942e-ae0c40bd09da None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:55.124889 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b56342-abc9-4707-942e-ae0c40bd09da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:55.125337 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b56342-abc9-4707-942e-ae0c40bd09da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:55.126988 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b56342-abc9-4707-942e-ae0c40bd09da None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:55.140664 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 249/487] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:55.146137 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b56342-abc9-4707-942e-ae0c40bd09da None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:55.163360 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 239/488] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:54:55.222360 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f7b29-927b-4b1b-b993-bf5b11bb111b None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:55.252341 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b56342-abc9-4707-942e-ae0c40bd09da None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:55.285402 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adba914-b471-4812-b4f8-672cd9f41ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:55.286172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adba914-b471-4812-b4f8-672cd9f41ccc None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:55.286439 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adba914-b471-4812-b4f8-672cd9f41ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:55.286710 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adba914-b471-4812-b4f8-672cd9f41ccc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:55.294596 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adba914-b471-4812-b4f8-672cd9f41ccc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:55.296045 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adba914-b471-4812-b4f8-672cd9f41ccc None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:55.311821 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-9adba914-b471-4812-b4f8-672cd9f41ccc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 18:54:55.311821 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:55.311821 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:55.311821 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:55.311821 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:55.311821 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:55.311821 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:55.311821 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:55.311821 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:55.311821 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:55.311821 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:55.311821 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:55.311821 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:54:55.311821 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:54:55.311821 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:54:55.311821 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:54:55.312752 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:55.312752 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:55.312752 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:54:55.312752 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:54:55.312752 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:54:55.312752 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:54:55.312752 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:55.312752 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:55.312752 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:55.312752 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:55.312752 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:55.312752 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:54:55.312752 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:55.312752 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:55.312752 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:55.312752 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:55.312752 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:55.312752 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:55.313662 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:55.313662 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:55.313662 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:54:55.313662 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:54:55.313662 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:54:55.313662 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:54:55.313662 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:54:55.313662 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:54:55.313662 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 18:54:55.313662 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:54:55.313662 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 250/489] 10.222.0.24 () {56 vars in 1093 bytes} [Mon May 16 18:54:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:54:55.318454 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adba914-b471-4812-b4f8-672cd9f41ccc None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:55.366556 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f7b29-927b-4b1b-b993-bf5b11bb111b None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:55.399913 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e8df2-e77f-4ee2-af15-69947dedaa74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:55.400823 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e8df2-e77f-4ee2-af15-69947dedaa74 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:55.401134 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e8df2-e77f-4ee2-af15-69947dedaa74 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:55.401417 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e8df2-e77f-4ee2-af15-69947dedaa74 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:55.411774 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e8df2-e77f-4ee2-af15-69947dedaa74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:55.417345 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adba914-b471-4812-b4f8-672cd9f41ccc None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:55.420067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-710e8df2-e77f-4ee2-af15-69947dedaa74 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 18:54:55.420067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:55.420067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:55.420067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:55.420067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:55.420067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:55.420067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:55.420067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:55.420067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:55.420067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:55.420067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:55.420067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:55.420067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:55.420067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:55.420067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:55.420067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:55.422103 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:55.422103 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:55.422103 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:55.422103 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:55.422103 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:55.422103 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:55.422103 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:55.422103 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:55.422103 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:55.422103 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:55.422103 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:55.422103 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:55.422103 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:55.422103 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:55.422103 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:55.422103 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:55.423991 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:55.423991 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:55.423991 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:55.423991 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:55.423991 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:55.423991 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:55.423991 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:55.423991 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:55.423991 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:55.423991 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:55.423991 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 18:54:55.423991 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:55.433553 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 240/490] 10.222.0.24 () {56 vars in 1102 bytes} [Mon May 16 18:54:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:54:55.433553 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf7622-e39d-49ef-a8e4-b250413afe12 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:55.433553 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf7622-e39d-49ef-a8e4-b250413afe12 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:55.433553 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf7622-e39d-49ef-a8e4-b250413afe12 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:55.433553 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 241/491] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:55.434307 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf7622-e39d-49ef-a8e4-b250413afe12 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:55.450451 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a5c0f-cc9e-40a2-811d-08af18f5495a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:55.451124 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a5c0f-cc9e-40a2-811d-08af18f5495a None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:55.451399 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a5c0f-cc9e-40a2-811d-08af18f5495a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:55.451668 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a5c0f-cc9e-40a2-811d-08af18f5495a None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:55.452513 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a5c0f-cc9e-40a2-811d-08af18f5495a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:55.452807 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a5c0f-cc9e-40a2-811d-08af18f5495a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:55.454293 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a5c0f-cc9e-40a2-811d-08af18f5495a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:55.492042 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 251/492] 10.222.0.24 () {56 vars in 1133 bytes} [Mon May 16 18:54:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:55.493412 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590084cb-26da-41c2-83e8-8d9885ef92d9 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:55.493725 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590084cb-26da-41c2-83e8-8d9885ef92d9 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:55.494153 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590084cb-26da-41c2-83e8-8d9885ef92d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:55.510418 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-590084cb-26da-41c2-83e8-8d9885ef92d9 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:55.511603 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-590084cb-26da-41c2-83e8-8d9885ef92d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:55.540928 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf7622-e39d-49ef-a8e4-b250413afe12 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:55.578293 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43246e57-eaad-4b3e-910f-93810e48286b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:55.579048 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43246e57-eaad-4b3e-910f-93810e48286b None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:55.579495 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43246e57-eaad-4b3e-910f-93810e48286b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:55.579773 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43246e57-eaad-4b3e-910f-93810e48286b None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:55.580596 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43246e57-eaad-4b3e-910f-93810e48286b None admin] RBAC: Adding query filter params (name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:55.580761 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 252/493] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:54:55.580905 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43246e57-eaad-4b3e-910f-93810e48286b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:55.581599 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590084cb-26da-41c2-83e8-8d9885ef92d9 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:55.586981 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43246e57-eaad-4b3e-910f-93810e48286b None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:55.604468 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 242/494] 10.222.0.24 () {56 vars in 1103 bytes} [Mon May 16 18:54:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:55.609952 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43246e57-eaad-4b3e-910f-93810e48286b None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:55.679795 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590084cb-26da-41c2-83e8-8d9885ef92d9 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:55.712908 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dafce5-91f7-41d1-a0cb-e4240e6b658c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:55.713589 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dafce5-91f7-41d1-a0cb-e4240e6b658c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:55.713870 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dafce5-91f7-41d1-a0cb-e4240e6b658c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:55.714134 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dafce5-91f7-41d1-a0cb-e4240e6b658c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:55.721650 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43246e57-eaad-4b3e-910f-93810e48286b None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:55.755313 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12eda96-d1e1-4bde-a2ff-f852b1aa9ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:55.756128 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12eda96-d1e1-4bde-a2ff-f852b1aa9ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:55.756408 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12eda96-d1e1-4bde-a2ff-f852b1aa9ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:55.756741 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12eda96-d1e1-4bde-a2ff-f852b1aa9ca1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:55.769374 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12eda96-d1e1-4bde-a2ff-f852b1aa9ca1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:55.770897 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12eda96-d1e1-4bde-a2ff-f852b1aa9ca1 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:55.779702 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dafce5-91f7-41d1-a0cb-e4240e6b658c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:55.781256 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dafce5-91f7-41d1-a0cb-e4240e6b658c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:55.788084 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-b12eda96-d1e1-4bde-a2ff-f852b1aa9ca1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:54:55.788084 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:55.788084 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:55.788084 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:55.788084 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:55.788084 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:55.788084 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:55.788084 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:55.788084 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:55.788084 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:55.788084 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:55.788084 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:55.788084 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:54:55.788084 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:54:55.788084 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:54:55.788890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:54:55.788890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:55.788890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:55.788890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:55.788890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:55.788890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:55.788890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:55.788890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:55.788890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:55.788890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:55.788890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:55.788890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:55.788890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:55.788890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:55.788890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:55.788890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:55.788890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:55.790090 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:54:55.790090 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:54:55.790090 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:54:55.790090 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:55.790090 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 243/495] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:54:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:54:55.790090 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12eda96-d1e1-4bde-a2ff-f852b1aa9ca1 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:55.876803 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 253/496] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:54:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:54:55.878081 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2da90-e04a-436e-8a24-68a2a8e00067 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:55.878368 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2da90-e04a-436e-8a24-68a2a8e00067 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:55.878640 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2da90-e04a-436e-8a24-68a2a8e00067 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:55.880070 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 254/497] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:55.882303 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2da90-e04a-436e-8a24-68a2a8e00067 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:55.891165 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12eda96-d1e1-4bde-a2ff-f852b1aa9ca1 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:55.924537 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193072ef-e883-464d-96fd-17b3057c8579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:55.925372 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193072ef-e883-464d-96fd-17b3057c8579 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:55.925691 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193072ef-e883-464d-96fd-17b3057c8579 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:55.925964 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193072ef-e883-464d-96fd-17b3057c8579 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:55.937383 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193072ef-e883-464d-96fd-17b3057c8579 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:55.945406 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-193072ef-e883-464d-96fd-17b3057c8579 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 18:54:55.945406 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:55.945406 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:55.945406 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:55.945406 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:55.945406 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:55.945406 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:55.945406 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:55.945406 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:55.945406 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:55.945406 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:55.945406 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:55.945406 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:55.945406 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:55.945406 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:55.945406 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:55.946392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:55.946392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:55.946392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:55.946392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:55.946392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:55.946392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:55.946392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:55.946392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:55.946392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:55.946392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:55.946392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:55.946392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:55.946392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:55.946392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:55.946392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:55.946392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:55.947338 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:55.947338 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:55.947338 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:55.947338 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:55.947338 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:55.947338 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:55.947338 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:55.947338 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:55.947338 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:55.947338 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:55.947338 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 18:54:55.947338 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:55.947338 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 244/498] 10.222.0.24 () {56 vars in 1102 bytes} [Mon May 16 18:54:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:55.948667 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193072ef-e883-464d-96fd-17b3057c8579 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:55.988889 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2da90-e04a-436e-8a24-68a2a8e00067 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:56.024087 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd7314-2450-4141-8835-3717bbc50e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:56.024766 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd7314-2450-4141-8835-3717bbc50e0b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:56.025048 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd7314-2450-4141-8835-3717bbc50e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:56.025394 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd7314-2450-4141-8835-3717bbc50e0b None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:56.026165 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd7314-2450-4141-8835-3717bbc50e0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:56.026521 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd7314-2450-4141-8835-3717bbc50e0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:56.027945 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd7314-2450-4141-8835-3717bbc50e0b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:56.039633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 255/499] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:54:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:56.040897 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b230919-de32-4404-bc78-e5fab402803b None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:56.041181 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b230919-de32-4404-bc78-e5fab402803b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:56.041451 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b230919-de32-4404-bc78-e5fab402803b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:56.054461 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193072ef-e883-464d-96fd-17b3057c8579 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:56.057639 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-5b230919-de32-4404-bc78-e5fab402803b None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:56.059593 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5b230919-de32-4404-bc78-e5fab402803b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:56.093768 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207159b-f4d5-4f69-9dc2-8dbbe7a97390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:56.094575 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207159b-f4d5-4f69-9dc2-8dbbe7a97390 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:56.094856 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207159b-f4d5-4f69-9dc2-8dbbe7a97390 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:56.095125 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207159b-f4d5-4f69-9dc2-8dbbe7a97390 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:56.105676 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7207159b-f4d5-4f69-9dc2-8dbbe7a97390 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:56.107166 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7207159b-f4d5-4f69-9dc2-8dbbe7a97390 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:56.124471 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-7207159b-f4d5-4f69-9dc2-8dbbe7a97390 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:54:56.124471 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:56.124471 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:56.124471 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:56.124471 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:56.124471 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:56.124471 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:56.124471 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:56.124471 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:56.124471 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:56.124471 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:56.124471 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:56.124471 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:54:56.124471 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:54:56.124471 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:54:56.125457 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:54:56.125457 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:56.125457 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:56.125457 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:56.125457 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:56.125457 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:56.125457 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:56.125457 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:56.125457 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:56.125457 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:56.125457 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:56.125457 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:56.125457 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:56.125457 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:56.125457 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:56.125457 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:56.125457 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:56.126688 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:54:56.126688 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:54:56.126688 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:54:56.126688 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:56.126688 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 245/500] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:54:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:56.127349 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207159b-f4d5-4f69-9dc2-8dbbe7a97390 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:56.131167 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 256/501] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:54:56.132005 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b230919-de32-4404-bc78-e5fab402803b None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:56.225731 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207159b-f4d5-4f69-9dc2-8dbbe7a97390 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:56.231707 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b230919-de32-4404-bc78-e5fab402803b None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:56.262822 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd37a9-5c05-4ee9-a117-24981f84b3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:56.263832 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd37a9-5c05-4ee9-a117-24981f84b3a3 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:56.264106 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd37a9-5c05-4ee9-a117-24981f84b3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:56.264391 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd37a9-5c05-4ee9-a117-24981f84b3a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:56.265131 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd37a9-5c05-4ee9-a117-24981f84b3a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:56.265429 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd37a9-5c05-4ee9-a117-24981f84b3a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:56.265578 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb57293-4b92-4f08-8b30-3ebc8d1321f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:56.266387 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb57293-4b92-4f08-8b30-3ebc8d1321f9 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:56.266668 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb57293-4b92-4f08-8b30-3ebc8d1321f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:56.266832 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd37a9-5c05-4ee9-a117-24981f84b3a3 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:56.266930 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb57293-4b92-4f08-8b30-3ebc8d1321f9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:56.274227 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb57293-4b92-4f08-8b30-3ebc8d1321f9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:56.275731 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb57293-4b92-4f08-8b30-3ebc8d1321f9 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:56.276303 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 246/502] 10.222.0.24 () {56 vars in 1103 bytes} [Mon May 16 18:54:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:56.277544 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4787e-1128-4f98-9425-823f14038e12 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:56.277967 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4787e-1128-4f98-9425-823f14038e12 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:56.278340 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4787e-1128-4f98-9425-823f14038e12 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:56.280306 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 247/503] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:56.281150 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4787e-1128-4f98-9425-823f14038e12 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:56.292712 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-2cb57293-4b92-4f08-8b30-3ebc8d1321f9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 16 18:54:56.292712 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:56.292712 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:56.292712 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:56.292712 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:56.292712 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:56.292712 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:56.292712 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:56.292712 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:56.292712 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:56.292712 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:56.292712 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:56.292712 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:54:56.292712 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:54:56.292712 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:54:56.292712 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:54:56.293699 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:56.293699 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:56.293699 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:54:56.293699 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:54:56.293699 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:54:56.293699 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:54:56.293699 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:56.293699 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:56.293699 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:56.293699 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:56.293699 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:56.293699 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:54:56.293699 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:56.293699 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:56.293699 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:56.293699 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:56.293699 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:56.293699 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:56.294658 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:56.294658 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:56.294658 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:54:56.294658 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:54:56.294658 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:54:56.294658 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:54:56.294658 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:54:56.294658 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:54:56.294658 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 16 18:54:56.294658 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:54:56.294658 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 257/504] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:54:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:56.295211 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb57293-4b92-4f08-8b30-3ebc8d1321f9 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:56.385363 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4787e-1128-4f98-9425-823f14038e12 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:56.386801 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb57293-4b92-4f08-8b30-3ebc8d1321f9 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:56.418492 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ba0bd-7d67-4800-a1ff-a5bc14f954b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:56.419074 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef70bb5-2a15-497e-b16b-4f78c5c12eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:56.419233 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ba0bd-7d67-4800-a1ff-a5bc14f954b7 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:56.419521 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ba0bd-7d67-4800-a1ff-a5bc14f954b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:56.419723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef70bb5-2a15-497e-b16b-4f78c5c12eed None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:56.419823 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ba0bd-7d67-4800-a1ff-a5bc14f954b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:56.420006 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef70bb5-2a15-497e-b16b-4f78c5c12eed None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:56.420273 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef70bb5-2a15-497e-b16b-4f78c5c12eed None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:56.421000 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef70bb5-2a15-497e-b16b-4f78c5c12eed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:56.421308 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef70bb5-2a15-497e-b16b-4f78c5c12eed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:56.422731 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef70bb5-2a15-497e-b16b-4f78c5c12eed None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:56.429518 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ba0bd-7d67-4800-a1ff-a5bc14f954b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:54:56.433748 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 248/505] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:56.438318 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef70bb5-2a15-497e-b16b-4f78c5c12eed None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:56.438426 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-b04ba0bd-7d67-4800-a1ff-a5bc14f954b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 18:54:56.438426 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:56.438426 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:56.438426 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:56.438426 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:56.438426 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:56.438426 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:56.438426 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:56.438426 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:56.438426 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:56.438426 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:56.438426 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:56.438426 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:54:56.438426 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:54:56.438426 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:54:56.438426 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:54:56.439313 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:54:56.439313 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:54:56.439313 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:54:56.439313 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:54:56.439313 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:56.439313 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:56.439313 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:56.439313 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:56.439313 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:56.439313 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:56.439313 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:56.439313 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:54:56.439313 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:56.439313 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:56.439313 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:56.439313 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:56.440081 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:56.440081 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:56.440081 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:56.440081 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:56.440081 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:54:56.440081 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:54:56.440081 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:54:56.440081 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:54:56.440081 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:54:56.440081 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:54:56.440081 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 18:54:56.440081 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:54:56.440081 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 258/506] 10.222.0.24 () {56 vars in 1102 bytes} [Mon May 16 18:54:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:56.440081 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6f9cb-c897-47cf-b950-f98b1e3987b0 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:56.440774 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6f9cb-c897-47cf-b950-f98b1e3987b0 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:56.440774 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6f9cb-c897-47cf-b950-f98b1e3987b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:56.456683 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-9db6f9cb-c897-47cf-b950-f98b1e3987b0 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:56.457913 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9db6f9cb-c897-47cf-b950-f98b1e3987b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:56.521918 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 259/507] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:54:56.522977 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6f9cb-c897-47cf-b950-f98b1e3987b0 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:56.535282 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef70bb5-2a15-497e-b16b-4f78c5c12eed None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:56.570688 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8b6a0-3042-4723-8548-fdec0f031496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:56.571496 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8b6a0-3042-4723-8548-fdec0f031496 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:56.571776 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8b6a0-3042-4723-8548-fdec0f031496 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:56.572122 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8b6a0-3042-4723-8548-fdec0f031496 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:56.582486 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8b6a0-3042-4723-8548-fdec0f031496 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:56.583966 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8b6a0-3042-4723-8548-fdec0f031496 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:56.600814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-3bd8b6a0-3042-4723-8548-fdec0f031496 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:54:56.600814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:56.600814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:56.600814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:56.600814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:56.600814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:56.600814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:56.600814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:56.600814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:56.600814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:56.600814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:56.600814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:56.600814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:54:56.600814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:54:56.600814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:54:56.601760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:54:56.601760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:56.601760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:56.601760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:56.601760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:56.601760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:56.601760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:56.601760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:56.601760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:56.601760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:56.601760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:56.601760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:56.601760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:56.601760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:56.601760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:56.601760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:56.601760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:56.602627 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:54:56.602627 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:54:56.602627 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:54:56.602627 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:56.602627 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 249/508] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:54:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:56.602892 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8b6a0-3042-4723-8548-fdec0f031496 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:56.620381 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6f9cb-c897-47cf-b950-f98b1e3987b0 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:56.653564 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8d9f6-f470-4f3a-97de-a9e425520d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:56.654137 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8d9f6-f470-4f3a-97de-a9e425520d99 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:56.654422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8d9f6-f470-4f3a-97de-a9e425520d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:56.654690 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8d9f6-f470-4f3a-97de-a9e425520d99 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:56.655540 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8d9f6-f470-4f3a-97de-a9e425520d99 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:56.655849 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8d9f6-f470-4f3a-97de-a9e425520d99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:56.657307 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8d9f6-f470-4f3a-97de-a9e425520d99 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:56.674107 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 260/509] 10.222.0.24 () {56 vars in 1137 bytes} [Mon May 16 18:54:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:56.674899 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8d9f6-f470-4f3a-97de-a9e425520d99 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:56.703300 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8b6a0-3042-4723-8548-fdec0f031496 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:56.734954 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb252d7-96d0-412f-90bc-29a658a1909f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:56.735746 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb252d7-96d0-412f-90bc-29a658a1909f None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:56.736022 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb252d7-96d0-412f-90bc-29a658a1909f None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:56.736292 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb252d7-96d0-412f-90bc-29a658a1909f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:56.742868 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb252d7-96d0-412f-90bc-29a658a1909f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:56.744376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb252d7-96d0-412f-90bc-29a658a1909f None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:56.759622 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-edb252d7-96d0-412f-90bc-29a658a1909f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:54:56.759622 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:56.759622 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:56.759622 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:56.759622 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:56.759622 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:56.759622 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:56.759622 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:56.759622 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:56.759622 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:56.759622 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:56.759622 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:56.759622 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:54:56.759622 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:54:56.759622 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:54:56.760474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:54:56.760474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:56.760474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:56.760474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:56.760474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:56.760474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:56.760474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:56.760474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:56.760474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:56.760474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:56.760474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:56.760474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:56.760474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:56.760474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:56.760474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:56.760474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:56.760474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:56.761285 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:54:56.761285 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:54:56.761285 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:54:56.761285 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:54:56.761285 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:54:56.761285 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:54:56.761285 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:54:56.761285 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:56.761285 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 250/510] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:54:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:56.761809 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb252d7-96d0-412f-90bc-29a658a1909f None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:56.767257 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8d9f6-f470-4f3a-97de-a9e425520d99 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:56.799596 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e12c16-c90b-43aa-9848-1644fc3f6ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:56.800359 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e12c16-c90b-43aa-9848-1644fc3f6ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:56.800710 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e12c16-c90b-43aa-9848-1644fc3f6ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:56.801048 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e12c16-c90b-43aa-9848-1644fc3f6ad9 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:56.801859 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e12c16-c90b-43aa-9848-1644fc3f6ad9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:56.802167 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e12c16-c90b-43aa-9848-1644fc3f6ad9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:56.803566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e12c16-c90b-43aa-9848-1644fc3f6ad9 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:56.811282 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 261/511] 10.222.0.24 () {56 vars in 1103 bytes} [Mon May 16 18:54:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:56.812132 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e12c16-c90b-43aa-9848-1644fc3f6ad9 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:56.854163 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb252d7-96d0-412f-90bc-29a658a1909f None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:56.886190 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e1910-0c8f-4698-95e2-cb592772929a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:56.886994 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e1910-0c8f-4698-95e2-cb592772929a None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:56.887234 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e1910-0c8f-4698-95e2-cb592772929a None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:56.887534 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e1910-0c8f-4698-95e2-cb592772929a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:56.897300 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e1910-0c8f-4698-95e2-cb592772929a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:56.898808 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e1910-0c8f-4698-95e2-cb592772929a None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:56.911126 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e12c16-c90b-43aa-9848-1644fc3f6ad9 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:56.916100 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-477e1910-0c8f-4698-95e2-cb592772929a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:54:56.916100 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:56.916100 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:56.916100 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:56.916100 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:56.916100 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:56.916100 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:56.916100 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:56.916100 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:56.916100 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:56.916100 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:56.916100 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:56.916100 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:54:56.916100 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:54:56.916100 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:54:56.916940 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:54:56.916940 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:56.916940 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:56.916940 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:56.916940 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:56.916940 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:56.916940 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:56.916940 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:56.916940 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:56.916940 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:56.916940 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:56.916940 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:56.916940 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:56.916940 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:56.916940 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:56.916940 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:56.916940 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:56.918042 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:54:56.918042 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:54:56.918042 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:54:56.918042 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:56.918042 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 251/512] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:54:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:56.918296 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e1910-0c8f-4698-95e2-cb592772929a None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:56.948734 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab71832-940a-4e64-a556-eb1d5d8a5170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:56.949407 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab71832-940a-4e64-a556-eb1d5d8a5170 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:56.949715 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab71832-940a-4e64-a556-eb1d5d8a5170 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:56.949989 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab71832-940a-4e64-a556-eb1d5d8a5170 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:56.950713 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab71832-940a-4e64-a556-eb1d5d8a5170 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:56.951017 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab71832-940a-4e64-a556-eb1d5d8a5170 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:56.952402 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab71832-940a-4e64-a556-eb1d5d8a5170 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:56.963315 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 262/513] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:56.964099 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab71832-940a-4e64-a556-eb1d5d8a5170 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:57.012292 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e1910-0c8f-4698-95e2-cb592772929a None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:57.045321 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d8ed8-9537-4527-bfcd-32de0cf91cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:57.045992 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d8ed8-9537-4527-bfcd-32de0cf91cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:57.046278 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d8ed8-9537-4527-bfcd-32de0cf91cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:57.046549 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d8ed8-9537-4527-bfcd-32de0cf91cf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:57.058470 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab71832-940a-4e64-a556-eb1d5d8a5170 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:57.090980 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2703f4-bd9f-46b0-a9c9-4ea03242f0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:57.091649 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2703f4-bd9f-46b0-a9c9-4ea03242f0ae None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:57.091921 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2703f4-bd9f-46b0-a9c9-4ea03242f0ae None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:57.092184 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2703f4-bd9f-46b0-a9c9-4ea03242f0ae None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:57.092959 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2703f4-bd9f-46b0-a9c9-4ea03242f0ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:57.093266 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2703f4-bd9f-46b0-a9c9-4ea03242f0ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:57.094758 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2703f4-bd9f-46b0-a9c9-4ea03242f0ae None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:57.109725 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d8ed8-9537-4527-bfcd-32de0cf91cf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:57.111182 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d8ed8-9537-4527-bfcd-32de0cf91cf8 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:57.111820 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 263/514] 10.222.0.24 () {56 vars in 1148 bytes} [Mon May 16 18:54:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:57.112621 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2703f4-bd9f-46b0-a9c9-4ea03242f0ae None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:57.206160 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2703f4-bd9f-46b0-a9c9-4ea03242f0ae None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:57.211617 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 252/515] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:54:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:54:57.212457 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d8ed8-9537-4527-bfcd-32de0cf91cf8 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:57.240097 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605b300-4012-4d89-9ab4-40332e3c33d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:57.240986 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605b300-4012-4d89-9ab4-40332e3c33d4 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:57.241374 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605b300-4012-4d89-9ab4-40332e3c33d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:57.241725 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605b300-4012-4d89-9ab4-40332e3c33d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:57.252430 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605b300-4012-4d89-9ab4-40332e3c33d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:57.254037 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605b300-4012-4d89-9ab4-40332e3c33d4 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:57.272076 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-c605b300-4012-4d89-9ab4-40332e3c33d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:54:57.272076 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:57.272076 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:57.272076 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:57.272076 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:57.272076 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:57.272076 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:57.272076 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:57.272076 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:57.272076 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:57.272076 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:57.272076 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:57.272076 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:54:57.272076 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:54:57.272076 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:54:57.278226 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:54:57.278226 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:57.278226 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:57.278226 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:57.278226 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:57.278226 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:57.278226 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:57.278226 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:57.278226 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:54:57.278226 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:57.278226 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:57.278226 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:57.278226 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:57.278226 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:57.278226 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:57.278226 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:57.278226 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:57.279052 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:54:57.279052 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:54:57.279052 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:54:57.279052 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:54:57.279052 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 264/516] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:54:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:57.279052 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605b300-4012-4d89-9ab4-40332e3c33d4 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:57.305611 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d8ed8-9537-4527-bfcd-32de0cf91cf8 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:57.337102 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f159a-3e7c-496a-b095-e47ac29d2f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:57.337785 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f159a-3e7c-496a-b095-e47ac29d2f91 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:57.338061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f159a-3e7c-496a-b095-e47ac29d2f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:57.338334 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f159a-3e7c-496a-b095-e47ac29d2f91 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:57.339054 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f159a-3e7c-496a-b095-e47ac29d2f91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:57.339361 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f159a-3e7c-496a-b095-e47ac29d2f91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:57.340735 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f159a-3e7c-496a-b095-e47ac29d2f91 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:57.351735 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 253/517] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:57.352530 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f159a-3e7c-496a-b095-e47ac29d2f91 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:57.372859 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605b300-4012-4d89-9ab4-40332e3c33d4 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:57.405857 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb177bda-8ea8-4c51-8818-ea3063646173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:57.406670 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb177bda-8ea8-4c51-8818-ea3063646173 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:57.406930 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb177bda-8ea8-4c51-8818-ea3063646173 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:57.407195 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb177bda-8ea8-4c51-8818-ea3063646173 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:57.414792 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb177bda-8ea8-4c51-8818-ea3063646173 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:57.416273 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb177bda-8ea8-4c51-8818-ea3063646173 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:57.431939 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-bb177bda-8ea8-4c51-8818-ea3063646173 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 16 18:54:57.431939 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:57.431939 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:57.431939 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:57.431939 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:57.431939 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:57.431939 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:57.431939 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:57.431939 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:57.431939 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:57.431939 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:57.431939 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:57.431939 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:54:57.431939 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:54:57.431939 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:54:57.431939 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:54:57.432806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:57.432806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:57.432806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:54:57.432806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:54:57.432806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:54:57.432806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:54:57.432806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:57.432806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:57.432806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:57.432806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:57.432806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:57.432806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:54:57.432806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:57.432806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:57.432806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:57.432806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:57.432806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:57.432806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:57.433736 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:57.433736 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:57.433736 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:54:57.433736 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:54:57.433736 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:54:57.433736 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:54:57.433736 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:54:57.433736 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:54:57.433736 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 16 18:54:57.433736 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:54:57.433736 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 265/518] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:54:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:57.434317 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb177bda-8ea8-4c51-8818-ea3063646173 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:57.447325 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f159a-3e7c-496a-b095-e47ac29d2f91 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:57.479042 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f8b51-3ed4-4859-8861-cb1eb73596f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:57.479710 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f8b51-3ed4-4859-8861-cb1eb73596f2 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:57.479985 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f8b51-3ed4-4859-8861-cb1eb73596f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:57.480264 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f8b51-3ed4-4859-8861-cb1eb73596f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:57.481092 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f8b51-3ed4-4859-8861-cb1eb73596f2 None admin] RBAC: Adding query filter params (role.id=48c59cffd0c84f83b89761ff42040687, scope.project.id=084e70bbad784892b195bb11a68bf857, user.id=1f03aa520ee14615b802cdbc3cd4f87d) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:57.481407 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f8b51-3ed4-4859-8861-cb1eb73596f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:57.482905 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f8b51-3ed4-4859-8861-cb1eb73596f2 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:57.488392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 254/519] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:54:57 2022] GET /identity/v3/role_assignments?user.id=1f03aa520ee14615b802cdbc3cd4f87d&scope.project.id=084e70bbad784892b195bb11a68bf857&role.id=48c59cffd0c84f83b89761ff42040687 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:57.489203 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f8b51-3ed4-4859-8861-cb1eb73596f2 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:57.538532 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb177bda-8ea8-4c51-8818-ea3063646173 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:57.576651 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65858c-a25c-44e4-b976-e3605411ba24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:57.577475 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65858c-a25c-44e4-b976-e3605411ba24 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:57.577786 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65858c-a25c-44e4-b976-e3605411ba24 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:57.578063 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65858c-a25c-44e4-b976-e3605411ba24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:57.588729 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c65858c-a25c-44e4-b976-e3605411ba24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:57.590299 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c65858c-a25c-44e4-b976-e3605411ba24 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:57.607521 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f8b51-3ed4-4859-8861-cb1eb73596f2 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:57.608691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-8c65858c-a25c-44e4-b976-e3605411ba24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:54:57.608691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:57.608691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:57.608691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:57.608691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:57.608691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:57.608691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:57.608691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:57.608691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:57.608691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:57.608691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:57.608691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:57.608691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:54:57.608691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:54:57.608691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:54:57.609519 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:54:57.609519 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:57.609519 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:57.609519 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:57.609519 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:57.609519 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:57.609519 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:57.609519 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:57.609519 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:54:57.609519 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:57.609519 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:57.609519 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:57.609519 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:57.609519 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:57.609519 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:57.609519 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:57.609519 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:57.616597 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:54:57.616597 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:54:57.616597 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:54:57.616597 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:54:57.616597 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 266/520] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:54:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:57.616597 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65858c-a25c-44e4-b976-e3605411ba24 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:57.655259 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e232ec-2952-4793-94ba-49b5a114d42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:57.656106 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e232ec-2952-4793-94ba-49b5a114d42f None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:57.656395 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e232ec-2952-4793-94ba-49b5a114d42f None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:57.657669 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e232ec-2952-4793-94ba-49b5a114d42f None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:57.658750 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e232ec-2952-4793-94ba-49b5a114d42f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:57.659183 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e232ec-2952-4793-94ba-49b5a114d42f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:57.661307 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e232ec-2952-4793-94ba-49b5a114d42f None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:57.679634 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 255/521] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:57.680771 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e232ec-2952-4793-94ba-49b5a114d42f None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:57.724588 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65858c-a25c-44e4-b976-e3605411ba24 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:57.756762 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc70a53-1e79-4406-a17e-6ae19cfa36a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:57.757790 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc70a53-1e79-4406-a17e-6ae19cfa36a6 None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:57.758288 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc70a53-1e79-4406-a17e-6ae19cfa36a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:57.758749 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc70a53-1e79-4406-a17e-6ae19cfa36a6 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:57.759868 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc70a53-1e79-4406-a17e-6ae19cfa36a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:57.761426 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc70a53-1e79-4406-a17e-6ae19cfa36a6 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:57.778173 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e232ec-2952-4793-94ba-49b5a114d42f None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:57.789915 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 267/522] 10.222.0.24 () {60 vars in 1132 bytes} [Mon May 16 18:54:57 2022] POST /identity/v3/users => generated 247 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:54:57.790848 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc70a53-1e79-4406-a17e-6ae19cfa36a6 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:57.818899 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df5428-2b23-43e7-8fcd-afe5739923d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:57.819698 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df5428-2b23-43e7-8fcd-afe5739923d0 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:57.819964 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df5428-2b23-43e7-8fcd-afe5739923d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:57.820243 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df5428-2b23-43e7-8fcd-afe5739923d0 None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:57.821239 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df5428-2b23-43e7-8fcd-afe5739923d0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:57.821473 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df5428-2b23-43e7-8fcd-afe5739923d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:57.823104 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df5428-2b23-43e7-8fcd-afe5739923d0 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:57.868582 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 256/523] 10.222.0.24 () {56 vars in 1137 bytes} [Mon May 16 18:54:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:57.868582 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df5428-2b23-43e7-8fcd-afe5739923d0 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:57.907030 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc70a53-1e79-4406-a17e-6ae19cfa36a6 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:57.943361 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e86638-6713-481b-8681-bc1a8f481940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:57.944295 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e86638-6713-481b-8681-bc1a8f481940 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:57.944741 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e86638-6713-481b-8681-bc1a8f481940 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:57.945182 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e86638-6713-481b-8681-bc1a8f481940 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:57.946126 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e86638-6713-481b-8681-bc1a8f481940 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:57.946584 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e86638-6713-481b-8681-bc1a8f481940 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:57.948235 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e86638-6713-481b-8681-bc1a8f481940 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:57.961407 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 268/524] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:57.962767 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e86638-6713-481b-8681-bc1a8f481940 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:57.972601 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df5428-2b23-43e7-8fcd-afe5739923d0 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:58.022102 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d3993-e9f5-42ad-af2f-5d9d2c81fbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:58.022955 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d3993-e9f5-42ad-af2f-5d9d2c81fbe1 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:58.023397 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d3993-e9f5-42ad-af2f-5d9d2c81fbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:58.023810 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d3993-e9f5-42ad-af2f-5d9d2c81fbe1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:58.033734 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d3993-e9f5-42ad-af2f-5d9d2c81fbe1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:58.035420 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d3993-e9f5-42ad-af2f-5d9d2c81fbe1 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:58.052240 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-476d3993-e9f5-42ad-af2f-5d9d2c81fbe1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 16 18:54:58.052240 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:58.052240 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:58.052240 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:58.052240 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:58.052240 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:58.052240 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:58.052240 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:58.052240 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:58.052240 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:58.052240 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:58.052240 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:58.052240 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:54:58.052240 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:54:58.052240 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:54:58.052240 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:54:58.053698 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:58.053698 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:58.053698 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:54:58.053698 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:54:58.053698 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:54:58.053698 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:54:58.053698 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:58.053698 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:58.053698 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:58.053698 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:58.053698 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:58.053698 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:58.053698 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:58.053698 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:58.053698 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:58.053698 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:58.053698 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:58.053698 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:58.055046 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:58.055046 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:58.055046 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:54:58.055046 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:54:58.055046 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:54:58.055046 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:54:58.055046 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:54:58.055046 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:54:58.055046 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 16 18:54:58.055046 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:58.055046 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 257/525] 10.222.0.24 () {56 vars in 1102 bytes} [Mon May 16 18:54:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:58.055046 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d3993-e9f5-42ad-af2f-5d9d2c81fbe1 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:58.098411 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e86638-6713-481b-8681-bc1a8f481940 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:58.132683 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925908e5-abd6-4c94-860c-42c4fd08fe50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:58.133564 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925908e5-abd6-4c94-860c-42c4fd08fe50 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:58.133894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925908e5-abd6-4c94-860c-42c4fd08fe50 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:58.134276 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925908e5-abd6-4c94-860c-42c4fd08fe50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:58.202815 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d3993-e9f5-42ad-af2f-5d9d2c81fbe1 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:58.206714 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925908e5-abd6-4c94-860c-42c4fd08fe50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:58.207967 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925908e5-abd6-4c94-860c-42c4fd08fe50 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:58.244456 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2dfabd-445c-4589-bdd2-9fe03935e3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:58.245517 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2dfabd-445c-4589-bdd2-9fe03935e3bb None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:58.245965 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2dfabd-445c-4589-bdd2-9fe03935e3bb None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:58.246376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2dfabd-445c-4589-bdd2-9fe03935e3bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:58.255354 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2dfabd-445c-4589-bdd2-9fe03935e3bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:58.257014 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2dfabd-445c-4589-bdd2-9fe03935e3bb None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:58.273607 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-7e2dfabd-445c-4589-bdd2-9fe03935e3bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:54:58.273607 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:58.273607 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:58.273607 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:58.273607 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:58.273607 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:58.273607 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:58.273607 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:58.273607 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:58.273607 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:58.273607 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:58.273607 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:58.273607 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:54:58.273607 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:54:58.273607 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:54:58.274691 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:54:58.274691 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:58.274691 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:58.274691 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:58.274691 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:58.274691 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:58.274691 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:58.274691 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:58.274691 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:58.274691 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:58.274691 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:58.274691 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:58.274691 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:58.274691 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:58.274691 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:58.274691 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:58.274691 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:58.275700 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:54:58.275700 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:54:58.275700 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:54:58.275700 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:54:58.275700 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:54:58.275700 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:54:58.275700 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:54:58.275700 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:58.277652 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 258/526] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:54:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:58.278685 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2dfabd-445c-4589-bdd2-9fe03935e3bb None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:58.311542 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 269/527] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:54:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:54:58.316452 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925908e5-abd6-4c94-860c-42c4fd08fe50 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:58.381498 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2dfabd-445c-4589-bdd2-9fe03935e3bb None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:58.411723 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925908e5-abd6-4c94-860c-42c4fd08fe50 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:58.426303 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7d5d2-dbaa-4914-952d-750417965fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:58.427348 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7d5d2-dbaa-4914-952d-750417965fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:58.427828 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7d5d2-dbaa-4914-952d-750417965fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:58.428298 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7d5d2-dbaa-4914-952d-750417965fe3 None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:58.429341 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7d5d2-dbaa-4914-952d-750417965fe3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:58.429882 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7d5d2-dbaa-4914-952d-750417965fe3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:58.431631 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7d5d2-dbaa-4914-952d-750417965fe3 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:58.449265 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7411ff6-c572-45dc-9ff4-050acdb577cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:58.449820 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 259/528] 10.222.0.24 () {56 vars in 1139 bytes} [Mon May 16 18:54:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:58.450254 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7411ff6-c572-45dc-9ff4-050acdb577cc None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:58.450254 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7411ff6-c572-45dc-9ff4-050acdb577cc None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:58.450524 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7411ff6-c572-45dc-9ff4-050acdb577cc None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:58.451316 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7411ff6-c572-45dc-9ff4-050acdb577cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:58.451630 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7411ff6-c572-45dc-9ff4-050acdb577cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:58.451928 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7d5d2-dbaa-4914-952d-750417965fe3 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:58.453273 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7411ff6-c572-45dc-9ff4-050acdb577cc None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:58.465806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 270/529] 10.222.0.24 () {56 vars in 1148 bytes} [Mon May 16 18:54:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:58.466656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7411ff6-c572-45dc-9ff4-050acdb577cc None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:58.548966 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7d5d2-dbaa-4914-952d-750417965fe3 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:58.563827 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7411ff6-c572-45dc-9ff4-050acdb577cc None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:58.585407 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99760acb-466d-4869-b7ce-999c1d270d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:58.586617 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99760acb-466d-4869-b7ce-999c1d270d5c None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:58.587100 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99760acb-466d-4869-b7ce-999c1d270d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:58.587622 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99760acb-466d-4869-b7ce-999c1d270d5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:58.597677 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e2d34-9f72-443f-9a94-689e8c5fbb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:58.598339 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e2d34-9f72-443f-9a94-689e8c5fbb32 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:58.598622 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e2d34-9f72-443f-9a94-689e8c5fbb32 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:58.598899 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e2d34-9f72-443f-9a94-689e8c5fbb32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:58.599175 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99760acb-466d-4869-b7ce-999c1d270d5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:58.600836 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99760acb-466d-4869-b7ce-999c1d270d5c None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:58.623299 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-99760acb-466d-4869-b7ce-999c1d270d5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:54:58.623299 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:58.623299 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:58.623299 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:58.623299 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:58.623299 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:58.623299 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:58.623299 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:58.623299 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:58.623299 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:58.623299 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:58.623299 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:58.623299 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:54:58.623299 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:54:58.623299 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:54:58.624239 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:54:58.624239 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:58.624239 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:58.624239 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:58.624239 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:58.624239 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:58.624239 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:58.624239 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:58.624239 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:58.624239 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:58.624239 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:58.624239 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:58.624239 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:58.624239 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:58.624239 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:58.624239 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:58.624239 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:58.625074 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:54:58.625074 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:54:58.625074 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:54:58.625074 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:58.625074 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 260/530] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:54:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:58.630726 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99760acb-466d-4869-b7ce-999c1d270d5c None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:58.694719 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e2d34-9f72-443f-9a94-689e8c5fbb32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:58.696213 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e2d34-9f72-443f-9a94-689e8c5fbb32 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:58.742679 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99760acb-466d-4869-b7ce-999c1d270d5c None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:58.776639 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29413cd2-963d-4b63-92c1-5271af90d3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:58.777757 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29413cd2-963d-4b63-92c1-5271af90d3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:58.778254 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29413cd2-963d-4b63-92c1-5271af90d3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:58.778721 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29413cd2-963d-4b63-92c1-5271af90d3a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:58.779749 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29413cd2-963d-4b63-92c1-5271af90d3a9 None admin] RBAC: Adding query filter params (role.id=48c59cffd0c84f83b89761ff42040687, scope.project.id=084e70bbad784892b195bb11a68bf857, user.id=5dfa8e8908804c0e8908e2a8c6b377e0) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:58.780387 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29413cd2-963d-4b63-92c1-5271af90d3a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:58.782093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29413cd2-963d-4b63-92c1-5271af90d3a9 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:58.788187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 261/531] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:54:58 2022] GET /identity/v3/role_assignments?user.id=5dfa8e8908804c0e8908e2a8c6b377e0&scope.project.id=084e70bbad784892b195bb11a68bf857&role.id=48c59cffd0c84f83b89761ff42040687 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:58.789183 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29413cd2-963d-4b63-92c1-5271af90d3a9 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:58.801708 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 271/532] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:54:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:54:58.807723 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e2d34-9f72-443f-9a94-689e8c5fbb32 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:58.891379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29413cd2-963d-4b63-92c1-5271af90d3a9 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:58.925436 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daceab7-07c3-433c-8a18-392fc50bbd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:58.926522 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daceab7-07c3-433c-8a18-392fc50bbd6e None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:58.926997 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daceab7-07c3-433c-8a18-392fc50bbd6e None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:58.927479 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daceab7-07c3-433c-8a18-392fc50bbd6e None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:58.928395 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daceab7-07c3-433c-8a18-392fc50bbd6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:58.928890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daceab7-07c3-433c-8a18-392fc50bbd6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:58.930520 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daceab7-07c3-433c-8a18-392fc50bbd6e None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:58.944012 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 262/533] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:58.950073 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daceab7-07c3-433c-8a18-392fc50bbd6e None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:59.003689 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e2d34-9f72-443f-9a94-689e8c5fbb32 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:59.060366 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daceab7-07c3-433c-8a18-392fc50bbd6e None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:59.093728 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1934a-5be6-4ef7-abd3-2412f8c6cb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:59.095326 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1934a-5be6-4ef7-abd3-2412f8c6cb70 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:59.095810 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1934a-5be6-4ef7-abd3-2412f8c6cb70 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:59.096234 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1934a-5be6-4ef7-abd3-2412f8c6cb70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:59.106181 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04168d-e435-49b1-8949-001f2c26694c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:59.107409 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04168d-e435-49b1-8949-001f2c26694c None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:59.107691 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04168d-e435-49b1-8949-001f2c26694c None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:59.107963 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04168d-e435-49b1-8949-001f2c26694c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:59.109388 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1934a-5be6-4ef7-abd3-2412f8c6cb70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:59.111102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1934a-5be6-4ef7-abd3-2412f8c6cb70 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:59.115960 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04168d-e435-49b1-8949-001f2c26694c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:59.117432 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04168d-e435-49b1-8949-001f2c26694c None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:59.143191 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-35c1934a-5be6-4ef7-abd3-2412f8c6cb70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:54:59.143191 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:59.143191 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:59.143191 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:59.143191 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:59.143191 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:59.143191 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:59.143191 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:59.143191 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:59.143191 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:59.143191 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:59.143191 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:59.143191 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:54:59.143191 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:54:59.143191 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:54:59.144087 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:54:59.144087 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:59.144087 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:59.144087 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:59.144087 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:59.144087 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:59.144087 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:59.144087 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:59.144087 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:54:59.144087 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:59.144087 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:59.144087 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:59.144087 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:59.144087 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:59.144087 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:59.144087 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:59.144087 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:59.145024 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:54:59.145024 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:54:59.145024 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:54:59.145024 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:54:59.148582 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 272/534] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:54:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:59.152403 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1934a-5be6-4ef7-abd3-2412f8c6cb70 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:59.153730 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-2d04168d-e435-49b1-8949-001f2c26694c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:54:59.153730 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:59.153730 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:59.153730 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:59.153730 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:59.153730 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:59.153730 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:59.153730 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:59.153730 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:59.153730 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:59.153730 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:59.153730 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:59.153730 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:54:59.153730 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:54:59.153730 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:54:59.154527 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:54:59.154527 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:59.154527 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:59.154527 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:59.154527 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:59.154527 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:59.154527 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:59.154527 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:59.154527 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:54:59.154527 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:59.154527 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:59.154527 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:59.154527 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:59.154527 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:59.154527 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:59.154527 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:59.154527 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:59.155369 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:54:59.155369 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:54:59.155369 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:54:59.155369 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:54:59.155369 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:54:59.155369 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:54:59.155369 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:54:59.155369 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:54:59.165645 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 263/535] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:54:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:54:59.171722 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04168d-e435-49b1-8949-001f2c26694c None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:59.348802 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1934a-5be6-4ef7-abd3-2412f8c6cb70 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:59.349723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04168d-e435-49b1-8949-001f2c26694c None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:59.385232 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd65a9-f0eb-408a-99e5-5bc8d04e364a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:59.386344 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd65a9-f0eb-408a-99e5-5bc8d04e364a None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:59.386867 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd65a9-f0eb-408a-99e5-5bc8d04e364a None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:59.387328 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd65a9-f0eb-408a-99e5-5bc8d04e364a None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:59.388328 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd65a9-f0eb-408a-99e5-5bc8d04e364a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:59.388925 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd65a9-f0eb-408a-99e5-5bc8d04e364a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:59.390600 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd65a9-f0eb-408a-99e5-5bc8d04e364a None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:59.408950 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 264/536] 10.222.0.24 () {56 vars in 1148 bytes} [Mon May 16 18:54:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:54:59.415443 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd65a9-f0eb-408a-99e5-5bc8d04e364a None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:59.438806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618780d6-dfab-4d9d-be08-01d9056c14d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:59.439491 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618780d6-dfab-4d9d-be08-01d9056c14d3 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:59.439781 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618780d6-dfab-4d9d-be08-01d9056c14d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:59.440055 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618780d6-dfab-4d9d-be08-01d9056c14d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:59.440783 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618780d6-dfab-4d9d-be08-01d9056c14d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:59.441101 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618780d6-dfab-4d9d-be08-01d9056c14d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:59.442601 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618780d6-dfab-4d9d-be08-01d9056c14d3 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:59.473090 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 273/537] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:54:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:54:59.474337 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618780d6-dfab-4d9d-be08-01d9056c14d3 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:59.526199 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd65a9-f0eb-408a-99e5-5bc8d04e364a None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:59.564070 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07dec86-1356-4747-b09b-7cb22cb8e8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:59.564780 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07dec86-1356-4747-b09b-7cb22cb8e8b8 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:59.565066 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07dec86-1356-4747-b09b-7cb22cb8e8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:59.565329 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07dec86-1356-4747-b09b-7cb22cb8e8b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:59.566199 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07dec86-1356-4747-b09b-7cb22cb8e8b8 None admin] RBAC: Adding query filter params (role.id=48c59cffd0c84f83b89761ff42040687, scope.project.id=084e70bbad784892b195bb11a68bf857, user.id=36439df302854b158c85f4fbb5bcb7d6) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:59.566507 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07dec86-1356-4747-b09b-7cb22cb8e8b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:59.570947 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07dec86-1356-4747-b09b-7cb22cb8e8b8 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:59.581993 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 265/538] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:54:59 2022] GET /identity/v3/role_assignments?user.id=36439df302854b158c85f4fbb5bcb7d6&scope.project.id=084e70bbad784892b195bb11a68bf857&role.id=48c59cffd0c84f83b89761ff42040687 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:54:59.651280 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618780d6-dfab-4d9d-be08-01d9056c14d3 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:59.700237 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122a410-9530-46a5-ab53-13762ddd29eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:59.701109 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122a410-9530-46a5-ab53-13762ddd29eb None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:59.701382 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122a410-9530-46a5-ab53-13762ddd29eb None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:59.701756 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122a410-9530-46a5-ab53-13762ddd29eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:59.709112 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c122a410-9530-46a5-ab53-13762ddd29eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:59.710611 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c122a410-9530-46a5-ab53-13762ddd29eb None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:59.731228 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-c122a410-9530-46a5-ab53-13762ddd29eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:54:59.731228 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:54:59.731228 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:54:59.731228 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:54:59.731228 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:54:59.731228 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:54:59.731228 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:54:59.731228 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:54:59.731228 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:54:59.731228 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:54:59.731228 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:54:59.731228 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:54:59.731228 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:54:59.731228 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:54:59.731228 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:54:59.732141 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:54:59.732141 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:54:59.732141 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:54:59.732141 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:54:59.732141 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:54:59.732141 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:54:59.732141 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:54:59.732141 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:54:59.732141 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:54:59.732141 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:54:59.732141 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:54:59.732141 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:54:59.732141 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:54:59.732141 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:54:59.732141 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:54:59.732141 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:54:59.732141 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:54:59.732976 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:54:59.732976 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:54:59.732976 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:54:59.732976 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:54:59.732976 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:54:59.732976 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:54:59.732976 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:54:59.732976 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:54:59.737196 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 274/539] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:54:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:54:59.740747 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07dec86-1356-4747-b09b-7cb22cb8e8b8 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:59.803135 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e94b7-46c0-43e8-a197-b3ea7710c223 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:59.803495 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e94b7-46c0-43e8-a197-b3ea7710c223 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:59.803696 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e94b7-46c0-43e8-a197-b3ea7710c223 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:59.805496 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 275/540] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:54:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:59.810770 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fffb73-ec6b-40e2-959f-2bd80ee4ffd5 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:59.811053 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fffb73-ec6b-40e2-959f-2bd80ee4ffd5 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:59.811335 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fffb73-ec6b-40e2-959f-2bd80ee4ffd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:59.853642 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-b7fffb73-ec6b-40e2-959f-2bd80ee4ffd5 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:59.853642 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b7fffb73-ec6b-40e2-959f-2bd80ee4ffd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:59.869972 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07dec86-1356-4747-b09b-7cb22cb8e8b8 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:59.901003 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77eb52a-1d47-4b83-b36d-98fce156fed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:59.901780 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77eb52a-1d47-4b83-b36d-98fce156fed2 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:59.901997 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77eb52a-1d47-4b83-b36d-98fce156fed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:59.902264 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77eb52a-1d47-4b83-b36d-98fce156fed2 None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:59.903060 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77eb52a-1d47-4b83-b36d-98fce156fed2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:54:59.903366 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77eb52a-1d47-4b83-b36d-98fce156fed2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:59.904929 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77eb52a-1d47-4b83-b36d-98fce156fed2 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:59.923671 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 266/541] 10.222.0.24 () {56 vars in 1148 bytes} [Mon May 16 18:54:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:54:59.925113 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77eb52a-1d47-4b83-b36d-98fce156fed2 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:00.022938 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 276/542] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:54:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:55:00.076597 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77eb52a-1d47-4b83-b36d-98fce156fed2 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:00.114693 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fffb73-ec6b-40e2-959f-2bd80ee4ffd5 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:00.139768 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973af8f1-d031-4982-8f9e-2129dc109ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:00.140441 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973af8f1-d031-4982-8f9e-2129dc109ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:00.140766 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973af8f1-d031-4982-8f9e-2129dc109ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:00.141038 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973af8f1-d031-4982-8f9e-2129dc109ff2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:00.141915 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973af8f1-d031-4982-8f9e-2129dc109ff2 None admin] RBAC: Adding query filter params (role.id=48c59cffd0c84f83b89761ff42040687, scope.project.id=084e70bbad784892b195bb11a68bf857, user.id=ee9e8d17cf1648e0b650df48b8f9487a) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:00.142225 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973af8f1-d031-4982-8f9e-2129dc109ff2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:00.143777 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973af8f1-d031-4982-8f9e-2129dc109ff2 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:00.153751 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 267/543] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:54:59 2022] GET /identity/v3/role_assignments?user.id=ee9e8d17cf1648e0b650df48b8f9487a&scope.project.id=084e70bbad784892b195bb11a68bf857&role.id=48c59cffd0c84f83b89761ff42040687 => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:55:00.248712 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fffb73-ec6b-40e2-959f-2bd80ee4ffd5 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:00.285523 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e96f8e-f9a1-47a8-aeeb-8c20e7afc488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:00.286383 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e96f8e-f9a1-47a8-aeeb-8c20e7afc488 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:00.286663 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e96f8e-f9a1-47a8-aeeb-8c20e7afc488 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:00.286934 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e96f8e-f9a1-47a8-aeeb-8c20e7afc488 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:00.298587 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e96f8e-f9a1-47a8-aeeb-8c20e7afc488 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:55:00.306896 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-d0e96f8e-f9a1-47a8-aeeb-8c20e7afc488 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 18:55:00.306896 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:00.306896 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:00.306896 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:00.306896 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:00.306896 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:00.306896 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:00.306896 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:00.306896 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:00.306896 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:00.306896 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:00.306896 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:00.306896 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:55:00.306896 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:55:00.306896 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:55:00.306896 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:55:00.307862 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:55:00.307862 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:55:00.307862 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:55:00.307862 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:55:00.307862 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:00.307862 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:00.307862 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:00.307862 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:00.307862 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:00.307862 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:00.307862 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:00.307862 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:00.307862 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:00.307862 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:00.307862 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:00.307862 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:00.309095 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:00.309095 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:00.309095 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:00.309095 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:00.309095 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:55:00.309095 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:55:00.309095 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:55:00.309095 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:55:00.309095 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:55:00.309095 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:55:00.309095 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 18:55:00.309095 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:00.309095 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 277/544] 10.222.0.24 () {56 vars in 1102 bytes} [Mon May 16 18:55:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:00.314160 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973af8f1-d031-4982-8f9e-2129dc109ff2 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:00.372763 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a695c-e178-46c7-8d84-8c7a34e58827 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:00.373421 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a695c-e178-46c7-8d84-8c7a34e58827 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:00.373614 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a695c-e178-46c7-8d84-8c7a34e58827 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:00.374907 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 278/545] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:00.380931 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a9950-2c65-458f-843a-89e60fbc42f7 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:00.381238 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a9950-2c65-458f-843a-89e60fbc42f7 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:00.381479 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a9950-2c65-458f-843a-89e60fbc42f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:00.404600 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-030a9950-2c65-458f-843a-89e60fbc42f7 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:00.405978 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-030a9950-2c65-458f-843a-89e60fbc42f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:00.453773 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973af8f1-d031-4982-8f9e-2129dc109ff2 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:00.487343 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21ae04-cbc5-4041-9594-54ed00910513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:00.488323 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21ae04-cbc5-4041-9594-54ed00910513 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:00.488611 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21ae04-cbc5-4041-9594-54ed00910513 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:00.489041 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21ae04-cbc5-4041-9594-54ed00910513 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:00.490145 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21ae04-cbc5-4041-9594-54ed00910513 None admin] RBAC: Adding query filter params (name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:00.490732 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21ae04-cbc5-4041-9594-54ed00910513 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:00.492127 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21ae04-cbc5-4041-9594-54ed00910513 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:00.494086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 279/546] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:55:00.500814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 268/547] 10.222.0.24 () {56 vars in 1103 bytes} [Mon May 16 18:55:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:55:00.506110 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a9950-2c65-458f-843a-89e60fbc42f7 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:00.534960 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21ae04-cbc5-4041-9594-54ed00910513 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:00.680768 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21ae04-cbc5-4041-9594-54ed00910513 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:00.717116 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a9950-2c65-458f-843a-89e60fbc42f7 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:00.717626 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76678318-550c-419c-b1ed-cd90157e821d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:00.718451 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76678318-550c-419c-b1ed-cd90157e821d None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:00.718735 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76678318-550c-419c-b1ed-cd90157e821d None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:00.719009 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76678318-550c-419c-b1ed-cd90157e821d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:00.730860 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76678318-550c-419c-b1ed-cd90157e821d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:55:00.739580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-76678318-550c-419c-b1ed-cd90157e821d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 18:55:00.739580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:00.739580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:00.739580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:00.739580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:00.739580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:00.739580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:00.739580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:00.739580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:00.739580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:00.739580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:00.739580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:00.739580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:55:00.739580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:55:00.739580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:55:00.739580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:55:00.740460 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:55:00.740460 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:55:00.740460 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:55:00.740460 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:55:00.740460 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:00.740460 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:00.740460 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:00.740460 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:00.740460 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:00.740460 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:00.740460 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:00.740460 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:00.740460 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:00.740460 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:00.740460 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:00.740460 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:00.741694 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:00.741694 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:00.741694 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:00.741694 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:00.741694 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:55:00.741694 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:55:00.741694 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:55:00.741694 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:55:00.741694 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:55:00.741694 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:55:00.741694 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 18:55:00.741694 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:00.741694 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 269/548] 10.222.0.24 () {56 vars in 1102 bytes} [Mon May 16 18:55:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:00.746981 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76678318-550c-419c-b1ed-cd90157e821d None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:00.801474 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0667d-ca01-499c-8919-238846eaa1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:00.802338 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0667d-ca01-499c-8919-238846eaa1a6 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:00.802617 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0667d-ca01-499c-8919-238846eaa1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:00.802929 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0667d-ca01-499c-8919-238846eaa1a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:00.821115 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0667d-ca01-499c-8919-238846eaa1a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:00.824940 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0667d-ca01-499c-8919-238846eaa1a6 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:00.861577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-bec0667d-ca01-499c-8919-238846eaa1a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:00.861577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:00.861577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:00.861577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:00.861577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:00.861577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:00.861577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:00.861577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:00.861577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:00.861577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:00.861577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:00.861577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:00.861577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:00.861577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:00.861577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:00.862466 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:00.862466 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:00.862466 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:00.862466 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:00.862466 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:00.862466 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:00.862466 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:00.862466 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:00.862466 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:00.862466 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:00.862466 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:00.862466 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:00.862466 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:00.862466 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:00.862466 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:00.862466 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:00.862466 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:00.863295 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:00.863295 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:00.863295 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:00.863295 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:00.865331 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 280/549] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:55:00.870816 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0667d-ca01-499c-8919-238846eaa1a6 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:00.891622 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76678318-550c-419c-b1ed-cd90157e821d None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:00.953098 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f13fe-1e02-426c-b9c0-1160ba1fd989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:00.954204 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f13fe-1e02-426c-b9c0-1160ba1fd989 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:00.954751 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f13fe-1e02-426c-b9c0-1160ba1fd989 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:00.955207 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f13fe-1e02-426c-b9c0-1160ba1fd989 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:00.956171 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f13fe-1e02-426c-b9c0-1160ba1fd989 None admin] RBAC: Adding query filter params (name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:00.957154 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f13fe-1e02-426c-b9c0-1160ba1fd989 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:00.959435 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f13fe-1e02-426c-b9c0-1160ba1fd989 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:00.977320 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 270/550] 10.222.0.24 () {56 vars in 1103 bytes} [Mon May 16 18:55:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:55:00.979567 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f13fe-1e02-426c-b9c0-1160ba1fd989 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:01.048337 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0667d-ca01-499c-8919-238846eaa1a6 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:01.091711 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f13fe-1e02-426c-b9c0-1160ba1fd989 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:01.130223 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f99c5-c1b8-41c2-b9c4-3da1413a7418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:01.131244 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f99c5-c1b8-41c2-b9c4-3da1413a7418 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:01.132010 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f99c5-c1b8-41c2-b9c4-3da1413a7418 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:01.132976 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f99c5-c1b8-41c2-b9c4-3da1413a7418 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:01.133821 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee99b6-51b9-4e5a-9cdc-6fa00d810eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:01.135004 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee99b6-51b9-4e5a-9cdc-6fa00d810eb7 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:01.135468 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee99b6-51b9-4e5a-9cdc-6fa00d810eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:01.135941 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee99b6-51b9-4e5a-9cdc-6fa00d810eb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:01.138433 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f99c5-c1b8-41c2-b9c4-3da1413a7418 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:01.138759 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f99c5-c1b8-41c2-b9c4-3da1413a7418 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:01.140274 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f99c5-c1b8-41c2-b9c4-3da1413a7418 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:01.148498 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee99b6-51b9-4e5a-9cdc-6fa00d810eb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:01.150572 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee99b6-51b9-4e5a-9cdc-6fa00d810eb7 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:01.168064 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 281/551] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:55:01.173289 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f99c5-c1b8-41c2-b9c4-3da1413a7418 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:01.177620 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-8fee99b6-51b9-4e5a-9cdc-6fa00d810eb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:01.177620 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:01.177620 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:01.177620 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:01.177620 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:01.177620 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:01.177620 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:01.177620 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:01.177620 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:01.177620 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:01.177620 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:01.177620 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:01.177620 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:01.177620 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:01.177620 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:01.178518 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:01.178518 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:01.178518 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:01.178518 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:01.178518 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:01.178518 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:01.178518 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:01.178518 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:01.178518 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:01.178518 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:01.178518 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:01.178518 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:01.178518 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:01.178518 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:01.178518 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:01.178518 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:01.178518 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:01.179321 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:01.179321 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:01.179321 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:01.179321 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:01.181839 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 271/552] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:01.187885 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee99b6-51b9-4e5a-9cdc-6fa00d810eb7 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:01.318554 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee99b6-51b9-4e5a-9cdc-6fa00d810eb7 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:01.351477 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23150119-d58c-4706-846b-734a2afc85a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:01.352510 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23150119-d58c-4706-846b-734a2afc85a6 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:01.353114 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23150119-d58c-4706-846b-734a2afc85a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:01.353609 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23150119-d58c-4706-846b-734a2afc85a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:01.354516 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23150119-d58c-4706-846b-734a2afc85a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:01.355009 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23150119-d58c-4706-846b-734a2afc85a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:01.356618 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23150119-d58c-4706-846b-734a2afc85a6 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:01.368448 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 272/553] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:01.370224 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e141b2-a2fa-4271-9fbe-d24a5fa94072 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:01.370700 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e141b2-a2fa-4271-9fbe-d24a5fa94072 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:01.371155 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e141b2-a2fa-4271-9fbe-d24a5fa94072 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:01.372820 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 273/554] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:01.374537 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e141b2-a2fa-4271-9fbe-d24a5fa94072 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:01.394151 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f99c5-c1b8-41c2-b9c4-3da1413a7418 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:01.435003 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f111c8-b592-4931-95b9-aa83592294f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:01.436514 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f111c8-b592-4931-95b9-aa83592294f1 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:01.437201 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f111c8-b592-4931-95b9-aa83592294f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:01.437639 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f111c8-b592-4931-95b9-aa83592294f1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:01.448348 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f111c8-b592-4931-95b9-aa83592294f1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:01.452194 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f111c8-b592-4931-95b9-aa83592294f1 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:01.472530 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-d8f111c8-b592-4931-95b9-aa83592294f1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 18:55:01.472530 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:01.472530 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:01.472530 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:01.472530 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:01.472530 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:01.472530 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:01.472530 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:01.472530 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:01.472530 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:01.472530 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:01.472530 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:01.472530 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:55:01.472530 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:55:01.472530 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:55:01.472530 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:55:01.473633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:01.473633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:01.473633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:55:01.473633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:01.473633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:55:01.473633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:01.473633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:01.473633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:01.473633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:01.473633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:01.473633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:01.473633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:01.473633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:01.473633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:01.473633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:01.473633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:01.473633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:01.473633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:01.474517 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:01.474517 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:01.474517 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:55:01.474517 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:55:01.474517 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:55:01.474517 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:55:01.474517 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:55:01.474517 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:55:01.474517 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 18:55:01.474517 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:01.477432 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 282/555] 10.222.0.24 () {56 vars in 1093 bytes} [Mon May 16 18:55:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:55:01.479552 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a3285-d7a2-468c-9bd2-8968cd91013e None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:01.480103 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a3285-d7a2-468c-9bd2-8968cd91013e None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:01.480515 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a3285-d7a2-468c-9bd2-8968cd91013e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:01.488914 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e141b2-a2fa-4271-9fbe-d24a5fa94072 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:01.501745 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-686a3285-d7a2-468c-9bd2-8968cd91013e None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:01.503467 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-686a3285-d7a2-468c-9bd2-8968cd91013e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:01.528241 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d7079-a122-4b5d-8307-9bfbe9f5f9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:01.529202 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d7079-a122-4b5d-8307-9bfbe9f5f9b2 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:01.529607 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d7079-a122-4b5d-8307-9bfbe9f5f9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:01.529971 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d7079-a122-4b5d-8307-9bfbe9f5f9b2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:01.539395 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d7079-a122-4b5d-8307-9bfbe9f5f9b2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:01.540908 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d7079-a122-4b5d-8307-9bfbe9f5f9b2 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:01.558260 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-d73d7079-a122-4b5d-8307-9bfbe9f5f9b2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 18:55:01.558260 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:01.558260 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:01.558260 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:01.558260 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:01.558260 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:01.558260 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:01.558260 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:01.558260 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:01.558260 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:01.558260 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:01.558260 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:01.558260 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:55:01.558260 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:55:01.558260 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:55:01.558260 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:55:01.559216 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:01.559216 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:01.559216 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:55:01.559216 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:01.559216 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:55:01.559216 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:01.559216 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:01.559216 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:01.559216 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:01.559216 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:01.559216 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:01.559216 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:01.559216 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:01.559216 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:01.559216 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:01.559216 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:01.559216 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:01.559216 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:01.560103 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:01.560103 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:01.560103 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:55:01.560103 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:55:01.560103 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:55:01.560103 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:55:01.560103 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:55:01.560103 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:55:01.560103 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 18:55:01.560103 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:01.560103 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 274/556] 10.222.0.24 () {56 vars in 1096 bytes} [Mon May 16 18:55:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:01.560654 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d7079-a122-4b5d-8307-9bfbe9f5f9b2 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:01.599950 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 283/557] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:55:01.601301 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a3285-d7a2-468c-9bd2-8968cd91013e None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:01.690238 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d7079-a122-4b5d-8307-9bfbe9f5f9b2 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:01.704143 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a3285-d7a2-468c-9bd2-8968cd91013e None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:01.732351 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba9aef-38a4-470b-a1d4-5a4485f25034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:01.733659 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba9aef-38a4-470b-a1d4-5a4485f25034 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:01.734167 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba9aef-38a4-470b-a1d4-5a4485f25034 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:01.734668 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba9aef-38a4-470b-a1d4-5a4485f25034 None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:01.735939 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba9aef-38a4-470b-a1d4-5a4485f25034 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:01.736475 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba9aef-38a4-470b-a1d4-5a4485f25034 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:01.737144 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba868a1-1473-4f63-8cc1-e1eb3792763f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:01.737942 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba868a1-1473-4f63-8cc1-e1eb3792763f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:01.738309 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba868a1-1473-4f63-8cc1-e1eb3792763f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:01.738583 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba9aef-38a4-470b-a1d4-5a4485f25034 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:01.738741 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba868a1-1473-4f63-8cc1-e1eb3792763f None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:01.739667 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba868a1-1473-4f63-8cc1-e1eb3792763f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:01.740081 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba868a1-1473-4f63-8cc1-e1eb3792763f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:01.742371 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba868a1-1473-4f63-8cc1-e1eb3792763f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:01.764531 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 284/558] 10.222.0.24 () {56 vars in 1135 bytes} [Mon May 16 18:55:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:01.764531 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba868a1-1473-4f63-8cc1-e1eb3792763f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:01.764820 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 275/559] 10.222.0.24 () {56 vars in 1133 bytes} [Mon May 16 18:55:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:01.768457 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba9aef-38a4-470b-a1d4-5a4485f25034 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:01.877993 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba868a1-1473-4f63-8cc1-e1eb3792763f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:01.882648 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba9aef-38a4-470b-a1d4-5a4485f25034 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:01.916551 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8f4df-c084-4e1b-b847-e067e9bce3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:01.917206 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8f4df-c084-4e1b-b847-e067e9bce3f2 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:01.917499 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8f4df-c084-4e1b-b847-e067e9bce3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:01.917784 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8f4df-c084-4e1b-b847-e067e9bce3f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:01.918651 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5fe3c-dcbb-4daa-987d-5419a9500749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:01.919659 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5fe3c-dcbb-4daa-987d-5419a9500749 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:01.920335 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5fe3c-dcbb-4daa-987d-5419a9500749 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:01.920801 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5fe3c-dcbb-4daa-987d-5419a9500749 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:01.931836 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5fe3c-dcbb-4daa-987d-5419a9500749 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:55:01.939669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-b7c5fe3c-dcbb-4daa-987d-5419a9500749 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 18:55:01.939669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:01.939669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:01.939669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:01.939669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:01.939669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:01.939669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:01.939669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:01.939669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:01.939669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:01.939669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:01.939669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:01.939669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:55:01.939669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:55:01.939669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:55:01.939669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:55:01.940589 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:55:01.940589 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:55:01.940589 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:55:01.940589 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:55:01.940589 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:01.940589 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:01.940589 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:01.940589 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:01.940589 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:01.940589 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:01.940589 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:01.940589 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:01.940589 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:01.940589 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:01.940589 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:01.940589 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:01.941360 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:01.941360 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:01.941360 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:01.941360 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:01.941360 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:55:01.941360 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:55:01.941360 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:55:01.941360 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:55:01.941360 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:55:01.941360 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:55:01.941360 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 18:55:01.941360 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:01.946052 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 285/560] 10.222.0.24 () {56 vars in 1102 bytes} [Mon May 16 18:55:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:01.947152 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5fe3c-dcbb-4daa-987d-5419a9500749 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:01.998304 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8f4df-c084-4e1b-b847-e067e9bce3f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:02.000791 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8f4df-c084-4e1b-b847-e067e9bce3f2 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:02.047410 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5fe3c-dcbb-4daa-987d-5419a9500749 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:02.083083 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550961a-3047-4e8e-ac9a-c348b7aee06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:02.084167 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550961a-3047-4e8e-ac9a-c348b7aee06d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:02.084276 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550961a-3047-4e8e-ac9a-c348b7aee06d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:02.084505 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550961a-3047-4e8e-ac9a-c348b7aee06d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:02.096409 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a550961a-3047-4e8e-ac9a-c348b7aee06d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:02.097921 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a550961a-3047-4e8e-ac9a-c348b7aee06d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:02.114928 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 276/561] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:55:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:55:02.116124 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8f4df-c084-4e1b-b847-e067e9bce3f2 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:02.123720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-a550961a-3047-4e8e-ac9a-c348b7aee06d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:02.123720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:02.123720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:02.123720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:02.123720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:02.123720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:02.123720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:02.123720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:02.123720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:02.123720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:02.123720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:02.123720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:02.123720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:02.123720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:02.123720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:02.126059 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:02.126059 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:02.126059 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:02.126059 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:02.126059 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:02.126059 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:02.126059 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:02.126059 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:02.126059 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:02.126059 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:02.126059 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:02.126059 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:02.126059 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:02.126059 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:02.126059 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:02.126059 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:02.126059 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:02.127065 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:02.127065 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:02.127065 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:02.127065 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:02.127065 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 286/562] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:02.127065 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550961a-3047-4e8e-ac9a-c348b7aee06d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:02.222886 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8f4df-c084-4e1b-b847-e067e9bce3f2 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:02.237352 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550961a-3047-4e8e-ac9a-c348b7aee06d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:02.256445 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4189b-982b-4f5f-a16b-62bace91c645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:02.257109 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4189b-982b-4f5f-a16b-62bace91c645 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:02.257387 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4189b-982b-4f5f-a16b-62bace91c645 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:02.257690 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4189b-982b-4f5f-a16b-62bace91c645 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:02.258441 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4189b-982b-4f5f-a16b-62bace91c645 None admin] RBAC: Adding query filter params (name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:02.258742 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4189b-982b-4f5f-a16b-62bace91c645 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:02.260168 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4189b-982b-4f5f-a16b-62bace91c645 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:02.268059 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 277/563] 10.222.0.24 () {56 vars in 1103 bytes} [Mon May 16 18:55:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:02.268868 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4189b-982b-4f5f-a16b-62bace91c645 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:02.277445 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e8bd5-25c1-42e5-84f4-e7fcd2ffbaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:02.278279 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e8bd5-25c1-42e5-84f4-e7fcd2ffbaea None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:02.278558 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e8bd5-25c1-42e5-84f4-e7fcd2ffbaea None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:02.279219 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e8bd5-25c1-42e5-84f4-e7fcd2ffbaea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:02.290744 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e8bd5-25c1-42e5-84f4-e7fcd2ffbaea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:02.292210 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e8bd5-25c1-42e5-84f4-e7fcd2ffbaea None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:02.312212 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-781e8bd5-25c1-42e5-84f4-e7fcd2ffbaea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:02.312212 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:02.312212 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:02.312212 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:02.312212 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:02.312212 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:02.312212 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:02.312212 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:02.312212 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:02.312212 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:02.312212 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:02.312212 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:02.312212 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:02.312212 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:02.312212 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:02.313089 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:02.313089 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:02.313089 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:02.313089 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:02.313089 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:02.313089 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:02.313089 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:02.313089 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:02.313089 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:02.313089 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:02.313089 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:02.313089 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:02.313089 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:02.313089 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:02.313089 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:02.313089 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:02.313089 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:02.314312 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:02.314312 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:02.314312 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:02.314312 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:02.314312 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 287/564] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:02.315002 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076319c4-5b2c-460b-9b9a-9f9eec446553 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:02.315002 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076319c4-5b2c-460b-9b9a-9f9eec446553 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:02.315351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076319c4-5b2c-460b-9b9a-9f9eec446553 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:02.316744 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 288/565] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:02.317291 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076319c4-5b2c-460b-9b9a-9f9eec446553 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:02.380466 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4189b-982b-4f5f-a16b-62bace91c645 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:02.414800 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cf36c-bc99-4894-a3ef-6ab722d811b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:02.415440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cf36c-bc99-4894-a3ef-6ab722d811b5 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:02.415725 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cf36c-bc99-4894-a3ef-6ab722d811b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:02.415995 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cf36c-bc99-4894-a3ef-6ab722d811b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:02.416730 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166cf36c-bc99-4894-a3ef-6ab722d811b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:02.417035 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166cf36c-bc99-4894-a3ef-6ab722d811b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:02.418496 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166cf36c-bc99-4894-a3ef-6ab722d811b5 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:02.418935 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076319c4-5b2c-460b-9b9a-9f9eec446553 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:02.431572 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 278/566] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:02.432470 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cf36c-bc99-4894-a3ef-6ab722d811b5 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:02.466029 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34fb94-7876-4ca4-91f2-9185deaa5ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:02.466840 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34fb94-7876-4ca4-91f2-9185deaa5ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:02.467112 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34fb94-7876-4ca4-91f2-9185deaa5ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:02.467418 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34fb94-7876-4ca4-91f2-9185deaa5ca3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:02.477727 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df34fb94-7876-4ca4-91f2-9185deaa5ca3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:02.479248 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df34fb94-7876-4ca4-91f2-9185deaa5ca3 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:02.496441 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-df34fb94-7876-4ca4-91f2-9185deaa5ca3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:02.496441 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:02.496441 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:02.496441 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:02.496441 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:02.496441 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:02.496441 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:02.496441 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:02.496441 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:02.496441 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:02.496441 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:02.496441 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:02.496441 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:02.496441 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:02.496441 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:02.497319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:02.497319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:02.497319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:02.497319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:02.497319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:02.497319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:02.497319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:02.497319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:02.497319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:02.497319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:02.497319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:02.497319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:02.497319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:02.497319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:02.497319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:02.497319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:02.497319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:02.498244 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:02.498244 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:02.498244 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:02.498244 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:02.498244 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 289/567] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:02.499039 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582e1bf-a480-4821-968a-897d96897575 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:02.499199 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582e1bf-a480-4821-968a-897d96897575 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:02.499481 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582e1bf-a480-4821-968a-897d96897575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:02.516445 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-4582e1bf-a480-4821-968a-897d96897575 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:02.517653 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4582e1bf-a480-4821-968a-897d96897575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:02.538521 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cf36c-bc99-4894-a3ef-6ab722d811b5 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:02.573444 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ef284-fd60-4baf-abdd-528e7ad3dd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:02.574108 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ef284-fd60-4baf-abdd-528e7ad3dd4c None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:02.574411 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ef284-fd60-4baf-abdd-528e7ad3dd4c None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:02.575060 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ef284-fd60-4baf-abdd-528e7ad3dd4c None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:02.575802 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407ef284-fd60-4baf-abdd-528e7ad3dd4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:02.576379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407ef284-fd60-4baf-abdd-528e7ad3dd4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:02.578257 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407ef284-fd60-4baf-abdd-528e7ad3dd4c None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:02.588569 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 290/568] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:55:02.589446 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582e1bf-a480-4821-968a-897d96897575 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:02.592193 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 279/569] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:02.593235 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ef284-fd60-4baf-abdd-528e7ad3dd4c None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:02.687150 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ef284-fd60-4baf-abdd-528e7ad3dd4c None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:02.692359 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582e1bf-a480-4821-968a-897d96897575 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:02.718746 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50386848-d9b8-488e-9af0-781080fbe566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:02.719401 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50386848-d9b8-488e-9af0-781080fbe566 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:02.719682 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50386848-d9b8-488e-9af0-781080fbe566 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:02.719957 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50386848-d9b8-488e-9af0-781080fbe566 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:02.720667 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50386848-d9b8-488e-9af0-781080fbe566 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:02.720972 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50386848-d9b8-488e-9af0-781080fbe566 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:02.722382 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50386848-d9b8-488e-9af0-781080fbe566 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:02.724829 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2db53-5255-4272-be97-2b655b52090e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:02.725651 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2db53-5255-4272-be97-2b655b52090e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:02.725933 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2db53-5255-4272-be97-2b655b52090e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:02.726208 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2db53-5255-4272-be97-2b655b52090e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:02.732769 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf2db53-5255-4272-be97-2b655b52090e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:02.733559 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 280/570] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:02.734251 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf2db53-5255-4272-be97-2b655b52090e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:02.734377 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50386848-d9b8-488e-9af0-781080fbe566 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:02.748681 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-bcf2db53-5255-4272-be97-2b655b52090e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:02.748681 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:02.748681 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:02.748681 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:02.748681 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:02.748681 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:02.748681 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:02.748681 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:02.748681 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:02.748681 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:02.748681 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:02.748681 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:02.748681 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:55:02.748681 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:55:02.748681 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:55:02.749696 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:55:02.749696 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:02.749696 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:02.749696 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:02.749696 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:02.749696 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:02.749696 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:02.749696 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:02.749696 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:02.749696 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:02.749696 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:02.749696 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:02.749696 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:02.749696 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:02.749696 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:02.749696 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:02.749696 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:02.751024 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:55:02.751024 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:55:02.751024 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:55:02.751024 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:55:02.751024 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:55:02.751024 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:55:02.751024 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:02.751024 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:02.751024 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 291/571] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:55:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:02.751024 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2db53-5255-4272-be97-2b655b52090e None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:02.831315 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50386848-d9b8-488e-9af0-781080fbe566 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:02.844765 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2db53-5255-4272-be97-2b655b52090e None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:02.863782 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084d978-2cf1-466f-9b1e-c7f6a502fcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:02.864544 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084d978-2cf1-466f-9b1e-c7f6a502fcf6 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:02.864851 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084d978-2cf1-466f-9b1e-c7f6a502fcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:02.865116 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084d978-2cf1-466f-9b1e-c7f6a502fcf6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:02.871472 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084d978-2cf1-466f-9b1e-c7f6a502fcf6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:02.872936 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084d978-2cf1-466f-9b1e-c7f6a502fcf6 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:02.876328 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45abd795-8431-4699-a0cf-42b55e73f72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:02.877106 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abd795-8431-4699-a0cf-42b55e73f72b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:02.877377 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abd795-8431-4699-a0cf-42b55e73f72b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:02.877669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abd795-8431-4699-a0cf-42b55e73f72b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:02.886187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-3084d978-2cf1-466f-9b1e-c7f6a502fcf6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:02.886187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:02.886187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:02.886187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:02.886187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:02.886187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:02.886187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:02.886187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:02.886187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:02.886187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:02.886187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:02.886187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:02.886187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:55:02.886187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:55:02.886187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:55:02.887061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:55:02.887061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:02.887061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:02.887061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:02.887061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:02.887061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:02.887061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:02.887061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:02.887061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:02.887061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:02.887061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:02.887061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:02.887061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:02.887061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:02.887061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:02.887061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:02.887061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:02.887924 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:55:02.887924 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:55:02.887924 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:55:02.887924 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:55:02.887924 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:55:02.887924 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:55:02.887924 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:02.887924 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:02.887924 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 281/572] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:55:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:02.888492 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45abd795-8431-4699-a0cf-42b55e73f72b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:55:02.888571 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cabf8-3b71-42f7-8f04-7cfa46c69af6 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:02.888967 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cabf8-3b71-42f7-8f04-7cfa46c69af6 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:02.889059 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cabf8-3b71-42f7-8f04-7cfa46c69af6 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:02.890484 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 282/573] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:02.890981 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cabf8-3b71-42f7-8f04-7cfa46c69af6 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:02.896355 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-45abd795-8431-4699-a0cf-42b55e73f72b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 18:55:02.896355 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:02.896355 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:02.896355 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:02.896355 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:02.896355 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:02.896355 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:02.896355 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:02.896355 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:02.896355 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:02.896355 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:02.896355 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:02.896355 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:55:02.896355 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:55:02.896355 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:55:02.896355 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:55:02.897445 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:55:02.897445 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:55:02.897445 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:55:02.897445 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:55:02.897445 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:02.897445 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:02.897445 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:02.897445 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:02.897445 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:02.897445 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:02.897445 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:02.897445 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:02.897445 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:02.897445 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:02.897445 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:02.897445 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:02.898403 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:02.898403 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:02.898403 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:02.898403 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:02.898403 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:55:02.898403 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:55:02.898403 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:55:02.898403 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:55:02.898403 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:55:02.898403 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:55:02.898403 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 18:55:02.898403 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:02.898403 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 292/574] 10.222.0.24 () {56 vars in 1102 bytes} [Mon May 16 18:55:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:02.899212 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45abd795-8431-4699-a0cf-42b55e73f72b None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:02.986325 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cabf8-3b71-42f7-8f04-7cfa46c69af6 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:02.995288 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45abd795-8431-4699-a0cf-42b55e73f72b None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:03.017753 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4aaa92-986c-423f-a206-4727f1109fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:03.018551 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4aaa92-986c-423f-a206-4727f1109fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:03.018828 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4aaa92-986c-423f-a206-4727f1109fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:03.019084 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4aaa92-986c-423f-a206-4727f1109fe4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:03.025938 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4aaa92-986c-423f-a206-4727f1109fe4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:03.027405 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4aaa92-986c-423f-a206-4727f1109fe4 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:03.027642 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d98f0-4f47-4741-930e-042c4d045f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:03.028299 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d98f0-4f47-4741-930e-042c4d045f69 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:03.028581 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d98f0-4f47-4741-930e-042c4d045f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:03.028841 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d98f0-4f47-4741-930e-042c4d045f69 None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:03.029666 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d98f0-4f47-4741-930e-042c4d045f69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:03.029974 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d98f0-4f47-4741-930e-042c4d045f69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:03.031481 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d98f0-4f47-4741-930e-042c4d045f69 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:03.042019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-1b4aaa92-986c-423f-a206-4727f1109fe4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 16 18:55:03.042019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:03.042019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:03.042019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:03.042019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:03.042019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:03.042019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:03.042019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:03.042019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:03.042019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:03.042019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:03.042019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:03.042019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:55:03.042019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:55:03.042019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:55:03.042019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:55:03.043057 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:03.043057 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:03.043057 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:55:03.043057 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:03.043057 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:55:03.043057 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:03.043057 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:03.043057 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:03.043057 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:03.043057 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:03.043057 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:03.043057 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:03.043057 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:03.043057 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:03.043057 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:03.043057 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:03.043057 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:03.043057 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:03.044062 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:03.044062 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:03.044062 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:55:03.044062 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:55:03.044062 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:55:03.044062 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:55:03.044062 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:55:03.044062 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:55:03.044062 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 16 18:55:03.044062 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:03.044572 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 293/575] 10.222.0.24 () {56 vars in 1148 bytes} [Mon May 16 18:55:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:03.044727 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d98f0-4f47-4741-930e-042c4d045f69 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:03.045810 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 283/576] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:55:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:03.047374 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22eea5-da26-4228-890c-6f3154bd0f0f None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:03.048639 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22eea5-da26-4228-890c-6f3154bd0f0f None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:03.048928 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22eea5-da26-4228-890c-6f3154bd0f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:03.064831 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-ec22eea5-da26-4228-890c-6f3154bd0f0f None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:03.066071 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-ec22eea5-da26-4228-890c-6f3154bd0f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:03.131420 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 284/577] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:55:03.132394 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22eea5-da26-4228-890c-6f3154bd0f0f None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:03.147019 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d98f0-4f47-4741-930e-042c4d045f69 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:03.180523 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a8136-eff8-426f-ac65-dc99dd713499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:03.181316 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a8136-eff8-426f-ac65-dc99dd713499 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:03.181610 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a8136-eff8-426f-ac65-dc99dd713499 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:03.181877 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a8136-eff8-426f-ac65-dc99dd713499 None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:03.182653 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a8136-eff8-426f-ac65-dc99dd713499 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:03.182951 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a8136-eff8-426f-ac65-dc99dd713499 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:03.184383 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a8136-eff8-426f-ac65-dc99dd713499 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:03.195336 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 294/578] 10.222.0.24 () {56 vars in 1148 bytes} [Mon May 16 18:55:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:03.196098 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a8136-eff8-426f-ac65-dc99dd713499 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:03.228906 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22eea5-da26-4228-890c-6f3154bd0f0f None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:03.261811 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec020d-523c-4fbb-ac9f-2a72cdb2d03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:03.262448 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec020d-523c-4fbb-ac9f-2a72cdb2d03c None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:03.262733 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec020d-523c-4fbb-ac9f-2a72cdb2d03c None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:03.263008 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec020d-523c-4fbb-ac9f-2a72cdb2d03c None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:03.263760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec020d-523c-4fbb-ac9f-2a72cdb2d03c None admin] RBAC: Adding query filter params (name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:03.264068 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec020d-523c-4fbb-ac9f-2a72cdb2d03c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:03.265452 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec020d-523c-4fbb-ac9f-2a72cdb2d03c None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:03.273059 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 285/579] 10.222.0.24 () {56 vars in 1103 bytes} [Mon May 16 18:55:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:03.273949 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec020d-523c-4fbb-ac9f-2a72cdb2d03c None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:03.288174 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a8136-eff8-426f-ac65-dc99dd713499 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:03.320117 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41d539-900a-472b-ab17-c1790ba47adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:03.320788 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41d539-900a-472b-ab17-c1790ba47adc None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:03.321066 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41d539-900a-472b-ab17-c1790ba47adc None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:03.321335 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41d539-900a-472b-ab17-c1790ba47adc None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:03.322284 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41d539-900a-472b-ab17-c1790ba47adc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:03.322597 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41d539-900a-472b-ab17-c1790ba47adc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:03.324044 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41d539-900a-472b-ab17-c1790ba47adc None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:03.340259 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 295/580] 10.222.0.24 () {56 vars in 1137 bytes} [Mon May 16 18:55:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:03.341047 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41d539-900a-472b-ab17-c1790ba47adc None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:03.367259 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec020d-523c-4fbb-ac9f-2a72cdb2d03c None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:03.400046 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80363b46-9d1b-431c-81dc-02e09da0b2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:03.400933 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80363b46-9d1b-431c-81dc-02e09da0b2db None admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:03.401213 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80363b46-9d1b-431c-81dc-02e09da0b2db None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:03.401483 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80363b46-9d1b-431c-81dc-02e09da0b2db None admin] PATH_INFO: `/v3/projects/084e70bbad784892b195bb11a68bf857/users/1f03aa520ee14615b802cdbc3cd4f87d/roles/48c59cffd0c84f83b89761ff42040687` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:03.415177 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80363b46-9d1b-431c-81dc-02e09da0b2db None admin] RBAC: Authorizing `identity:create_grant(project_id=084e70bbad784892b195bb11a68bf857, user_id=1f03aa520ee14615b802cdbc3cd4f87d, role_id=48c59cffd0c84f83b89761ff42040687)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:03.416698 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80363b46-9d1b-431c-81dc-02e09da0b2db None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:03.428533 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 286/581] 10.222.0.24 () {58 vars in 1439 bytes} [Mon May 16 18:55:03 2022] PUT /identity/v3/projects/084e70bbad784892b195bb11a68bf857/users/1f03aa520ee14615b802cdbc3cd4f87d/roles/48c59cffd0c84f83b89761ff42040687 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:55:03.429321 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80363b46-9d1b-431c-81dc-02e09da0b2db None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:03.444845 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41d539-900a-472b-ab17-c1790ba47adc None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:03.481436 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1ed80-5e09-4940-87a7-62049c00bb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:03.482302 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1ed80-5e09-4940-87a7-62049c00bb0a None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:03.482583 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1ed80-5e09-4940-87a7-62049c00bb0a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:03.482861 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1ed80-5e09-4940-87a7-62049c00bb0a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:03.496707 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1ed80-5e09-4940-87a7-62049c00bb0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:55:03.504749 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-47a1ed80-5e09-4940-87a7-62049c00bb0a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 18:55:03.504749 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:03.504749 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:03.504749 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:03.504749 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:03.504749 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:03.504749 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:03.504749 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:03.504749 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:03.504749 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:03.504749 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:03.504749 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:03.504749 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:55:03.504749 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:55:03.504749 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:55:03.504749 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:55:03.505867 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:55:03.505867 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:55:03.505867 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:55:03.505867 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:55:03.505867 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:03.505867 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:03.505867 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:03.505867 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:03.505867 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:03.505867 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:03.505867 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:03.505867 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:03.505867 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:03.505867 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:03.505867 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:03.505867 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:03.506709 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:03.506709 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:03.506709 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:03.506709 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:03.506709 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:55:03.506709 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:55:03.506709 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:55:03.506709 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:55:03.506709 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:55:03.506709 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:55:03.506709 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 18:55:03.506709 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:03.506709 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 296/582] 10.222.0.24 () {56 vars in 1102 bytes} [Mon May 16 18:55:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:03.507394 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1ed80-5e09-4940-87a7-62049c00bb0a None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:03.547680 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80363b46-9d1b-431c-81dc-02e09da0b2db None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:03.583017 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b99a3-b248-4f3e-9077-9c6bf25b092a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:03.583712 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b99a3-b248-4f3e-9077-9c6bf25b092a None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:03.583973 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b99a3-b248-4f3e-9077-9c6bf25b092a None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:03.584226 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b99a3-b248-4f3e-9077-9c6bf25b092a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:03.585067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b99a3-b248-4f3e-9077-9c6bf25b092a None admin] RBAC: Adding query filter params (role.id=48c59cffd0c84f83b89761ff42040687, scope.project.id=084e70bbad784892b195bb11a68bf857, user.id=654e435a35c4491eb87943734ce280f4) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:03.585374 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b99a3-b248-4f3e-9077-9c6bf25b092a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:03.586864 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b99a3-b248-4f3e-9077-9c6bf25b092a None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:03.592791 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 287/583] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:55:03 2022] GET /identity/v3/role_assignments?user.id=654e435a35c4491eb87943734ce280f4&scope.project.id=084e70bbad784892b195bb11a68bf857&role.id=48c59cffd0c84f83b89761ff42040687 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:03.593695 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b99a3-b248-4f3e-9077-9c6bf25b092a None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:03.626232 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1ed80-5e09-4940-87a7-62049c00bb0a None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:03.665800 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe92f5f-590a-4766-a488-94ad6b8a1885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:03.666692 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe92f5f-590a-4766-a488-94ad6b8a1885 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:03.666973 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe92f5f-590a-4766-a488-94ad6b8a1885 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:03.667344 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe92f5f-590a-4766-a488-94ad6b8a1885 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:03.679399 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe92f5f-590a-4766-a488-94ad6b8a1885 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:03.680647 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe92f5f-590a-4766-a488-94ad6b8a1885 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:03.699525 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-5fe92f5f-590a-4766-a488-94ad6b8a1885 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:03.699525 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:03.699525 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:03.699525 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:03.699525 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:03.699525 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:03.699525 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:03.699525 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:03.699525 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:03.699525 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:03.699525 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:03.699525 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:03.699525 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:03.699525 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:03.699525 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:03.700495 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:03.700495 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:03.700495 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:03.700495 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:03.700495 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:03.700495 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:03.700495 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:03.700495 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:03.700495 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:03.700495 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:03.700495 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:03.700495 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:03.700495 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:03.700495 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:03.700495 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:03.700495 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:03.700495 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:03.701384 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:03.701384 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:03.701384 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:03.701384 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:03.701384 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 297/584] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:03.701700 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe92f5f-590a-4766-a488-94ad6b8a1885 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:03.717812 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b99a3-b248-4f3e-9077-9c6bf25b092a None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:03.753563 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e1d68-604d-4bee-af99-94d0837aae7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:03.754793 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e1d68-604d-4bee-af99-94d0837aae7c None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:03.755308 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e1d68-604d-4bee-af99-94d0837aae7c None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:03.755802 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e1d68-604d-4bee-af99-94d0837aae7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:03.767745 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e1d68-604d-4bee-af99-94d0837aae7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:03.769686 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e1d68-604d-4bee-af99-94d0837aae7c None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:03.788554 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-f83e1d68-604d-4bee-af99-94d0837aae7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:03.788554 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:03.788554 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:03.788554 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:03.788554 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:03.788554 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:03.788554 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:03.788554 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:03.788554 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:03.788554 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:03.788554 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:03.788554 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:03.788554 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:03.788554 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:03.788554 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:03.789649 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:03.789649 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:03.789649 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:03.789649 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:03.789649 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:03.789649 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:03.789649 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:03.789649 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:03.789649 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:03.789649 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:03.789649 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:03.789649 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:03.789649 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:03.789649 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:03.789649 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:03.789649 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:03.789649 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:03.790612 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:03.790612 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:03.790612 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:03.790612 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:03.792975 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 288/585] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:03.794112 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e1d68-604d-4bee-af99-94d0837aae7c None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:03.807627 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe92f5f-590a-4766-a488-94ad6b8a1885 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:03.859704 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac3189-7ea6-47d7-b2a6-b18d9d8f1a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:03.861003 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac3189-7ea6-47d7-b2a6-b18d9d8f1a0d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:03.861485 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac3189-7ea6-47d7-b2a6-b18d9d8f1a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:03.862148 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac3189-7ea6-47d7-b2a6-b18d9d8f1a0d None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:03.863546 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac3189-7ea6-47d7-b2a6-b18d9d8f1a0d None admin] RBAC: Adding query filter params (name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:03.864304 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac3189-7ea6-47d7-b2a6-b18d9d8f1a0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:03.865992 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac3189-7ea6-47d7-b2a6-b18d9d8f1a0d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:03.877321 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 298/586] 10.222.0.24 () {56 vars in 1103 bytes} [Mon May 16 18:55:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:03.878992 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac3189-7ea6-47d7-b2a6-b18d9d8f1a0d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:03.917960 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e1d68-604d-4bee-af99-94d0837aae7c None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:03.959988 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2f0c0-c14c-4fd8-a7cc-13da51819650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:03.960911 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2f0c0-c14c-4fd8-a7cc-13da51819650 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:03.961430 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2f0c0-c14c-4fd8-a7cc-13da51819650 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:03.961893 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2f0c0-c14c-4fd8-a7cc-13da51819650 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:03.963393 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2f0c0-c14c-4fd8-a7cc-13da51819650 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:03.963853 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2f0c0-c14c-4fd8-a7cc-13da51819650 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:03.965772 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2f0c0-c14c-4fd8-a7cc-13da51819650 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:03.981608 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 289/587] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:03.982700 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2f0c0-c14c-4fd8-a7cc-13da51819650 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:03.993139 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac3189-7ea6-47d7-b2a6-b18d9d8f1a0d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:04.029555 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deab6ba-8340-4096-9bf5-1c469423c143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:04.030433 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deab6ba-8340-4096-9bf5-1c469423c143 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:04.030807 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deab6ba-8340-4096-9bf5-1c469423c143 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:04.031192 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deab6ba-8340-4096-9bf5-1c469423c143 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:04.032005 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deab6ba-8340-4096-9bf5-1c469423c143 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:04.032402 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deab6ba-8340-4096-9bf5-1c469423c143 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:04.033987 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deab6ba-8340-4096-9bf5-1c469423c143 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:04.047397 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 299/588] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:04.048494 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deab6ba-8340-4096-9bf5-1c469423c143 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:04.099637 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2f0c0-c14c-4fd8-a7cc-13da51819650 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:04.148590 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2b89d-41b1-441a-bf70-107565080c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:04.149978 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2b89d-41b1-441a-bf70-107565080c02 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:04.150400 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2b89d-41b1-441a-bf70-107565080c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:04.150963 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2b89d-41b1-441a-bf70-107565080c02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:04.154445 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deab6ba-8340-4096-9bf5-1c469423c143 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:04.164479 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a2b89d-41b1-441a-bf70-107565080c02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:04.166259 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a2b89d-41b1-441a-bf70-107565080c02 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:04.189858 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-35a2b89d-41b1-441a-bf70-107565080c02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:04.189858 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:04.189858 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:04.189858 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:04.189858 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:04.189858 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:04.189858 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:04.189858 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:04.189858 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:04.189858 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:04.189858 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:04.189858 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:04.189858 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:04.189858 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:04.189858 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:04.190936 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:04.190936 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:04.190936 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:04.190936 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:04.190936 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:04.190936 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:04.190936 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:04.190936 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:04.190936 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:04.190936 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:04.190936 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:04.190936 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:04.190936 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:04.190936 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:04.190936 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:04.190936 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:04.190936 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:04.192029 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:04.192029 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:04.192029 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:04.192029 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:04.193847 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 290/589] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:04.194766 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2b89d-41b1-441a-bf70-107565080c02 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:04.201321 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b2b1c-59c6-4d34-8336-a27e17c60c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:04.202279 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b2b1c-59c6-4d34-8336-a27e17c60c3c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:04.202655 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b2b1c-59c6-4d34-8336-a27e17c60c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:04.203017 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b2b1c-59c6-4d34-8336-a27e17c60c3c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:04.211311 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b2b1c-59c6-4d34-8336-a27e17c60c3c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:04.213847 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b2b1c-59c6-4d34-8336-a27e17c60c3c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:04.229035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-6b1b2b1c-59c6-4d34-8336-a27e17c60c3c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 16 18:55:04.229035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:04.229035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:04.229035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:04.229035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:04.229035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:04.229035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:04.229035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:04.229035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:04.229035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:04.229035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:04.229035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:04.229035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:55:04.229035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:55:04.229035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:55:04.229035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:55:04.230219 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:04.230219 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:04.230219 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:55:04.230219 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:04.230219 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:55:04.230219 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:04.230219 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:04.230219 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:04.230219 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:04.230219 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:04.230219 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:04.230219 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:04.230219 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:04.230219 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:04.230219 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:04.230219 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:04.230219 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:04.230219 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:04.231351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:04.231351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:04.231351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:55:04.231351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:55:04.231351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:55:04.231351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:55:04.231351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:55:04.231351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:55:04.231351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 16 18:55:04.231351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:04.233929 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 300/590] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:55:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:04.239090 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b2b1c-59c6-4d34-8336-a27e17c60c3c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:04.307906 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2b89d-41b1-441a-bf70-107565080c02 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:04.337662 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b2b1c-59c6-4d34-8336-a27e17c60c3c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:04.342348 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811f731-6e86-48af-9d8e-193e4b3b950e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:04.343323 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811f731-6e86-48af-9d8e-193e4b3b950e None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:04.343750 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811f731-6e86-48af-9d8e-193e4b3b950e None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:04.344187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811f731-6e86-48af-9d8e-193e4b3b950e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:04.352334 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5811f731-6e86-48af-9d8e-193e4b3b950e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:04.354651 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5811f731-6e86-48af-9d8e-193e4b3b950e None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:04.371637 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-5811f731-6e86-48af-9d8e-193e4b3b950e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:04.371637 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:04.371637 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:04.371637 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:04.371637 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:04.371637 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:04.371637 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:04.371637 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:04.371637 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:04.371637 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:04.371637 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:04.371637 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:04.371637 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:55:04.371637 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:55:04.371637 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:55:04.372745 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:55:04.372745 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:04.372745 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:04.372745 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:04.372745 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:04.372745 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:04.372745 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:04.372745 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:04.372745 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:04.372745 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:04.372745 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:04.372745 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:04.372745 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:04.372745 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:04.372745 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:04.372745 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:04.372745 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:04.373829 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:55:04.373829 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:55:04.373829 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:55:04.373829 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:55:04.373829 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:55:04.373829 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:55:04.373829 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:04.373829 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:04.376611 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 291/591] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:55:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:04.377564 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811f731-6e86-48af-9d8e-193e4b3b950e None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:04.387228 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4fe4e-40ee-476d-abb5-633829a31c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:04.387903 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4fe4e-40ee-476d-abb5-633829a31c5b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:04.388177 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4fe4e-40ee-476d-abb5-633829a31c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:04.388445 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4fe4e-40ee-476d-abb5-633829a31c5b None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:04.389165 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4fe4e-40ee-476d-abb5-633829a31c5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:04.389466 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4fe4e-40ee-476d-abb5-633829a31c5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:04.390875 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4fe4e-40ee-476d-abb5-633829a31c5b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:04.402696 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 301/592] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:04.403612 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4fe4e-40ee-476d-abb5-633829a31c5b None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:04.497458 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811f731-6e86-48af-9d8e-193e4b3b950e None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:04.510792 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4fe4e-40ee-476d-abb5-633829a31c5b None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:04.538275 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f198289-d941-4797-9d90-a5610a6b09bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:04.539832 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f198289-d941-4797-9d90-a5610a6b09bb None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:04.540361 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f198289-d941-4797-9d90-a5610a6b09bb None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:04.540874 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f198289-d941-4797-9d90-a5610a6b09bb None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:04.541962 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f198289-d941-4797-9d90-a5610a6b09bb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:04.542488 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f198289-d941-4797-9d90-a5610a6b09bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:04.543401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593f187-0519-466b-9340-8ea896bd0770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:04.544062 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593f187-0519-466b-9340-8ea896bd0770 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:04.544334 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593f187-0519-466b-9340-8ea896bd0770 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:04.544601 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593f187-0519-466b-9340-8ea896bd0770 None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:04.545025 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f198289-d941-4797-9d90-a5610a6b09bb None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:04.545378 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593f187-0519-466b-9340-8ea896bd0770 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:04.545709 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593f187-0519-466b-9340-8ea896bd0770 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:04.547359 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593f187-0519-466b-9340-8ea896bd0770 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:04.564634 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 292/594] 10.222.0.24 () {56 vars in 1137 bytes} [Mon May 16 18:55:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:04.564823 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 302/594] 10.222.0.24 () {56 vars in 1148 bytes} [Mon May 16 18:55:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:04.565648 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593f187-0519-466b-9340-8ea896bd0770 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:04.566132 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f198289-d941-4797-9d90-a5610a6b09bb None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:04.666583 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593f187-0519-466b-9340-8ea896bd0770 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:04.689086 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f198289-d941-4797-9d90-a5610a6b09bb None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:04.705137 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defbf23-3697-428c-b8ed-149c8c78080f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:04.706696 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defbf23-3697-428c-b8ed-149c8c78080f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:04.708582 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defbf23-3697-428c-b8ed-149c8c78080f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:04.708582 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defbf23-3697-428c-b8ed-149c8c78080f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:04.716739 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6defbf23-3697-428c-b8ed-149c8c78080f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:04.718850 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6defbf23-3697-428c-b8ed-149c8c78080f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:04.728523 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12109dff-0628-43e2-b29b-29b743813ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:04.729557 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12109dff-0628-43e2-b29b-29b743813ba2 None admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:04.729898 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12109dff-0628-43e2-b29b-29b743813ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:04.730372 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12109dff-0628-43e2-b29b-29b743813ba2 None admin] PATH_INFO: `/v3/projects/084e70bbad784892b195bb11a68bf857/users/5dfa8e8908804c0e8908e2a8c6b377e0/roles/48c59cffd0c84f83b89761ff42040687` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:04.736735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-6defbf23-3697-428c-b8ed-149c8c78080f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 16 18:55:04.736735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:04.736735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:04.736735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:04.736735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:04.736735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:04.736735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:04.736735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:04.736735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:04.736735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:04.736735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:04.736735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:04.736735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:55:04.736735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:55:04.736735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:55:04.736735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:55:04.737740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:04.737740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:04.737740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:55:04.737740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:04.737740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:55:04.737740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:04.737740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:04.737740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:04.737740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:04.737740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:04.737740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:04.737740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:04.737740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:04.737740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:04.737740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:04.737740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:04.737740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:04.737740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:04.738718 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:04.738718 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:04.738718 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:55:04.738718 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:55:04.738718 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:55:04.738718 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:55:04.738718 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:55:04.738718 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:55:04.738718 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 16 18:55:04.738718 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:04.738718 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 303/595] 10.222.0.24 () {56 vars in 1102 bytes} [Mon May 16 18:55:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:04.739573 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defbf23-3697-428c-b8ed-149c8c78080f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:04.747609 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12109dff-0628-43e2-b29b-29b743813ba2 None admin] RBAC: Authorizing `identity:create_grant(project_id=084e70bbad784892b195bb11a68bf857, user_id=5dfa8e8908804c0e8908e2a8c6b377e0, role_id=48c59cffd0c84f83b89761ff42040687)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:04.749222 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12109dff-0628-43e2-b29b-29b743813ba2 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:04.768641 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 293/596] 10.222.0.24 () {58 vars in 1439 bytes} [Mon May 16 18:55:04 2022] PUT /identity/v3/projects/084e70bbad784892b195bb11a68bf857/users/5dfa8e8908804c0e8908e2a8c6b377e0/roles/48c59cffd0c84f83b89761ff42040687 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:55:04.769822 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12109dff-0628-43e2-b29b-29b743813ba2 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:04.888100 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12109dff-0628-43e2-b29b-29b743813ba2 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:04.951344 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57bc0c3-f73f-47a5-8edb-4fb86cd592cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:04.952117 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bc0c3-f73f-47a5-8edb-4fb86cd592cb None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:04.952404 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bc0c3-f73f-47a5-8edb-4fb86cd592cb None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:04.952677 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bc0c3-f73f-47a5-8edb-4fb86cd592cb None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:04.953641 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57bc0c3-f73f-47a5-8edb-4fb86cd592cb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:04.953961 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57bc0c3-f73f-47a5-8edb-4fb86cd592cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:04.960874 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57bc0c3-f73f-47a5-8edb-4fb86cd592cb None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:04.989768 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defbf23-3697-428c-b8ed-149c8c78080f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:04.993176 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 294/597] 10.222.0.24 () {56 vars in 1139 bytes} [Mon May 16 18:55:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:05.009752 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57bc0c3-f73f-47a5-8edb-4fb86cd592cb None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:05.109258 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b39c32-428c-4c0a-b0b4-df8e9571692f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:05.110800 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b39c32-428c-4c0a-b0b4-df8e9571692f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:05.113550 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b39c32-428c-4c0a-b0b4-df8e9571692f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:05.113550 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b39c32-428c-4c0a-b0b4-df8e9571692f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:05.128067 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b39c32-428c-4c0a-b0b4-df8e9571692f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:05.128067 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b39c32-428c-4c0a-b0b4-df8e9571692f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:05.147766 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57bc0c3-f73f-47a5-8edb-4fb86cd592cb None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:05.163675 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-a8b39c32-428c-4c0a-b0b4-df8e9571692f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:05.163675 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:05.163675 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:05.163675 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:05.163675 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:05.163675 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:05.163675 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:05.163675 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:05.163675 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:05.163675 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:05.163675 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:05.163675 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:05.163675 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:05.163675 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:05.163675 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:05.164626 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:05.164626 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:05.164626 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:05.164626 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:05.164626 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:05.164626 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:05.164626 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:05.164626 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:05.164626 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:05.164626 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:05.164626 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:05.164626 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:05.164626 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:05.164626 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:05.164626 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:05.164626 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:05.164626 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:05.165642 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:05.165642 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:05.165642 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:05.165642 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:05.165642 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 304/598] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 423 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:05.173627 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b39c32-428c-4c0a-b0b4-df8e9571692f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:05.195864 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094babd-5e26-4b11-b5df-ed6ab8909d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:05.197290 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094babd-5e26-4b11-b5df-ed6ab8909d5f None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:05.197290 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094babd-5e26-4b11-b5df-ed6ab8909d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:05.197476 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094babd-5e26-4b11-b5df-ed6ab8909d5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:05.221640 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a094babd-5e26-4b11-b5df-ed6ab8909d5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:05.221640 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a094babd-5e26-4b11-b5df-ed6ab8909d5f None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:05.253390 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-a094babd-5e26-4b11-b5df-ed6ab8909d5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:05.253390 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:05.253390 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:05.253390 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:05.253390 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:05.253390 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:05.253390 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:05.253390 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:05.253390 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:05.253390 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:05.253390 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:05.253390 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:05.253390 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:05.253390 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:05.253390 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:05.254376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:05.254376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:05.254376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:05.254376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:05.254376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:05.254376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:05.254376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:05.254376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:05.254376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:05.254376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:05.254376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:05.254376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:05.254376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:05.254376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:05.254376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:05.254376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:05.254376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:05.255260 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:05.255260 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:05.255260 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:05.255260 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:05.261573 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 295/599] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:05.275009 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094babd-5e26-4b11-b5df-ed6ab8909d5f None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:05.429572 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b39c32-428c-4c0a-b0b4-df8e9571692f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:05.521640 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094babd-5e26-4b11-b5df-ed6ab8909d5f None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:05.542925 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef8d72-50ac-4472-a12d-bb48479b2919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:05.544169 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef8d72-50ac-4472-a12d-bb48479b2919 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:05.544674 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef8d72-50ac-4472-a12d-bb48479b2919 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:05.545154 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef8d72-50ac-4472-a12d-bb48479b2919 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:05.546138 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef8d72-50ac-4472-a12d-bb48479b2919 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:05.546652 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef8d72-50ac-4472-a12d-bb48479b2919 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:05.548263 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef8d72-50ac-4472-a12d-bb48479b2919 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:05.572440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57d3b0-6912-486f-806b-4b73e3ba3289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:05.572815 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57d3b0-6912-486f-806b-4b73e3ba3289 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:05.572918 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57d3b0-6912-486f-806b-4b73e3ba3289 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:05.573202 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57d3b0-6912-486f-806b-4b73e3ba3289 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:05.574010 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c57d3b0-6912-486f-806b-4b73e3ba3289 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:05.574314 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c57d3b0-6912-486f-806b-4b73e3ba3289 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:05.575923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c57d3b0-6912-486f-806b-4b73e3ba3289 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:05.591378 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 305/600] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:05.597557 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 296/601] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:05.602667 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef8d72-50ac-4472-a12d-bb48479b2919 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:05.602886 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57d3b0-6912-486f-806b-4b73e3ba3289 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:05.705803 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57d3b0-6912-486f-806b-4b73e3ba3289 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:05.741559 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933389a-7aee-4601-8017-f5325ebdeb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:05.741559 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933389a-7aee-4601-8017-f5325ebdeb22 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:05.741559 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933389a-7aee-4601-8017-f5325ebdeb22 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:05.741559 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933389a-7aee-4601-8017-f5325ebdeb22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:05.745898 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d933389a-7aee-4601-8017-f5325ebdeb22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:05.746848 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d933389a-7aee-4601-8017-f5325ebdeb22 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:05.761967 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-d933389a-7aee-4601-8017-f5325ebdeb22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:05.761967 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:05.761967 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:05.761967 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:05.761967 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:05.761967 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:05.761967 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:05.761967 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:05.761967 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:05.761967 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:05.761967 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:05.761967 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:05.761967 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:55:05.761967 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:55:05.761967 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:55:05.762924 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:55:05.762924 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:05.762924 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:05.762924 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:05.762924 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:05.762924 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:05.762924 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:05.762924 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:05.762924 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:05.762924 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:05.762924 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:05.762924 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:05.762924 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:05.762924 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:05.762924 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:05.762924 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:05.762924 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:05.763790 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:55:05.763790 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:55:05.763790 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:55:05.763790 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:55:05.763790 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:55:05.763790 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:55:05.763790 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:05.763790 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:05.763790 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 297/602] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:55:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:05.768677 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933389a-7aee-4601-8017-f5325ebdeb22 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:05.837307 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef8d72-50ac-4472-a12d-bb48479b2919 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:05.873981 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933389a-7aee-4601-8017-f5325ebdeb22 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:05.906587 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e441daa4-eebc-454a-904f-d18aeadb85f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:05.907276 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441daa4-eebc-454a-904f-d18aeadb85f1 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:05.907554 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441daa4-eebc-454a-904f-d18aeadb85f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:05.907925 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441daa4-eebc-454a-904f-d18aeadb85f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:05.908754 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e441daa4-eebc-454a-904f-d18aeadb85f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:05.909061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e441daa4-eebc-454a-904f-d18aeadb85f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:05.910610 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e441daa4-eebc-454a-904f-d18aeadb85f1 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:05.925057 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 298/603] 10.222.0.24 () {56 vars in 1148 bytes} [Mon May 16 18:55:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:05.927005 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c87da-e218-4dce-9caa-dc5cd2a08372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:05.927860 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c87da-e218-4dce-9caa-dc5cd2a08372 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:05.928141 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c87da-e218-4dce-9caa-dc5cd2a08372 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:05.928415 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c87da-e218-4dce-9caa-dc5cd2a08372 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:05.931181 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e441daa4-eebc-454a-904f-d18aeadb85f1 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:05.946768 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c87da-e218-4dce-9caa-dc5cd2a08372 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:05.948270 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c87da-e218-4dce-9caa-dc5cd2a08372 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:05.983024 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-6c7c87da-e218-4dce-9caa-dc5cd2a08372 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:05.983024 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:05.983024 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:05.983024 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:05.983024 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:05.983024 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:05.983024 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:05.983024 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:05.983024 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:05.983024 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:05.983024 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:05.983024 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:05.983024 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:55:05.983024 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:55:05.983024 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:55:05.983974 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:55:05.983974 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:05.983974 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:05.983974 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:05.983974 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:05.983974 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:05.983974 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:05.983974 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:05.983974 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:05.983974 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:05.983974 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:05.983974 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:05.983974 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:05.983974 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:05.983974 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:05.983974 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:05.983974 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:05.984867 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:55:05.984867 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:55:05.984867 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:55:05.984867 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:55:05.984867 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:55:05.984867 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:55:05.984867 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:05.984867 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:05.984867 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 306/604] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:55:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:05.989854 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c87da-e218-4dce-9caa-dc5cd2a08372 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:06.030630 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e441daa4-eebc-454a-904f-d18aeadb85f1 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:06.064835 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefd9d9-b89c-4e1e-b72d-dc9430e59cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:06.065786 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefd9d9-b89c-4e1e-b72d-dc9430e59cd5 None admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:06.066074 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefd9d9-b89c-4e1e-b72d-dc9430e59cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:06.066329 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefd9d9-b89c-4e1e-b72d-dc9430e59cd5 None admin] PATH_INFO: `/v3/projects/084e70bbad784892b195bb11a68bf857/users/ee9e8d17cf1648e0b650df48b8f9487a/roles/48c59cffd0c84f83b89761ff42040687` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:06.081508 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefd9d9-b89c-4e1e-b72d-dc9430e59cd5 None admin] RBAC: Authorizing `identity:create_grant(project_id=084e70bbad784892b195bb11a68bf857, user_id=ee9e8d17cf1648e0b650df48b8f9487a, role_id=48c59cffd0c84f83b89761ff42040687)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:06.083029 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefd9d9-b89c-4e1e-b72d-dc9430e59cd5 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:06.103836 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 299/605] 10.222.0.24 () {58 vars in 1439 bytes} [Mon May 16 18:55:05 2022] PUT /identity/v3/projects/084e70bbad784892b195bb11a68bf857/users/ee9e8d17cf1648e0b650df48b8f9487a/roles/48c59cffd0c84f83b89761ff42040687 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:55:06.120224 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1719972-871e-464a-89f1-234f5eebb826 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:06.120560 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1719972-871e-464a-89f1-234f5eebb826 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:06.120790 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1719972-871e-464a-89f1-234f5eebb826 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:06.122535 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 300/606] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:55:06.129578 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a783c-fbeb-45f3-bc02-31ffd10c0c1c None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:06.129578 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a783c-fbeb-45f3-bc02-31ffd10c0c1c None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:06.129578 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a783c-fbeb-45f3-bc02-31ffd10c0c1c None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:06.129578 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 301/607] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:06.129578 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa92ae-9125-49d0-b43d-a0f9c8dcbb63 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:06.129578 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa92ae-9125-49d0-b43d-a0f9c8dcbb63 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:06.130110 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa92ae-9125-49d0-b43d-a0f9c8dcbb63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:06.156748 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-4cfa92ae-9125-49d0-b43d-a0f9c8dcbb63 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:06.160838 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-4cfa92ae-9125-49d0-b43d-a0f9c8dcbb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:06.179690 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c87da-e218-4dce-9caa-dc5cd2a08372 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:06.225590 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11add836-366e-48ba-b794-0c8d68ab5ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:06.227071 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11add836-366e-48ba-b794-0c8d68ab5ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:06.227850 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11add836-366e-48ba-b794-0c8d68ab5ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:06.228275 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11add836-366e-48ba-b794-0c8d68ab5ad0 None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:06.229599 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11add836-366e-48ba-b794-0c8d68ab5ad0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:06.230211 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11add836-366e-48ba-b794-0c8d68ab5ad0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:06.232313 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11add836-366e-48ba-b794-0c8d68ab5ad0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:06.246341 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 302/608] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:55:06.248166 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09834140-3a2a-47ae-bfb5-1fb8843ecd77 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:06.248622 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09834140-3a2a-47ae-bfb5-1fb8843ecd77 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:06.249052 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09834140-3a2a-47ae-bfb5-1fb8843ecd77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:06.260957 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 307/609] 10.222.0.24 () {56 vars in 1148 bytes} [Mon May 16 18:55:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:55:06.269513 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11add836-366e-48ba-b794-0c8d68ab5ad0 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:06.276313 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-09834140-3a2a-47ae-bfb5-1fb8843ecd77 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:06.277635 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-09834140-3a2a-47ae-bfb5-1fb8843ecd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:06.356384 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 303/610] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:55:06.357558 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09834140-3a2a-47ae-bfb5-1fb8843ecd77 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:06.399715 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11add836-366e-48ba-b794-0c8d68ab5ad0 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:06.455599 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ed6cc-7869-4a38-9b6a-2a9908e6372f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:06.456989 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ed6cc-7869-4a38-9b6a-2a9908e6372f None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:06.457428 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ed6cc-7869-4a38-9b6a-2a9908e6372f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:06.457899 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ed6cc-7869-4a38-9b6a-2a9908e6372f None admin] PATH_INFO: `/v3/projects/084e70bbad784892b195bb11a68bf857/users/36439df302854b158c85f4fbb5bcb7d6/roles/48c59cffd0c84f83b89761ff42040687` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:06.466802 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09834140-3a2a-47ae-bfb5-1fb8843ecd77 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:06.482878 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ed6cc-7869-4a38-9b6a-2a9908e6372f None admin] RBAC: Authorizing `identity:create_grant(project_id=084e70bbad784892b195bb11a68bf857, user_id=36439df302854b158c85f4fbb5bcb7d6, role_id=48c59cffd0c84f83b89761ff42040687)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:06.485561 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ed6cc-7869-4a38-9b6a-2a9908e6372f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:06.506870 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493f419-26d6-4f67-96fa-9d8a4aea0d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:06.507680 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493f419-26d6-4f67-96fa-9d8a4aea0d9d None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:06.507955 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493f419-26d6-4f67-96fa-9d8a4aea0d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:06.508270 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493f419-26d6-4f67-96fa-9d8a4aea0d9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:06.509373 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 308/611] 10.222.0.24 () {58 vars in 1439 bytes} [Mon May 16 18:55:06 2022] PUT /identity/v3/projects/084e70bbad784892b195bb11a68bf857/users/36439df302854b158c85f4fbb5bcb7d6/roles/48c59cffd0c84f83b89761ff42040687 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:55:06.511615 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ed6cc-7869-4a38-9b6a-2a9908e6372f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:06.521562 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6493f419-26d6-4f67-96fa-9d8a4aea0d9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:55:06.530228 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-6493f419-26d6-4f67-96fa-9d8a4aea0d9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 18:55:06.530228 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:06.530228 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:06.530228 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:06.530228 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:06.530228 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:06.530228 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:06.530228 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:06.530228 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:06.530228 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:06.530228 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:06.530228 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:06.530228 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:55:06.530228 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:55:06.530228 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:55:06.530228 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:55:06.531186 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:55:06.531186 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:55:06.531186 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:55:06.531186 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:55:06.531186 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:06.531186 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:06.531186 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:06.531186 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:06.531186 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:06.531186 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:06.531186 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:06.531186 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:06.531186 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:06.531186 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:06.531186 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:06.531186 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:06.532006 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:06.532006 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:06.532006 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:06.532006 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:06.532006 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:55:06.532006 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:55:06.532006 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:55:06.532006 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:55:06.532006 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:55:06.532006 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:55:06.532006 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 18:55:06.532006 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:06.532644 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 304/612] 10.222.0.24 () {56 vars in 1102 bytes} [Mon May 16 18:55:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:06.538723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493f419-26d6-4f67-96fa-9d8a4aea0d9d None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:06.715195 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ed6cc-7869-4a38-9b6a-2a9908e6372f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:06.742881 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493f419-26d6-4f67-96fa-9d8a4aea0d9d None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:06.753259 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073ddb4-e3fe-401e-8471-10db301d11a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:06.754647 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073ddb4-e3fe-401e-8471-10db301d11a8 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:06.754647 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073ddb4-e3fe-401e-8471-10db301d11a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:06.754647 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073ddb4-e3fe-401e-8471-10db301d11a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:06.765747 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073ddb4-e3fe-401e-8471-10db301d11a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:55:06.773492 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-b073ddb4-e3fe-401e-8471-10db301d11a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 18:55:06.773492 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:06.773492 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:06.773492 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:06.773492 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:06.773492 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:06.773492 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:06.773492 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:06.773492 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:06.773492 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:06.773492 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:06.773492 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:06.773492 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:55:06.773492 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:55:06.773492 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:55:06.773492 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:55:06.774691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:55:06.774691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:55:06.774691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:55:06.774691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:55:06.774691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:06.774691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:06.774691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:06.774691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:06.774691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:06.774691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:06.774691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:06.774691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:06.774691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:06.774691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:06.774691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:06.774691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:06.775739 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:06.775739 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:06.775739 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:06.775739 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:06.775739 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:55:06.775739 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:55:06.775739 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:55:06.775739 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:55:06.775739 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:55:06.775739 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:55:06.775739 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 18:55:06.775739 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:06.775739 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 309/613] 10.222.0.24 () {56 vars in 1102 bytes} [Mon May 16 18:55:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:06.789562 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073ddb4-e3fe-401e-8471-10db301d11a8 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:06.822826 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95353948-c23c-4a47-988d-aa1e74c40163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:06.823808 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95353948-c23c-4a47-988d-aa1e74c40163 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:06.824248 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95353948-c23c-4a47-988d-aa1e74c40163 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:06.824658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95353948-c23c-4a47-988d-aa1e74c40163 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:06.825579 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95353948-c23c-4a47-988d-aa1e74c40163 None admin] RBAC: Adding query filter params (name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:06.826041 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95353948-c23c-4a47-988d-aa1e74c40163 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:06.827603 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95353948-c23c-4a47-988d-aa1e74c40163 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:06.847420 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 305/614] 10.222.0.24 () {56 vars in 1103 bytes} [Mon May 16 18:55:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:06.853224 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95353948-c23c-4a47-988d-aa1e74c40163 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:06.880263 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073ddb4-e3fe-401e-8471-10db301d11a8 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:06.913663 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3f52c-8fd9-4c14-a0e4-7d060e0bce8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:06.914336 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3f52c-8fd9-4c14-a0e4-7d060e0bce8f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:06.914612 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3f52c-8fd9-4c14-a0e4-7d060e0bce8f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:06.914882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3f52c-8fd9-4c14-a0e4-7d060e0bce8f None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:06.915753 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec3f52c-8fd9-4c14-a0e4-7d060e0bce8f None admin] RBAC: Adding query filter params (name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:06.916043 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec3f52c-8fd9-4c14-a0e4-7d060e0bce8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:06.917471 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec3f52c-8fd9-4c14-a0e4-7d060e0bce8f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:06.926054 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 310/615] 10.222.0.24 () {56 vars in 1103 bytes} [Mon May 16 18:55:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:55:06.931518 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3f52c-8fd9-4c14-a0e4-7d060e0bce8f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:07.044296 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3f52c-8fd9-4c14-a0e4-7d060e0bce8f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:07.064046 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95353948-c23c-4a47-988d-aa1e74c40163 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:07.080870 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a1aee-b97d-4fc1-9b3c-a3ed6316635e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:07.081720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a1aee-b97d-4fc1-9b3c-a3ed6316635e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:07.082006 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a1aee-b97d-4fc1-9b3c-a3ed6316635e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:07.082283 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a1aee-b97d-4fc1-9b3c-a3ed6316635e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:07.093840 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33a1aee-b97d-4fc1-9b3c-a3ed6316635e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:07.096021 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33a1aee-b97d-4fc1-9b3c-a3ed6316635e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:07.115532 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-c33a1aee-b97d-4fc1-9b3c-a3ed6316635e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:07.115532 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:07.115532 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:07.115532 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:07.115532 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:07.115532 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:07.115532 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:07.115532 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:07.115532 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:07.115532 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:07.115532 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:07.115532 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:07.115532 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:07.115532 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:07.115532 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:07.116427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:07.116427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:07.116427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:07.116427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:07.116427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:07.116427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:07.116427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:07.116427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:07.116427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:07.116427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:07.116427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:07.116427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:07.116427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:07.116427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:07.116427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:07.116427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:07.116427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:07.117301 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:07.117301 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:07.117301 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:07.117301 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:07.117515 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 311/616] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:07.127655 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a1aee-b97d-4fc1-9b3c-a3ed6316635e None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:07.138263 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd08ed-977f-4b49-b59b-e7e7e45f8751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:07.139088 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd08ed-977f-4b49-b59b-e7e7e45f8751 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:07.139372 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd08ed-977f-4b49-b59b-e7e7e45f8751 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:07.139651 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd08ed-977f-4b49-b59b-e7e7e45f8751 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:07.156813 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd08ed-977f-4b49-b59b-e7e7e45f8751 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:07.160486 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd08ed-977f-4b49-b59b-e7e7e45f8751 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:07.191076 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-ecbd08ed-977f-4b49-b59b-e7e7e45f8751 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:07.191076 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:07.191076 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:07.191076 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:07.191076 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:07.191076 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:07.191076 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:07.191076 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:07.191076 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:07.191076 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:07.191076 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:07.191076 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:07.191076 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:07.191076 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:07.191076 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:07.192022 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:07.192022 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:07.192022 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:07.192022 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:07.192022 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:07.192022 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:07.192022 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:07.192022 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:07.192022 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:07.192022 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:07.192022 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:07.192022 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:07.192022 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:07.192022 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:07.192022 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:07.192022 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:07.192022 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:07.192893 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:07.192893 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:07.192893 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:07.192893 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:07.192893 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 306/617] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:55:07.198199 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd08ed-977f-4b49-b59b-e7e7e45f8751 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:07.232090 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a1aee-b97d-4fc1-9b3c-a3ed6316635e None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:07.273557 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35f9ef-42a8-4096-bafe-3c267873dbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:07.273557 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35f9ef-42a8-4096-bafe-3c267873dbae None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:07.273557 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35f9ef-42a8-4096-bafe-3c267873dbae None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:07.273557 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35f9ef-42a8-4096-bafe-3c267873dbae None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:07.273987 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d35f9ef-42a8-4096-bafe-3c267873dbae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:07.273987 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d35f9ef-42a8-4096-bafe-3c267873dbae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:07.273987 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d35f9ef-42a8-4096-bafe-3c267873dbae None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:07.286336 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 312/618] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:07.292106 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35f9ef-42a8-4096-bafe-3c267873dbae None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:07.394355 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35f9ef-42a8-4096-bafe-3c267873dbae None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:07.428203 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28aa08e-1257-48ce-b34d-d6f9e5bed89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:07.429006 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28aa08e-1257-48ce-b34d-d6f9e5bed89d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:07.429280 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28aa08e-1257-48ce-b34d-d6f9e5bed89d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:07.429565 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28aa08e-1257-48ce-b34d-d6f9e5bed89d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:07.431497 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd08ed-977f-4b49-b59b-e7e7e45f8751 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:07.436881 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28aa08e-1257-48ce-b34d-d6f9e5bed89d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:07.438378 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28aa08e-1257-48ce-b34d-d6f9e5bed89d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:07.453086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-d28aa08e-1257-48ce-b34d-d6f9e5bed89d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 18:55:07.453086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:07.453086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:07.453086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:07.453086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:07.453086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:07.453086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:07.453086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:07.453086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:07.453086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:07.453086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:07.453086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:07.453086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:55:07.453086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:55:07.453086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:55:07.453086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:55:07.454121 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:07.454121 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:07.454121 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:55:07.454121 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:07.454121 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:55:07.454121 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:07.454121 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:07.454121 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:07.454121 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:07.454121 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:07.454121 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:07.454121 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:07.454121 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:07.454121 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:07.454121 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:07.454121 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:07.454121 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:07.454121 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:07.455042 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:07.455042 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:07.455042 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:55:07.455042 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:55:07.455042 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:55:07.455042 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:55:07.455042 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:55:07.455042 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:55:07.455042 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 18:55:07.455042 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:07.455042 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 313/619] 10.222.0.24 () {56 vars in 1093 bytes} [Mon May 16 18:55:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:55:07.460142 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28aa08e-1257-48ce-b34d-d6f9e5bed89d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:07.510642 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aad860-26a4-4ce8-9fe0-ca4a186b89e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:07.511394 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aad860-26a4-4ce8-9fe0-ca4a186b89e5 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:07.511684 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aad860-26a4-4ce8-9fe0-ca4a186b89e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:07.511959 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aad860-26a4-4ce8-9fe0-ca4a186b89e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:07.512697 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aad860-26a4-4ce8-9fe0-ca4a186b89e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:07.513008 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aad860-26a4-4ce8-9fe0-ca4a186b89e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:07.514458 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aad860-26a4-4ce8-9fe0-ca4a186b89e5 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:07.536978 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 307/620] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:55:07.541905 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aad860-26a4-4ce8-9fe0-ca4a186b89e5 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:07.558973 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28aa08e-1257-48ce-b34d-d6f9e5bed89d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:07.592682 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86752a-b2ec-4f60-8287-bea20d0ecc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:07.593419 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86752a-b2ec-4f60-8287-bea20d0ecc61 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:07.593732 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86752a-b2ec-4f60-8287-bea20d0ecc61 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:07.594031 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86752a-b2ec-4f60-8287-bea20d0ecc61 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:07.594868 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c86752a-b2ec-4f60-8287-bea20d0ecc61 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:07.595206 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c86752a-b2ec-4f60-8287-bea20d0ecc61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:07.596683 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c86752a-b2ec-4f60-8287-bea20d0ecc61 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:07.615152 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 314/621] 10.222.0.24 () {56 vars in 1133 bytes} [Mon May 16 18:55:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:07.620947 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86752a-b2ec-4f60-8287-bea20d0ecc61 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:07.719740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86752a-b2ec-4f60-8287-bea20d0ecc61 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:07.751623 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aad860-26a4-4ce8-9fe0-ca4a186b89e5 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:07.752264 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010edd3f-246d-4c35-9e1e-05f35a66f5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:07.752617 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010edd3f-246d-4c35-9e1e-05f35a66f5b5 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:07.752895 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010edd3f-246d-4c35-9e1e-05f35a66f5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:07.753163 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010edd3f-246d-4c35-9e1e-05f35a66f5b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:07.813128 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fdceac-6ea2-4202-861a-4f0902a66138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:07.814422 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdceac-6ea2-4202-861a-4f0902a66138 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:07.814912 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdceac-6ea2-4202-861a-4f0902a66138 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:07.815386 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdceac-6ea2-4202-861a-4f0902a66138 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:07.818179 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010edd3f-246d-4c35-9e1e-05f35a66f5b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:07.819720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010edd3f-246d-4c35-9e1e-05f35a66f5b5 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:07.826706 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fdceac-6ea2-4202-861a-4f0902a66138 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:07.828397 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fdceac-6ea2-4202-861a-4f0902a66138 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:07.857760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-e5fdceac-6ea2-4202-861a-4f0902a66138 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 18:55:07.857760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:07.857760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:07.857760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:07.857760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:07.857760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:07.857760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:07.857760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:07.857760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:07.857760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:07.857760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:07.857760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:07.857760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:55:07.857760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:55:07.857760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:55:07.857760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:55:07.858739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:07.858739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:07.858739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:55:07.858739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:07.858739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:55:07.858739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:07.858739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:07.858739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:07.858739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:07.858739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:07.858739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:07.858739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:07.858739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:07.858739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:07.858739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:07.858739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:07.858739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:07.858739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:07.859689 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:07.859689 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:07.859689 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:55:07.859689 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:55:07.859689 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:55:07.859689 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:55:07.859689 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:55:07.859689 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:55:07.859689 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 18:55:07.859689 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:07.863446 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 308/622] 10.222.0.24 () {56 vars in 1096 bytes} [Mon May 16 18:55:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:55:07.869041 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fdceac-6ea2-4202-861a-4f0902a66138 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:07.914593 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 315/623] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:55:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 18:55:07.916829 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38663b12-f186-49e7-ab48-a86a914b2f22 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:07.916829 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38663b12-f186-49e7-ab48-a86a914b2f22 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:07.916829 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38663b12-f186-49e7-ab48-a86a914b2f22 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:07.922600 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 316/624] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:07.926771 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38663b12-f186-49e7-ab48-a86a914b2f22 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:07.986893 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fdceac-6ea2-4202-861a-4f0902a66138 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:08.021223 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ad245-c3eb-4e0d-a164-8e58e44a97cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:08.022343 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ad245-c3eb-4e0d-a164-8e58e44a97cd None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:08.022594 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38663b12-f186-49e7-ab48-a86a914b2f22 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:08.023086 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ad245-c3eb-4e0d-a164-8e58e44a97cd None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:08.023622 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ad245-c3eb-4e0d-a164-8e58e44a97cd None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:08.024708 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ad245-c3eb-4e0d-a164-8e58e44a97cd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:08.025235 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ad245-c3eb-4e0d-a164-8e58e44a97cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:08.026932 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ad245-c3eb-4e0d-a164-8e58e44a97cd None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:08.045435 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 309/625] 10.222.0.24 () {56 vars in 1135 bytes} [Mon May 16 18:55:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:08.047192 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c92ed-7dc4-4992-85a1-7f94c4ebd0aa None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:08.047685 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c92ed-7dc4-4992-85a1-7f94c4ebd0aa None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:08.048188 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c92ed-7dc4-4992-85a1-7f94c4ebd0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:08.057924 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f7a54-734d-444a-a43e-946c578e2202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:08.058732 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f7a54-734d-444a-a43e-946c578e2202 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:08.059000 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f7a54-734d-444a-a43e-946c578e2202 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:08.059272 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f7a54-734d-444a-a43e-946c578e2202 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:08.066355 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-046c92ed-7dc4-4992-85a1-7f94c4ebd0aa None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:08.067847 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-046c92ed-7dc4-4992-85a1-7f94c4ebd0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:08.069762 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f7a54-734d-444a-a43e-946c578e2202 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:08.071821 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f7a54-734d-444a-a43e-946c578e2202 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:08.089802 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-665f7a54-734d-444a-a43e-946c578e2202 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:08.089802 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:08.089802 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:08.089802 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:08.089802 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:08.089802 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:08.089802 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:08.089802 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:08.089802 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:08.089802 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:08.089802 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:08.089802 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:08.089802 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:08.089802 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:08.089802 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:08.090732 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:08.090732 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:08.090732 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:08.090732 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:08.090732 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:08.090732 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:08.090732 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:08.090732 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:08.090732 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:08.090732 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:08.090732 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:08.090732 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:08.090732 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:08.090732 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:08.090732 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:08.090732 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:08.090732 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:08.091603 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:08.091603 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:08.091603 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:08.091603 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:08.095876 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 317/626] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:08.096485 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f7a54-734d-444a-a43e-946c578e2202 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:08.149619 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 310/627] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:55:08.150925 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c92ed-7dc4-4992-85a1-7f94c4ebd0aa None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:08.213918 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f7a54-734d-444a-a43e-946c578e2202 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:08.246671 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8bf6b-b275-4ec4-a190-32ae22f81578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:08.247406 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8bf6b-b275-4ec4-a190-32ae22f81578 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:08.247678 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8bf6b-b275-4ec4-a190-32ae22f81578 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:08.247952 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8bf6b-b275-4ec4-a190-32ae22f81578 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:08.254730 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c92ed-7dc4-4992-85a1-7f94c4ebd0aa None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:08.258184 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de8bf6b-b275-4ec4-a190-32ae22f81578 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:08.259728 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de8bf6b-b275-4ec4-a190-32ae22f81578 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:08.277028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-1de8bf6b-b275-4ec4-a190-32ae22f81578 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:08.277028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:08.277028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:08.277028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:08.277028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:08.277028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:08.277028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:08.277028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:08.277028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:08.277028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:08.277028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:08.277028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:08.277028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:08.277028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:08.277028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:08.277972 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:08.277972 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:08.277972 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:08.277972 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:08.277972 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:08.277972 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:08.277972 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:08.277972 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:08.277972 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:08.277972 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:08.277972 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:08.277972 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:08.277972 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:08.277972 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:08.277972 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:08.277972 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:08.277972 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:08.278921 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:08.278921 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:08.278921 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:08.278921 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:08.278921 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 318/628] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:08.280487 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8bf6b-b275-4ec4-a190-32ae22f81578 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:08.293221 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757ad19-b9e1-4708-b962-54bfd173cc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:08.294314 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757ad19-b9e1-4708-b962-54bfd173cc9d None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:08.294819 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757ad19-b9e1-4708-b962-54bfd173cc9d None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:08.295334 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757ad19-b9e1-4708-b962-54bfd173cc9d None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:08.296335 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757ad19-b9e1-4708-b962-54bfd173cc9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:08.296904 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757ad19-b9e1-4708-b962-54bfd173cc9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:08.298594 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757ad19-b9e1-4708-b962-54bfd173cc9d None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:08.310967 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 311/629] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:08.312061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757ad19-b9e1-4708-b962-54bfd173cc9d None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:08.393846 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8bf6b-b275-4ec4-a190-32ae22f81578 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:08.428746 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757ad19-b9e1-4708-b962-54bfd173cc9d None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:08.436805 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e79113-f7e4-4e3c-bafc-d61287c8cbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:08.438049 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e79113-f7e4-4e3c-bafc-d61287c8cbca None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:08.440271 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e79113-f7e4-4e3c-bafc-d61287c8cbca None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:08.440646 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e79113-f7e4-4e3c-bafc-d61287c8cbca None admin] PATH_INFO: `/v3/roles/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:08.452369 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e79113-f7e4-4e3c-bafc-d61287c8cbca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:55:08.460653 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-44e79113-f7e4-4e3c-bafc-d61287c8cbca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 18:55:08.460653 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:08.460653 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:08.460653 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:08.460653 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:08.460653 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:08.460653 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:08.460653 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:08.460653 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:08.460653 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:08.460653 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:08.460653 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:08.460653 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:55:08.460653 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:55:08.460653 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:55:08.460653 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:55:08.461871 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:55:08.461871 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:55:08.461871 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:55:08.461871 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:55:08.461871 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:08.461871 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:08.461871 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:08.461871 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:08.461871 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:08.461871 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:08.461871 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:08.461871 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:08.461871 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:08.461871 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:08.461871 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:08.461871 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:08.463161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:08.463161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:08.463161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:08.463161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:08.463161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:55:08.463161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:55:08.463161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:55:08.463161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:55:08.463161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:55:08.463161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:55:08.463161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 18:55:08.463161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:08.469557 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 319/630] 10.222.0.24 () {56 vars in 1102 bytes} [Mon May 16 18:55:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:08.469557 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e79113-f7e4-4e3c-bafc-d61287c8cbca None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:08.478285 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9d55c-adcd-4b82-b2db-c56d2d44bda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:08.479590 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9d55c-adcd-4b82-b2db-c56d2d44bda9 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:08.480034 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9d55c-adcd-4b82-b2db-c56d2d44bda9 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:08.480442 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9d55c-adcd-4b82-b2db-c56d2d44bda9 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:08.481670 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9d55c-adcd-4b82-b2db-c56d2d44bda9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:08.482238 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9d55c-adcd-4b82-b2db-c56d2d44bda9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:08.484386 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9d55c-adcd-4b82-b2db-c56d2d44bda9 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:08.498662 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 312/631] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:08.499796 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9d55c-adcd-4b82-b2db-c56d2d44bda9 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:08.572470 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e79113-f7e4-4e3c-bafc-d61287c8cbca None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:08.600829 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9d55c-adcd-4b82-b2db-c56d2d44bda9 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:08.608637 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c2301-bd27-40a2-9744-b21c33e6a97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:08.609564 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c2301-bd27-40a2-9744-b21c33e6a97f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:08.610176 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c2301-bd27-40a2-9744-b21c33e6a97f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:08.610407 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c2301-bd27-40a2-9744-b21c33e6a97f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:08.617766 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c2301-bd27-40a2-9744-b21c33e6a97f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:08.619359 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c2301-bd27-40a2-9744-b21c33e6a97f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:08.634005 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-f16c2301-bd27-40a2-9744-b21c33e6a97f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:08.634005 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:08.634005 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:08.634005 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:08.634005 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:08.634005 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:08.634005 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:08.634005 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:08.634005 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:08.634005 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:08.634005 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:08.634005 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:08.634005 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:55:08.634005 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:55:08.634005 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:55:08.634960 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:55:08.634960 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:08.634960 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:08.634960 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:08.634960 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:08.634960 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:08.634960 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:08.634960 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:08.634960 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:08.634960 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:08.634960 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:08.634960 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:08.634960 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:08.634960 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:08.634960 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:08.634960 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:08.634960 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:08.635835 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:55:08.635835 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:55:08.635835 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:55:08.635835 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:55:08.635835 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:55:08.635835 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:55:08.635835 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:08.635835 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:08.635835 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 320/632] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:55:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:08.636319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c2301-bd27-40a2-9744-b21c33e6a97f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:08.644357 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c3a77-de85-4123-b7a8-cf329f8f1750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:08.645040 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c3a77-de85-4123-b7a8-cf329f8f1750 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:08.645319 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c3a77-de85-4123-b7a8-cf329f8f1750 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:08.645620 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c3a77-de85-4123-b7a8-cf329f8f1750 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:08.646381 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c3a77-de85-4123-b7a8-cf329f8f1750 None admin] RBAC: Adding query filter params (name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:08.646676 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c3a77-de85-4123-b7a8-cf329f8f1750 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:08.648064 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c3a77-de85-4123-b7a8-cf329f8f1750 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:08.664263 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 313/633] 10.222.0.24 () {56 vars in 1103 bytes} [Mon May 16 18:55:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:08.665677 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f887b-50f8-4b2d-9b5e-7676b1653564 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:08.665966 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f887b-50f8-4b2d-9b5e-7676b1653564 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:08.666234 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f887b-50f8-4b2d-9b5e-7676b1653564 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:08.667660 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 314/634] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:08.668219 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f887b-50f8-4b2d-9b5e-7676b1653564 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:08.748318 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c2301-bd27-40a2-9744-b21c33e6a97f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:08.766694 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f887b-50f8-4b2d-9b5e-7676b1653564 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:08.780787 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe3c6b-1542-41dd-8d21-5e60364e8d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:08.781621 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe3c6b-1542-41dd-8d21-5e60364e8d5c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:08.781904 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe3c6b-1542-41dd-8d21-5e60364e8d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:08.782174 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe3c6b-1542-41dd-8d21-5e60364e8d5c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:08.789220 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe3c6b-1542-41dd-8d21-5e60364e8d5c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:08.790857 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe3c6b-1542-41dd-8d21-5e60364e8d5c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:08.802164 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc19dab-ef67-4017-9bd7-08b3265ce214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:08.802867 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc19dab-ef67-4017-9bd7-08b3265ce214 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:08.803154 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc19dab-ef67-4017-9bd7-08b3265ce214 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:08.803420 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc19dab-ef67-4017-9bd7-08b3265ce214 None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:08.804197 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc19dab-ef67-4017-9bd7-08b3265ce214 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:08.804499 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc19dab-ef67-4017-9bd7-08b3265ce214 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:08.804651 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-89fe3c6b-1542-41dd-8d21-5e60364e8d5c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:08.804651 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:08.804651 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:08.804651 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:08.804651 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:08.804651 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:08.804651 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:08.804651 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:08.804651 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:08.804651 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:08.804651 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:08.804651 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:08.804651 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:55:08.804651 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:55:08.804651 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:55:08.805551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:55:08.805551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:08.805551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:08.805551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:08.805551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:08.805551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:08.805551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:08.805551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:08.805551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:08.805551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:08.805551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:08.805551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:08.805551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:08.805551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:08.805551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:08.805551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:08.805551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:08.806480 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:55:08.806480 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:55:08.806480 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:55:08.806480 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:55:08.806480 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:55:08.806480 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:55:08.806480 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:08.806480 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:08.806903 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc19dab-ef67-4017-9bd7-08b3265ce214 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:08.810750 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 321/635] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:55:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:08.811516 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe3c6b-1542-41dd-8d21-5e60364e8d5c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:08.821865 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 315/636] 10.222.0.24 () {56 vars in 1148 bytes} [Mon May 16 18:55:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:08.823792 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405612f-7f23-4968-96cf-ad29eafe3d75 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:08.824109 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405612f-7f23-4968-96cf-ad29eafe3d75 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:08.824391 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405612f-7f23-4968-96cf-ad29eafe3d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:08.840469 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-3405612f-7f23-4968-96cf-ad29eafe3d75 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:08.841687 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-3405612f-7f23-4968-96cf-ad29eafe3d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:08.906928 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 316/637] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:55:08.907835 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405612f-7f23-4968-96cf-ad29eafe3d75 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:08.918616 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe3c6b-1542-41dd-8d21-5e60364e8d5c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:08.958563 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fdb0a3-89ba-4fe9-968e-c54d00b3ac6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:08.959370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fdb0a3-89ba-4fe9-968e-c54d00b3ac6a None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:08.959650 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fdb0a3-89ba-4fe9-968e-c54d00b3ac6a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:08.959921 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fdb0a3-89ba-4fe9-968e-c54d00b3ac6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:09.007387 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405612f-7f23-4968-96cf-ad29eafe3d75 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:09.042419 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f616383-319b-4e2a-857f-8cf7cec61bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:09.043022 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f616383-319b-4e2a-857f-8cf7cec61bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:09.043299 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f616383-319b-4e2a-857f-8cf7cec61bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:09.043567 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f616383-319b-4e2a-857f-8cf7cec61bf9 None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:09.044369 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f616383-319b-4e2a-857f-8cf7cec61bf9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:09.044676 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f616383-319b-4e2a-857f-8cf7cec61bf9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:09.046194 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f616383-319b-4e2a-857f-8cf7cec61bf9 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:09.063875 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 317/638] 10.222.0.24 () {56 vars in 1148 bytes} [Mon May 16 18:55:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:09.063875 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f616383-319b-4e2a-857f-8cf7cec61bf9 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:09.110929 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fdb0a3-89ba-4fe9-968e-c54d00b3ac6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:09.112401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fdb0a3-89ba-4fe9-968e-c54d00b3ac6a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:09.131002 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-d1fdb0a3-89ba-4fe9-968e-c54d00b3ac6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:09.131002 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:09.131002 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:09.131002 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:09.131002 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:09.131002 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:09.131002 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:09.131002 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:09.131002 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:09.131002 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:09.131002 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:09.131002 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:09.131002 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:09.131002 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:09.131002 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:09.132094 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:09.132094 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:09.132094 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:09.132094 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:09.132094 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:09.132094 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:09.132094 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:09.132094 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:09.132094 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:09.132094 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:09.132094 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:09.132094 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:09.132094 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:09.132094 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:09.132094 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:09.132094 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:09.132094 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:09.133273 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:09.133273 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:09.133273 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:09.133273 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:09.133273 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 322/639] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:09.133597 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fdb0a3-89ba-4fe9-968e-c54d00b3ac6a None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:09.171658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f616383-319b-4e2a-857f-8cf7cec61bf9 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:09.204756 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3bdcc9-2e7e-46f8-9676-866818bd7ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:09.205398 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bdcc9-2e7e-46f8-9676-866818bd7ffb None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:09.205707 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bdcc9-2e7e-46f8-9676-866818bd7ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:09.205984 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bdcc9-2e7e-46f8-9676-866818bd7ffb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:09.206823 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3bdcc9-2e7e-46f8-9676-866818bd7ffb None admin] RBAC: Adding query filter params (role.id=48c59cffd0c84f83b89761ff42040687, scope.project.id=084e70bbad784892b195bb11a68bf857, user.id=1f03aa520ee14615b802cdbc3cd4f87d) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:09.207139 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3bdcc9-2e7e-46f8-9676-866818bd7ffb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:09.208595 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3bdcc9-2e7e-46f8-9676-866818bd7ffb None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:09.214367 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 318/640] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:55:09 2022] GET /identity/v3/role_assignments?user.id=1f03aa520ee14615b802cdbc3cd4f87d&scope.project.id=084e70bbad784892b195bb11a68bf857&role.id=48c59cffd0c84f83b89761ff42040687 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:09.215114 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3bdcc9-2e7e-46f8-9676-866818bd7ffb None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:09.229043 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fdb0a3-89ba-4fe9-968e-c54d00b3ac6a None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:09.264380 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97d017-ed5a-4767-bc43-d3afb3376225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:09.265374 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97d017-ed5a-4767-bc43-d3afb3376225 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:09.265680 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97d017-ed5a-4767-bc43-d3afb3376225 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:09.265956 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97d017-ed5a-4767-bc43-d3afb3376225 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:09.280786 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc97d017-ed5a-4767-bc43-d3afb3376225 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:55:09.290035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-cc97d017-ed5a-4767-bc43-d3afb3376225 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 18:55:09.290035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:09.290035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:09.290035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:09.290035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:09.290035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:09.290035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:09.290035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:09.290035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:09.290035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:09.290035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:09.290035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:09.290035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:55:09.290035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:55:09.290035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:55:09.290035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:55:09.291181 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:55:09.291181 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:55:09.291181 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:55:09.291181 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:55:09.291181 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:09.291181 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:09.291181 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:09.291181 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:09.291181 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:09.291181 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:09.291181 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:09.291181 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:09.291181 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:09.291181 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:09.291181 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:09.291181 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:09.292007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:09.292007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:09.292007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:09.292007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:09.292007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:55:09.292007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:55:09.292007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:55:09.292007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:55:09.292007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:55:09.292007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:55:09.292007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 18:55:09.292007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:09.292007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 323/641] 10.222.0.24 () {56 vars in 1102 bytes} [Mon May 16 18:55:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:09.292823 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616333b1-f81d-46a6-982b-4bbfc132d8fa None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:09.294246 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616333b1-f81d-46a6-982b-4bbfc132d8fa None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:09.294246 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616333b1-f81d-46a6-982b-4bbfc132d8fa None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:09.298410 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 324/642] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:09.298410 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616333b1-f81d-46a6-982b-4bbfc132d8fa None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:09.323469 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3bdcc9-2e7e-46f8-9676-866818bd7ffb None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:09.357170 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bdb98-32b1-4143-b8c2-41ac276b227b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:09.358113 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bdb98-32b1-4143-b8c2-41ac276b227b None admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:09.358394 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bdb98-32b1-4143-b8c2-41ac276b227b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:09.358662 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bdb98-32b1-4143-b8c2-41ac276b227b None admin] PATH_INFO: `/v3/projects/084e70bbad784892b195bb11a68bf857/users/654e435a35c4491eb87943734ce280f4/roles/48c59cffd0c84f83b89761ff42040687` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:09.374959 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978bdb98-32b1-4143-b8c2-41ac276b227b None admin] RBAC: Authorizing `identity:create_grant(project_id=084e70bbad784892b195bb11a68bf857, user_id=654e435a35c4491eb87943734ce280f4, role_id=48c59cffd0c84f83b89761ff42040687)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:09.376484 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978bdb98-32b1-4143-b8c2-41ac276b227b None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:09.391639 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 319/643] 10.222.0.24 () {58 vars in 1439 bytes} [Mon May 16 18:55:09 2022] PUT /identity/v3/projects/084e70bbad784892b195bb11a68bf857/users/654e435a35c4491eb87943734ce280f4/roles/48c59cffd0c84f83b89761ff42040687 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:55:09.393108 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9a418-6750-4537-8c69-c49dce286f4f None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:09.393469 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9a418-6750-4537-8c69-c49dce286f4f None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:09.393826 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9a418-6750-4537-8c69-c49dce286f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:09.417601 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616333b1-f81d-46a6-982b-4bbfc132d8fa None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:09.419002 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-cdf9a418-6750-4537-8c69-c49dce286f4f None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:09.420233 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-cdf9a418-6750-4537-8c69-c49dce286f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:09.454967 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d857e-5e2e-431f-b807-a82768eafbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:09.455833 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d857e-5e2e-431f-b807-a82768eafbe1 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:09.456252 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d857e-5e2e-431f-b807-a82768eafbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:09.456625 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d857e-5e2e-431f-b807-a82768eafbe1 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:09.457480 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d857e-5e2e-431f-b807-a82768eafbe1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:09.457885 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d857e-5e2e-431f-b807-a82768eafbe1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:09.459325 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d857e-5e2e-431f-b807-a82768eafbe1 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:09.472530 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 325/644] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:09.473444 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d857e-5e2e-431f-b807-a82768eafbe1 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:09.513565 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 320/645] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:55:09.513565 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf9a418-6750-4537-8c69-c49dce286f4f None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:09.580940 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d857e-5e2e-431f-b807-a82768eafbe1 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:09.618337 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf9a418-6750-4537-8c69-c49dce286f4f None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:09.619290 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75434612-e29a-41c7-b68f-0235609ad246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:09.619979 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75434612-e29a-41c7-b68f-0235609ad246 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:09.620251 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75434612-e29a-41c7-b68f-0235609ad246 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:09.620515 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75434612-e29a-41c7-b68f-0235609ad246 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:09.621259 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75434612-e29a-41c7-b68f-0235609ad246 None admin] RBAC: Adding query filter params (name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:09.621579 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75434612-e29a-41c7-b68f-0235609ad246 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:09.622945 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75434612-e29a-41c7-b68f-0235609ad246 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:09.631505 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 326/646] 10.222.0.24 () {56 vars in 1103 bytes} [Mon May 16 18:55:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:09.632348 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75434612-e29a-41c7-b68f-0235609ad246 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:09.652282 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ee4c6-de17-4dd3-a92c-9f1ddbbda3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:09.653107 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ee4c6-de17-4dd3-a92c-9f1ddbbda3d1 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:09.653389 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ee4c6-de17-4dd3-a92c-9f1ddbbda3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:09.653712 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ee4c6-de17-4dd3-a92c-9f1ddbbda3d1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:09.663924 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ee4c6-de17-4dd3-a92c-9f1ddbbda3d1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:09.665760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ee4c6-de17-4dd3-a92c-9f1ddbbda3d1 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:09.684162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-308ee4c6-de17-4dd3-a92c-9f1ddbbda3d1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 16 18:55:09.684162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:09.684162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:09.684162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:09.684162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:09.684162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:09.684162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:09.684162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:09.684162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:09.684162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:09.684162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:09.684162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:09.684162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:55:09.684162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:55:09.684162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:55:09.684162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:55:09.685176 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:09.685176 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:09.685176 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:55:09.685176 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:09.685176 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:55:09.685176 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:09.685176 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:09.685176 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:09.685176 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:09.685176 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:09.685176 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:09.685176 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:09.685176 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:09.685176 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:09.685176 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:09.685176 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:09.685176 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:09.685176 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:09.686715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:09.686715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:09.686715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:55:09.686715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:55:09.686715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:55:09.686715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:55:09.686715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:55:09.686715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:55:09.686715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 16 18:55:09.686715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:09.686715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 321/647] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:55:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:09.687731 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ee4c6-de17-4dd3-a92c-9f1ddbbda3d1 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:09.742179 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75434612-e29a-41c7-b68f-0235609ad246 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:09.775103 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee789052-b629-40df-bbbc-192ebe373772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:09.775897 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee789052-b629-40df-bbbc-192ebe373772 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:09.776174 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee789052-b629-40df-bbbc-192ebe373772 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:09.776484 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee789052-b629-40df-bbbc-192ebe373772 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:09.787833 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee789052-b629-40df-bbbc-192ebe373772 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:55:09.796043 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-ee789052-b629-40df-bbbc-192ebe373772 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 18:55:09.796043 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:09.796043 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:09.796043 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:09.796043 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:09.796043 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:09.796043 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:09.796043 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:09.796043 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:09.796043 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:09.796043 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:09.796043 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:09.796043 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:55:09.796043 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:55:09.796043 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:55:09.796043 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:55:09.798314 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:55:09.798314 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:55:09.798314 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:55:09.798314 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:55:09.798314 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:09.798314 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:09.798314 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:09.798314 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:09.798314 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:09.798314 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:09.798314 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:09.798314 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:09.798314 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:09.798314 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:09.798314 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:09.798314 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:09.800304 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:09.800304 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:09.800304 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:09.800304 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:09.800304 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:55:09.800304 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:55:09.800304 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:55:09.800304 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:55:09.800304 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:55:09.800304 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:55:09.800304 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 18:55:09.800304 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:09.800304 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 327/648] 10.222.0.24 () {56 vars in 1102 bytes} [Mon May 16 18:55:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:09.800304 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee789052-b629-40df-bbbc-192ebe373772 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:09.806515 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ee4c6-de17-4dd3-a92c-9f1ddbbda3d1 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:09.844409 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f3f065-2f98-4591-b82c-15d2417a7813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:09.845766 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3f065-2f98-4591-b82c-15d2417a7813 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:09.846052 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3f065-2f98-4591-b82c-15d2417a7813 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:09.846325 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3f065-2f98-4591-b82c-15d2417a7813 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:09.859229 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f3f065-2f98-4591-b82c-15d2417a7813 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:09.861318 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f3f065-2f98-4591-b82c-15d2417a7813 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:09.884255 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-17f3f065-2f98-4591-b82c-15d2417a7813 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:09.884255 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:09.884255 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:09.884255 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:09.884255 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:09.884255 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:09.884255 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:09.884255 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:09.884255 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:09.884255 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:09.884255 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:09.884255 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:09.884255 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:09.884255 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:09.884255 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:09.885412 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:09.885412 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:09.885412 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:09.885412 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:09.885412 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:09.885412 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:09.885412 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:09.885412 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:09.885412 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:09.885412 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:09.885412 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:09.885412 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:09.885412 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:09.885412 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:09.885412 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:09.885412 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:09.885412 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:09.887482 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:09.887482 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:09.887482 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:09.887482 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:09.887482 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 322/649] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:09.887482 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f3f065-2f98-4591-b82c-15d2417a7813 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:09.901735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee789052-b629-40df-bbbc-192ebe373772 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:09.934739 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca25bc-0ef5-4e83-8ce0-e027e26d13e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:09.935572 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca25bc-0ef5-4e83-8ce0-e027e26d13e7 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:09.935962 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca25bc-0ef5-4e83-8ce0-e027e26d13e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:09.936326 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca25bc-0ef5-4e83-8ce0-e027e26d13e7 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:09.937261 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca25bc-0ef5-4e83-8ce0-e027e26d13e7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:09.937686 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca25bc-0ef5-4e83-8ce0-e027e26d13e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:09.939272 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca25bc-0ef5-4e83-8ce0-e027e26d13e7 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:09.961803 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 328/650] 10.222.0.24 () {56 vars in 1137 bytes} [Mon May 16 18:55:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:09.963063 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca25bc-0ef5-4e83-8ce0-e027e26d13e7 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:10.004584 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f3f065-2f98-4591-b82c-15d2417a7813 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:10.046641 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb00a9-ef5f-4da3-abe6-b8fdf861e628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:10.047452 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb00a9-ef5f-4da3-abe6-b8fdf861e628 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:10.048010 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb00a9-ef5f-4da3-abe6-b8fdf861e628 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:10.048289 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb00a9-ef5f-4da3-abe6-b8fdf861e628 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:10.049043 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb00a9-ef5f-4da3-abe6-b8fdf861e628 None admin] RBAC: Adding query filter params (name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:10.049351 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb00a9-ef5f-4da3-abe6-b8fdf861e628 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:10.051186 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb00a9-ef5f-4da3-abe6-b8fdf861e628 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:10.061994 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 323/651] 10.222.0.24 () {56 vars in 1103 bytes} [Mon May 16 18:55:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:10.062238 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca25bc-0ef5-4e83-8ce0-e027e26d13e7 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:10.062837 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb00a9-ef5f-4da3-abe6-b8fdf861e628 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:10.105519 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be09cc8-056c-468b-8e92-8c2a41329b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:10.106911 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be09cc8-056c-468b-8e92-8c2a41329b15 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:10.107195 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be09cc8-056c-468b-8e92-8c2a41329b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:10.107468 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be09cc8-056c-468b-8e92-8c2a41329b15 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:10.108191 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be09cc8-056c-468b-8e92-8c2a41329b15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:10.108497 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be09cc8-056c-468b-8e92-8c2a41329b15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:10.109901 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be09cc8-056c-468b-8e92-8c2a41329b15 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:10.123962 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 329/652] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:10.124932 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be09cc8-056c-468b-8e92-8c2a41329b15 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:10.175240 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb00a9-ef5f-4da3-abe6-b8fdf861e628 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:10.211825 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b056bf-b6bd-4102-9c12-2efde58cc091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:10.212691 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b056bf-b6bd-4102-9c12-2efde58cc091 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:10.213060 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b056bf-b6bd-4102-9c12-2efde58cc091 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:10.213447 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b056bf-b6bd-4102-9c12-2efde58cc091 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:10.250048 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be09cc8-056c-468b-8e92-8c2a41329b15 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:10.279327 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b056bf-b6bd-4102-9c12-2efde58cc091 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:10.280939 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b056bf-b6bd-4102-9c12-2efde58cc091 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:10.290481 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb94d1e-6a49-4000-b84a-821a5693d4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:10.291292 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb94d1e-6a49-4000-b84a-821a5693d4cb None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:10.291572 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb94d1e-6a49-4000-b84a-821a5693d4cb None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:10.291844 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb94d1e-6a49-4000-b84a-821a5693d4cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:10.303562 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb94d1e-6a49-4000-b84a-821a5693d4cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:10.305218 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb94d1e-6a49-4000-b84a-821a5693d4cb None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:10.322427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-0fb94d1e-6a49-4000-b84a-821a5693d4cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:10.322427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:10.322427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:10.322427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:10.322427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:10.322427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:10.322427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:10.322427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:10.322427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:10.322427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:10.322427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:10.322427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:10.322427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:10.322427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:10.322427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:10.323541 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:10.323541 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:10.323541 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:10.323541 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:10.323541 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:10.323541 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:10.323541 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:10.323541 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:10.323541 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:10.323541 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:10.323541 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:10.323541 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:10.323541 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:10.323541 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:10.323541 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:10.323541 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:10.323541 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:10.325267 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:10.325267 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:10.325267 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:10.325267 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:10.325881 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 330/653] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:10.326973 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb94d1e-6a49-4000-b84a-821a5693d4cb None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:10.399151 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 324/654] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:55:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:55:10.399969 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b056bf-b6bd-4102-9c12-2efde58cc091 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:10.426909 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb94d1e-6a49-4000-b84a-821a5693d4cb None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:10.466875 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee76062-e81b-47cb-b949-561465e71a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:10.467839 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee76062-e81b-47cb-b949-561465e71a74 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:10.468116 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee76062-e81b-47cb-b949-561465e71a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:10.468859 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee76062-e81b-47cb-b949-561465e71a74 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:10.478889 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee76062-e81b-47cb-b949-561465e71a74 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:10.481021 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee76062-e81b-47cb-b949-561465e71a74 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:10.499160 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-dee76062-e81b-47cb-b949-561465e71a74 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 16 18:55:10.499160 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:10.499160 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:10.499160 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:10.499160 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:10.499160 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:10.499160 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:10.499160 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:10.499160 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:10.499160 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:10.499160 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:10.499160 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:10.499160 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:55:10.499160 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:55:10.499160 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:55:10.499160 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:55:10.501408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:10.501408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:10.501408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:55:10.501408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:10.501408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:55:10.501408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:10.501408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:10.501408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:10.501408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:10.501408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:10.501408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:10.501408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:10.501408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:10.501408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:10.501408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:10.501408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:10.501408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:10.501408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:10.503155 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:10.503155 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:10.503155 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:55:10.503155 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:55:10.503155 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:55:10.503155 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:55:10.503155 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:55:10.503155 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:55:10.503155 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 16 18:55:10.503155 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:10.504249 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b056bf-b6bd-4102-9c12-2efde58cc091 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:10.504402 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 331/655] 10.222.0.24 () {56 vars in 1102 bytes} [Mon May 16 18:55:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:10.504402 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee76062-e81b-47cb-b949-561465e71a74 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:10.539070 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3c01a-9a50-45ac-9309-ae2631be146a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:10.539741 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3c01a-9a50-45ac-9309-ae2631be146a None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:10.540139 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3c01a-9a50-45ac-9309-ae2631be146a None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:10.540412 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3c01a-9a50-45ac-9309-ae2631be146a None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:10.541141 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c3c01a-9a50-45ac-9309-ae2631be146a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:10.541492 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c3c01a-9a50-45ac-9309-ae2631be146a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:10.542902 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c3c01a-9a50-45ac-9309-ae2631be146a None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:10.554499 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 325/656] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:10.555374 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3c01a-9a50-45ac-9309-ae2631be146a None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:10.610072 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee76062-e81b-47cb-b949-561465e71a74 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:10.644479 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf7b25-d97a-4139-9469-4093ecfecc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:10.645283 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf7b25-d97a-4139-9469-4093ecfecc5f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:10.645585 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf7b25-d97a-4139-9469-4093ecfecc5f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:10.645861 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf7b25-d97a-4139-9469-4093ecfecc5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:10.656406 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaf7b25-d97a-4139-9469-4093ecfecc5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:10.657520 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3c01a-9a50-45ac-9309-ae2631be146a None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:10.657891 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaf7b25-d97a-4139-9469-4093ecfecc5f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:10.675473 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-9aaf7b25-d97a-4139-9469-4093ecfecc5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:10.675473 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:10.675473 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:10.675473 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:10.675473 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:10.675473 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:10.675473 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:10.675473 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:10.675473 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:10.675473 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:10.675473 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:10.675473 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:10.675473 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:10.675473 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:10.675473 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:10.677673 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:10.677673 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:10.677673 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:10.677673 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:10.677673 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:10.677673 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:10.677673 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:10.677673 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:10.677673 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:10.677673 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:10.677673 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:10.677673 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:10.677673 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:10.677673 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:10.677673 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:10.677673 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:10.677673 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:10.679099 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:10.679099 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:10.679099 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:10.679099 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:10.679099 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 332/657] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:10.679099 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf7b25-d97a-4139-9469-4093ecfecc5f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:10.705080 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57418c78-ea0a-487e-b787-92d151caa75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:10.706156 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57418c78-ea0a-487e-b787-92d151caa75c None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:10.706459 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57418c78-ea0a-487e-b787-92d151caa75c None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:10.706733 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57418c78-ea0a-487e-b787-92d151caa75c None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:10.707844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57418c78-ea0a-487e-b787-92d151caa75c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:10.708149 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57418c78-ea0a-487e-b787-92d151caa75c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:10.710435 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57418c78-ea0a-487e-b787-92d151caa75c None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:10.733092 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 326/658] 10.222.0.24 () {56 vars in 1139 bytes} [Mon May 16 18:55:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:10.734038 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57418c78-ea0a-487e-b787-92d151caa75c None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:10.789918 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf7b25-d97a-4139-9469-4093ecfecc5f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:10.826339 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff1dd8-efe8-4ef9-bb71-ae91a1e813b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:10.827225 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff1dd8-efe8-4ef9-bb71-ae91a1e813b6 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:10.827520 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff1dd8-efe8-4ef9-bb71-ae91a1e813b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:10.827823 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff1dd8-efe8-4ef9-bb71-ae91a1e813b6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:10.836855 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff1dd8-efe8-4ef9-bb71-ae91a1e813b6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:10.838419 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff1dd8-efe8-4ef9-bb71-ae91a1e813b6 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:10.854420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-d8ff1dd8-efe8-4ef9-bb71-ae91a1e813b6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 16 18:55:10.854420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:10.854420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:10.854420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:10.854420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:10.854420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:10.854420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:10.854420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:10.854420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:10.854420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:10.854420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:10.854420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:10.854420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:55:10.854420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:55:10.854420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:55:10.854420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:55:10.855638 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:10.855638 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:10.855638 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:55:10.855638 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:10.855638 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:55:10.855638 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:10.855638 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:10.855638 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:10.855638 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:10.855638 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:10.855638 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:10.855638 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:10.855638 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:10.855638 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:10.855638 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:10.855638 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:10.855638 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:10.855638 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:10.857414 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:10.857414 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:10.857414 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:55:10.857414 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:55:10.857414 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:55:10.857414 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:55:10.857414 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:55:10.857414 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:55:10.857414 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 16 18:55:10.857414 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:10.857414 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 333/659] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:55:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:10.857414 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff1dd8-efe8-4ef9-bb71-ae91a1e813b6 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:10.970641 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff1dd8-efe8-4ef9-bb71-ae91a1e813b6 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:10.971156 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57418c78-ea0a-487e-b787-92d151caa75c None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:11.004403 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6012b2-3ebf-4afd-83d0-6b446374c257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:11.005519 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6012b2-3ebf-4afd-83d0-6b446374c257 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:11.005839 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6012b2-3ebf-4afd-83d0-6b446374c257 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:11.006375 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6012b2-3ebf-4afd-83d0-6b446374c257 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:11.007108 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6012b2-3ebf-4afd-83d0-6b446374c257 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:11.007566 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6012b2-3ebf-4afd-83d0-6b446374c257 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:11.009621 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6012b2-3ebf-4afd-83d0-6b446374c257 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:11.013301 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677115bc-ab6e-4b99-b9b2-c32ed375bff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:11.013982 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677115bc-ab6e-4b99-b9b2-c32ed375bff9 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:11.014266 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677115bc-ab6e-4b99-b9b2-c32ed375bff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:11.014538 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677115bc-ab6e-4b99-b9b2-c32ed375bff9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:11.022078 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 327/660] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:11.022971 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6012b2-3ebf-4afd-83d0-6b446374c257 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:11.092653 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677115bc-ab6e-4b99-b9b2-c32ed375bff9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:11.094616 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677115bc-ab6e-4b99-b9b2-c32ed375bff9 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:11.138977 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6012b2-3ebf-4afd-83d0-6b446374c257 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:11.173387 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc021730-0148-4c75-afdf-6b935a663db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:11.174105 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc021730-0148-4c75-afdf-6b935a663db4 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:11.174380 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc021730-0148-4c75-afdf-6b935a663db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:11.174652 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc021730-0148-4c75-afdf-6b935a663db4 None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:11.175493 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc021730-0148-4c75-afdf-6b935a663db4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:11.175800 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc021730-0148-4c75-afdf-6b935a663db4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:11.177254 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc021730-0148-4c75-afdf-6b935a663db4 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:11.195294 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 328/661] 10.222.0.24 () {56 vars in 1137 bytes} [Mon May 16 18:55:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:11.196227 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc021730-0148-4c75-afdf-6b935a663db4 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:11.223997 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 334/662] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:55:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:55:11.225095 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677115bc-ab6e-4b99-b9b2-c32ed375bff9 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:11.297081 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc021730-0148-4c75-afdf-6b935a663db4 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:11.330094 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894433b7-0809-4b58-ac4f-f3564750c5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:11.330905 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894433b7-0809-4b58-ac4f-f3564750c5d9 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:11.331182 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894433b7-0809-4b58-ac4f-f3564750c5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:11.331451 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894433b7-0809-4b58-ac4f-f3564750c5d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:11.340288 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894433b7-0809-4b58-ac4f-f3564750c5d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:11.342309 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894433b7-0809-4b58-ac4f-f3564750c5d9 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:11.345306 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677115bc-ab6e-4b99-b9b2-c32ed375bff9 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:11.358563 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-894433b7-0809-4b58-ac4f-f3564750c5d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:11.358563 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:11.358563 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:11.358563 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:11.358563 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:11.358563 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:11.358563 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:11.358563 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:11.358563 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:11.358563 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:11.358563 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:11.358563 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:11.358563 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:55:11.358563 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:55:11.358563 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:55:11.359680 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:55:11.359680 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:11.359680 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:11.359680 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:11.359680 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:11.359680 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:11.359680 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:11.359680 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:11.359680 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:11.359680 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:11.359680 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:11.359680 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:11.359680 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:11.359680 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:11.359680 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:11.359680 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:11.359680 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:11.360760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:55:11.360760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:55:11.360760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:55:11.360760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:55:11.360760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:55:11.360760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:55:11.360760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:11.360760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:11.360760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 329/663] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:55:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:11.361300 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894433b7-0809-4b58-ac4f-f3564750c5d9 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:11.386468 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eacb3a-70c1-41c8-93b9-94011fcaa50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:11.387832 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eacb3a-70c1-41c8-93b9-94011fcaa50b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:11.388422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eacb3a-70c1-41c8-93b9-94011fcaa50b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:11.388941 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eacb3a-70c1-41c8-93b9-94011fcaa50b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:11.466155 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894433b7-0809-4b58-ac4f-f3564750c5d9 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:11.478875 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eacb3a-70c1-41c8-93b9-94011fcaa50b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:11.481036 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eacb3a-70c1-41c8-93b9-94011fcaa50b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:11.506787 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879dad9-ccd8-409e-9dd6-c0ed9dfb55dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:11.508116 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879dad9-ccd8-409e-9dd6-c0ed9dfb55dd None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:11.508543 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879dad9-ccd8-409e-9dd6-c0ed9dfb55dd None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:11.509133 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879dad9-ccd8-409e-9dd6-c0ed9dfb55dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:11.522116 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7879dad9-ccd8-409e-9dd6-c0ed9dfb55dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:11.524537 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7879dad9-ccd8-409e-9dd6-c0ed9dfb55dd None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:11.547844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-7879dad9-ccd8-409e-9dd6-c0ed9dfb55dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:11.547844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:11.547844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:11.547844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:11.547844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:11.547844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:11.547844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:11.547844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:11.547844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:11.547844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:11.547844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:11.547844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:11.547844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:11.547844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:11.547844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:11.548970 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:11.548970 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:11.548970 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:11.548970 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:11.548970 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:11.548970 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:11.548970 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:11.548970 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:11.548970 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:11.548970 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:11.548970 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:11.548970 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:11.548970 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:11.548970 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:11.548970 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:11.548970 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:11.548970 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:11.550015 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:11.550015 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:11.550015 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:11.550015 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:11.550890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 330/664] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:11.551708 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879dad9-ccd8-409e-9dd6-c0ed9dfb55dd None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:11.594269 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 335/665] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:55:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:55:11.595529 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eacb3a-70c1-41c8-93b9-94011fcaa50b None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:11.658470 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879dad9-ccd8-409e-9dd6-c0ed9dfb55dd None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:11.690659 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cf0e2-a147-4b71-b0b7-becdd1bcb206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:11.691346 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cf0e2-a147-4b71-b0b7-becdd1bcb206 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:11.691628 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cf0e2-a147-4b71-b0b7-becdd1bcb206 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:11.691898 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cf0e2-a147-4b71-b0b7-becdd1bcb206 None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:11.692687 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3cf0e2-a147-4b71-b0b7-becdd1bcb206 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:11.693006 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3cf0e2-a147-4b71-b0b7-becdd1bcb206 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:11.694467 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3cf0e2-a147-4b71-b0b7-becdd1bcb206 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:11.710895 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 331/666] 10.222.0.24 () {56 vars in 1148 bytes} [Mon May 16 18:55:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:11.710895 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cf0e2-a147-4b71-b0b7-becdd1bcb206 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:11.714399 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eacb3a-70c1-41c8-93b9-94011fcaa50b None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:11.747194 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1ca5f-80d8-45a4-b33d-398725414466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:11.747777 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1ca5f-80d8-45a4-b33d-398725414466 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:11.748050 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1ca5f-80d8-45a4-b33d-398725414466 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:11.748315 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1ca5f-80d8-45a4-b33d-398725414466 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:11.749033 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f1ca5f-80d8-45a4-b33d-398725414466 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:11.749331 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f1ca5f-80d8-45a4-b33d-398725414466 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:11.750741 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f1ca5f-80d8-45a4-b33d-398725414466 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:11.761786 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 336/667] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:11.767140 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e3fa3-cebc-43cb-baae-a004bc919347 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:11.767433 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e3fa3-cebc-43cb-baae-a004bc919347 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:11.767723 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e3fa3-cebc-43cb-baae-a004bc919347 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:11.769006 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 337/668] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:11.769783 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e3fa3-cebc-43cb-baae-a004bc919347 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:11.805172 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cf0e2-a147-4b71-b0b7-becdd1bcb206 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:11.838069 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638c60a-a389-47b7-98dd-abef7476826c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:11.838869 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638c60a-a389-47b7-98dd-abef7476826c None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:11.839175 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638c60a-a389-47b7-98dd-abef7476826c None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:11.839421 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638c60a-a389-47b7-98dd-abef7476826c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:11.849278 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5638c60a-a389-47b7-98dd-abef7476826c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:11.850777 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5638c60a-a389-47b7-98dd-abef7476826c None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:11.864206 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e3fa3-cebc-43cb-baae-a004bc919347 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:11.867872 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-5638c60a-a389-47b7-98dd-abef7476826c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:11.867872 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:11.867872 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:11.867872 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:11.867872 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:11.867872 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:11.867872 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:11.867872 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:11.867872 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:11.867872 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:11.867872 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:11.867872 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:11.867872 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:11.867872 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:11.867872 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:11.868912 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:11.868912 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:11.868912 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:11.868912 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:11.868912 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:11.868912 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:11.868912 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:11.868912 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:11.868912 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:11.868912 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:11.868912 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:11.868912 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:11.868912 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:11.868912 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:11.868912 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:11.868912 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:11.868912 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:11.869831 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:11.869831 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:11.869831 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:11.869831 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:11.869831 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 332/669] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:11.870469 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fa2b7-a53a-444d-8475-efd97eab5b81 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:11.870573 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fa2b7-a53a-444d-8475-efd97eab5b81 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:11.870811 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fa2b7-a53a-444d-8475-efd97eab5b81 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:11.872047 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 333/670] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:11.873574 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47fa2b7-a53a-444d-8475-efd97eab5b81 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:11.899787 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1daafb3-3804-46a1-9c9b-a6ec482f94e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:11.900442 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1daafb3-3804-46a1-9c9b-a6ec482f94e0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:11.900725 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1daafb3-3804-46a1-9c9b-a6ec482f94e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:11.901000 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1daafb3-3804-46a1-9c9b-a6ec482f94e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:11.901866 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1daafb3-3804-46a1-9c9b-a6ec482f94e0 None admin] RBAC: Adding query filter params (role.id=48c59cffd0c84f83b89761ff42040687, scope.project.id=084e70bbad784892b195bb11a68bf857, user.id=5dfa8e8908804c0e8908e2a8c6b377e0) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:11.902180 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1daafb3-3804-46a1-9c9b-a6ec482f94e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:11.903681 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1daafb3-3804-46a1-9c9b-a6ec482f94e0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:11.909272 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 338/671] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:55:11 2022] GET /identity/v3/role_assignments?user.id=5dfa8e8908804c0e8908e2a8c6b377e0&scope.project.id=084e70bbad784892b195bb11a68bf857&role.id=48c59cffd0c84f83b89761ff42040687 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:11.910535 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2cdb9-005c-47d0-9094-e14e2e299493 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:11.910826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2cdb9-005c-47d0-9094-e14e2e299493 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:11.911106 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2cdb9-005c-47d0-9094-e14e2e299493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:11.943944 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-47b2cdb9-005c-47d0-9094-e14e2e299493 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:11.945169 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-47b2cdb9-005c-47d0-9094-e14e2e299493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:11.980782 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47fa2b7-a53a-444d-8475-efd97eab5b81 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:12.016640 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445960a-1b53-4c08-8387-cd9eed4fabb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:12.017371 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445960a-1b53-4c08-8387-cd9eed4fabb1 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:12.017677 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445960a-1b53-4c08-8387-cd9eed4fabb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:12.017983 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445960a-1b53-4c08-8387-cd9eed4fabb1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:12.029790 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 339/672] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:55:12.029790 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2cdb9-005c-47d0-9094-e14e2e299493 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:12.036569 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445960a-1b53-4c08-8387-cd9eed4fabb1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:12.039265 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445960a-1b53-4c08-8387-cd9eed4fabb1 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:12.058479 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-b445960a-1b53-4c08-8387-cd9eed4fabb1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:12.058479 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:12.058479 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:12.058479 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:12.058479 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:12.058479 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:12.058479 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:12.058479 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:12.058479 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:12.058479 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:12.058479 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:12.058479 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:12.058479 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:55:12.058479 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:55:12.058479 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:55:12.059488 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:55:12.059488 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:12.059488 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:12.059488 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:12.059488 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:12.059488 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:12.059488 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:12.059488 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:12.059488 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:12.059488 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:12.059488 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:12.059488 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:12.059488 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:12.059488 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:12.059488 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:12.059488 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:12.059488 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:12.061113 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:55:12.061113 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:55:12.061113 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:55:12.061113 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:55:12.061113 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:55:12.061113 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:55:12.061113 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:12.061113 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:12.061113 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 334/673] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:55:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:12.061655 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe8be1-01fb-4389-a5dd-14c1b8d5f7db None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:12.061655 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe8be1-01fb-4389-a5dd-14c1b8d5f7db None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:12.062012 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe8be1-01fb-4389-a5dd-14c1b8d5f7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:12.080134 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-1efe8be1-01fb-4389-a5dd-14c1b8d5f7db None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:12.081363 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-1efe8be1-01fb-4389-a5dd-14c1b8d5f7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:12.131774 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2cdb9-005c-47d0-9094-e14e2e299493 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:12.170255 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d76f1-7d37-4a94-90fa-37c8017d718f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:12.171174 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d76f1-7d37-4a94-90fa-37c8017d718f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:12.171601 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d76f1-7d37-4a94-90fa-37c8017d718f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:12.171872 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d76f1-7d37-4a94-90fa-37c8017d718f None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:12.173370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d76f1-7d37-4a94-90fa-37c8017d718f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:12.173370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d76f1-7d37-4a94-90fa-37c8017d718f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:12.173683 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 335/674] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:55:12.175144 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d76f1-7d37-4a94-90fa-37c8017d718f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:12.175255 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe8be1-01fb-4389-a5dd-14c1b8d5f7db None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:12.191205 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 340/675] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:12.191205 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d76f1-7d37-4a94-90fa-37c8017d718f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:12.279547 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe8be1-01fb-4389-a5dd-14c1b8d5f7db None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:12.294585 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d76f1-7d37-4a94-90fa-37c8017d718f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:12.312453 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854e32b-11b3-4094-b4d4-48b496788383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:12.313262 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854e32b-11b3-4094-b4d4-48b496788383 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:12.313559 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854e32b-11b3-4094-b4d4-48b496788383 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:12.313838 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854e32b-11b3-4094-b4d4-48b496788383 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:12.323685 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854e32b-11b3-4094-b4d4-48b496788383 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:55:12.328008 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cedceda-4f55-438b-846d-a35e55872a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:12.328919 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cedceda-4f55-438b-846d-a35e55872a3e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:12.329389 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cedceda-4f55-438b-846d-a35e55872a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:12.329942 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cedceda-4f55-438b-846d-a35e55872a3e None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:12.330765 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cedceda-4f55-438b-846d-a35e55872a3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:12.331083 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cedceda-4f55-438b-846d-a35e55872a3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:12.331268 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-8854e32b-11b3-4094-b4d4-48b496788383 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:55:12.331268 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:12.331268 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:12.331268 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:12.331268 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:12.331268 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:12.331268 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:12.331268 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:12.331268 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:12.331268 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:12.331268 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:12.331268 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:12.331268 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:55:12.331268 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:55:12.331268 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:55:12.331268 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:55:12.332170 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:55:12.332170 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:55:12.332170 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:55:12.332170 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:55:12.332170 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:12.332170 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:12.332170 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:12.332170 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:12.332170 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:12.332170 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:12.332170 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:12.332170 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:12.332170 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:12.332170 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:12.332170 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:12.332170 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:12.332986 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:12.332986 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:12.332986 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:12.332986 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:12.332986 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:55:12.332986 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:55:12.332986 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:55:12.332986 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:55:12.332986 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:55:12.332986 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:55:12.332986 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:55:12.332986 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:12.334268 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cedceda-4f55-438b-846d-a35e55872a3e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:12.334348 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 336/676] 10.222.0.24 () {56 vars in 1096 bytes} [Mon May 16 18:55:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:12.334348 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854e32b-11b3-4094-b4d4-48b496788383 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:12.352908 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 341/677] 10.222.0.24 () {56 vars in 1148 bytes} [Mon May 16 18:55:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:12.352908 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cedceda-4f55-438b-846d-a35e55872a3e None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:12.438776 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854e32b-11b3-4094-b4d4-48b496788383 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:12.444492 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cedceda-4f55-438b-846d-a35e55872a3e None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:12.471902 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf3356-613e-4055-9f83-76b868344c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:12.472698 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf3356-613e-4055-9f83-76b868344c41 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:12.472972 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf3356-613e-4055-9f83-76b868344c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:12.473266 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf3356-613e-4055-9f83-76b868344c41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:12.477174 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf4ec9-4e83-43b2-8d3d-aa2e1fe58d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:12.478069 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf4ec9-4e83-43b2-8d3d-aa2e1fe58d15 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:12.478379 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf4ec9-4e83-43b2-8d3d-aa2e1fe58d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:12.478656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf4ec9-4e83-43b2-8d3d-aa2e1fe58d15 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:12.479908 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf3356-613e-4055-9f83-76b868344c41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:12.481365 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf3356-613e-4055-9f83-76b868344c41 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:12.488475 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf4ec9-4e83-43b2-8d3d-aa2e1fe58d15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:55:12.495263 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-47cf3356-613e-4055-9f83-76b868344c41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:12.495263 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:12.495263 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:12.495263 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:12.495263 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:12.495263 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:12.495263 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:12.495263 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:12.495263 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:12.495263 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:12.495263 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:12.495263 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:12.495263 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:55:12.495263 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:55:12.495263 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:55:12.496137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:55:12.496137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:12.496137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:12.496137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:12.496137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:12.496137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:12.496137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:12.496137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:12.496137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:12.496137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:12.496137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:12.496137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:12.496137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:12.496137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:12.496137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:12.496137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:12.496137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:12.497677 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:55:12.497677 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:55:12.497677 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:55:12.497677 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:55:12.497677 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:55:12.497677 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:55:12.497677 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:12.497677 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:12.498113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-0ecf4ec9-4e83-43b2-8d3d-aa2e1fe58d15 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 18:55:12.498113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:12.498113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:12.498113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:12.498113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:12.498113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:12.498113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:12.498113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:12.498113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:12.498113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:12.498113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:12.498113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:12.498113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:55:12.498113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:55:12.498113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:55:12.498113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:55:12.499020 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:55:12.499020 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:55:12.499020 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:55:12.499020 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:55:12.499020 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:12.499020 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:12.499020 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:12.499020 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:12.499020 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:12.499020 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:12.499020 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:12.499020 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:12.499020 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:12.499020 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:12.499020 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:12.499020 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:12.499824 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:12.499824 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:12.499824 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:12.499824 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:12.499824 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:55:12.499824 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:55:12.499824 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:55:12.499824 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:55:12.499824 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:55:12.499824 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:55:12.499824 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 18:55:12.499824 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:12.500434 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 337/678] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:55:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:12.500434 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf3356-613e-4055-9f83-76b868344c41 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:12.506892 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 342/679] 10.222.0.24 () {56 vars in 1102 bytes} [Mon May 16 18:55:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:12.506892 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf4ec9-4e83-43b2-8d3d-aa2e1fe58d15 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:12.600944 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf3356-613e-4055-9f83-76b868344c41 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:12.601896 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf4ec9-4e83-43b2-8d3d-aa2e1fe58d15 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:12.633344 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65070e2f-9887-4113-aadd-f0a255c1208d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:12.634055 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65070e2f-9887-4113-aadd-f0a255c1208d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:12.634338 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65070e2f-9887-4113-aadd-f0a255c1208d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:12.634612 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65070e2f-9887-4113-aadd-f0a255c1208d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:12.634707 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49498d76-b9b5-405e-a4f0-3f3ce9744c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:12.635302 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49498d76-b9b5-405e-a4f0-3f3ce9744c36 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:12.635506 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65070e2f-9887-4113-aadd-f0a255c1208d None admin] RBAC: Adding query filter params (role.id=48c59cffd0c84f83b89761ff42040687, scope.project.id=084e70bbad784892b195bb11a68bf857, user.id=ee9e8d17cf1648e0b650df48b8f9487a) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:12.635601 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49498d76-b9b5-405e-a4f0-3f3ce9744c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:12.635819 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65070e2f-9887-4113-aadd-f0a255c1208d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:12.635911 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49498d76-b9b5-405e-a4f0-3f3ce9744c36 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:12.636581 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49498d76-b9b5-405e-a4f0-3f3ce9744c36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:12.636889 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49498d76-b9b5-405e-a4f0-3f3ce9744c36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:12.637311 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65070e2f-9887-4113-aadd-f0a255c1208d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:12.638286 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49498d76-b9b5-405e-a4f0-3f3ce9744c36 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:12.643105 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 343/680] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:55:12 2022] GET /identity/v3/role_assignments?user.id=ee9e8d17cf1648e0b650df48b8f9487a&scope.project.id=084e70bbad784892b195bb11a68bf857&role.id=48c59cffd0c84f83b89761ff42040687 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:12.643962 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65070e2f-9887-4113-aadd-f0a255c1208d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:12.659557 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 338/681] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:55:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:12.661333 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49498d76-b9b5-405e-a4f0-3f3ce9744c36 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:12.764244 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65070e2f-9887-4113-aadd-f0a255c1208d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:12.783485 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49498d76-b9b5-405e-a4f0-3f3ce9744c36 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:12.810373 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3305e-abeb-466c-a338-5e29140292e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:12.811536 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3305e-abeb-466c-a338-5e29140292e1 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:12.812004 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3305e-abeb-466c-a338-5e29140292e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:12.812796 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3305e-abeb-466c-a338-5e29140292e1 None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:12.814131 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee3305e-abeb-466c-a338-5e29140292e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:12.814841 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee3305e-abeb-466c-a338-5e29140292e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:12.817201 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee3305e-abeb-466c-a338-5e29140292e1 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:12.820839 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc747c3-64d6-4910-997a-7e2c135be6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:12.821328 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc747c3-64d6-4910-997a-7e2c135be6f3 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:12.821748 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc747c3-64d6-4910-997a-7e2c135be6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:12.822101 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc747c3-64d6-4910-997a-7e2c135be6f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:12.822968 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc747c3-64d6-4910-997a-7e2c135be6f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:12.823346 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc747c3-64d6-4910-997a-7e2c135be6f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:12.824852 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc747c3-64d6-4910-997a-7e2c135be6f3 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:12.834432 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 344/683] 10.222.0.24 () {56 vars in 1148 bytes} [Mon May 16 18:55:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:12.835635 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3305e-abeb-466c-a338-5e29140292e1 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:12.839049 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 339/683] 10.222.0.24 () {56 vars in 1103 bytes} [Mon May 16 18:55:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:12.840542 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc747c3-64d6-4910-997a-7e2c135be6f3 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:12.953391 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3305e-abeb-466c-a338-5e29140292e1 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:12.958633 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc747c3-64d6-4910-997a-7e2c135be6f3 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:12.987479 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623764e-810a-4c0e-96eb-c83b957f3692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:12.988306 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623764e-810a-4c0e-96eb-c83b957f3692 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:12.988728 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623764e-810a-4c0e-96eb-c83b957f3692 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:12.989021 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623764e-810a-4c0e-96eb-c83b957f3692 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:12.997678 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40d1ad-f9ac-4ac0-85d3-160af978bc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:12.998484 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40d1ad-f9ac-4ac0-85d3-160af978bc80 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:12.999159 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40d1ad-f9ac-4ac0-85d3-160af978bc80 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:12.999437 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40d1ad-f9ac-4ac0-85d3-160af978bc80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:13.000888 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0623764e-810a-4c0e-96eb-c83b957f3692 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:13.002865 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0623764e-810a-4c0e-96eb-c83b957f3692 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:13.011734 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40d1ad-f9ac-4ac0-85d3-160af978bc80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:13.013932 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40d1ad-f9ac-4ac0-85d3-160af978bc80 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:13.023146 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-0623764e-810a-4c0e-96eb-c83b957f3692 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:13.023146 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:13.023146 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:13.023146 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:13.023146 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:13.023146 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:13.023146 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:13.023146 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:13.023146 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:13.023146 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:13.023146 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:13.023146 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:13.023146 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:13.023146 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:13.023146 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:13.024039 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:13.024039 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:13.024039 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:13.024039 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:13.024039 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:13.024039 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:13.024039 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:13.024039 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:13.024039 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:13.024039 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:13.024039 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:13.024039 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:13.024039 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:13.024039 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:13.024039 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:13.024039 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:13.024039 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:13.025774 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:13.025774 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:13.025774 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:13.025774 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:13.025774 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 345/684] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:13.025774 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623764e-810a-4c0e-96eb-c83b957f3692 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:13.032138 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-7b40d1ad-f9ac-4ac0-85d3-160af978bc80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:13.032138 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:13.032138 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:13.032138 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:13.032138 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:13.032138 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:13.032138 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:13.032138 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:13.032138 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:13.032138 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:13.032138 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:13.032138 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:13.032138 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:13.032138 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:13.032138 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:13.034175 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:13.034175 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:13.034175 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:13.034175 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:13.034175 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:13.034175 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:13.034175 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:13.034175 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:13.034175 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:13.034175 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:13.034175 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:13.034175 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:13.034175 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:13.034175 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:13.034175 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:13.034175 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:13.034175 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:13.035391 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:13.035391 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:13.035391 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:13.035391 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:13.035391 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 340/685] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:13.035391 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40d1ad-f9ac-4ac0-85d3-160af978bc80 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:13.145169 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623764e-810a-4c0e-96eb-c83b957f3692 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:13.155656 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40d1ad-f9ac-4ac0-85d3-160af978bc80 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:13.189766 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89eb51-9843-417d-9645-ee55a8d9c760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:13.190570 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89eb51-9843-417d-9645-ee55a8d9c760 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:13.190876 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89eb51-9843-417d-9645-ee55a8d9c760 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:13.191216 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89eb51-9843-417d-9645-ee55a8d9c760 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:13.192117 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b89eb51-9843-417d-9645-ee55a8d9c760 None admin] RBAC: Adding query filter params (role.id=48c59cffd0c84f83b89761ff42040687, scope.project.id=084e70bbad784892b195bb11a68bf857, user.id=36439df302854b158c85f4fbb5bcb7d6) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:13.192502 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b89eb51-9843-417d-9645-ee55a8d9c760 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:13.192778 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d580666d-13f2-454a-8b89-74bd40f1ff3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:13.193514 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d580666d-13f2-454a-8b89-74bd40f1ff3b None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:13.193885 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d580666d-13f2-454a-8b89-74bd40f1ff3b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:13.194224 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d580666d-13f2-454a-8b89-74bd40f1ff3b None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:13.194344 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b89eb51-9843-417d-9645-ee55a8d9c760 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:13.195061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d580666d-13f2-454a-8b89-74bd40f1ff3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:13.195446 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d580666d-13f2-454a-8b89-74bd40f1ff3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:13.196943 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d580666d-13f2-454a-8b89-74bd40f1ff3b None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:13.201185 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 346/686] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:55:13 2022] GET /identity/v3/role_assignments?user.id=36439df302854b158c85f4fbb5bcb7d6&scope.project.id=084e70bbad784892b195bb11a68bf857&role.id=48c59cffd0c84f83b89761ff42040687 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:13.206462 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89eb51-9843-417d-9645-ee55a8d9c760 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:13.210050 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 341/687] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:13.218752 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d580666d-13f2-454a-8b89-74bd40f1ff3b None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:13.341522 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d580666d-13f2-454a-8b89-74bd40f1ff3b None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:13.387813 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727bf6f4-827d-4f75-9d81-ed7567353a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:13.388651 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727bf6f4-827d-4f75-9d81-ed7567353a9e None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:13.388926 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727bf6f4-827d-4f75-9d81-ed7567353a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:13.389198 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727bf6f4-827d-4f75-9d81-ed7567353a9e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:13.401221 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727bf6f4-827d-4f75-9d81-ed7567353a9e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:13.401703 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89eb51-9843-417d-9645-ee55a8d9c760 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:13.402741 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727bf6f4-827d-4f75-9d81-ed7567353a9e None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:13.437034 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37390af5-333c-40c4-8da3-d28c1b27c854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:13.437377 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-727bf6f4-827d-4f75-9d81-ed7567353a9e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 18:55:13.437377 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:13.437377 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:13.437377 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:13.437377 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:13.437377 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:13.437377 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:13.437377 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:13.437377 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:13.437377 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:13.437377 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:13.437377 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:13.437377 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:55:13.437377 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:55:13.437377 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:55:13.437377 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:55:13.439448 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:13.439448 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:13.439448 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:55:13.439448 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:13.439448 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:55:13.439448 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:13.439448 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:13.439448 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:13.439448 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:13.439448 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:13.439448 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:13.439448 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:13.439448 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:13.439448 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:13.439448 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:13.439448 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:13.439448 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:13.439448 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:13.441783 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:13.441783 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:13.441783 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:55:13.441783 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:55:13.441783 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:55:13.441783 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:55:13.441783 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:55:13.441783 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:55:13.441783 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 18:55:13.441783 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:13.443026 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37390af5-333c-40c4-8da3-d28c1b27c854 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:13.443026 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37390af5-333c-40c4-8da3-d28c1b27c854 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:13.443026 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37390af5-333c-40c4-8da3-d28c1b27c854 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:13.443026 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37390af5-333c-40c4-8da3-d28c1b27c854 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:13.443564 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 342/688] 10.222.0.24 () {56 vars in 1093 bytes} [Mon May 16 18:55:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:13.443710 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37390af5-333c-40c4-8da3-d28c1b27c854 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:13.443710 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37390af5-333c-40c4-8da3-d28c1b27c854 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:13.449557 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727bf6f4-827d-4f75-9d81-ed7567353a9e None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:13.459339 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 347/689] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:13.460993 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37390af5-333c-40c4-8da3-d28c1b27c854 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:13.567569 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727bf6f4-827d-4f75-9d81-ed7567353a9e None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:13.567942 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37390af5-333c-40c4-8da3-d28c1b27c854 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:13.606620 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfedeb7-a4b5-4397-82a1-7535c309322f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:13.607432 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfedeb7-a4b5-4397-82a1-7535c309322f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:13.607714 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfedeb7-a4b5-4397-82a1-7535c309322f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:13.607985 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfedeb7-a4b5-4397-82a1-7535c309322f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:13.610889 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2898f-6c1e-42f0-8e7e-13c3ca37eb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:13.612135 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2898f-6c1e-42f0-8e7e-13c3ca37eb33 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:13.612418 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2898f-6c1e-42f0-8e7e-13c3ca37eb33 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:13.612690 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2898f-6c1e-42f0-8e7e-13c3ca37eb33 None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:13.613564 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e2898f-6c1e-42f0-8e7e-13c3ca37eb33 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:13.613879 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e2898f-6c1e-42f0-8e7e-13c3ca37eb33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:13.615347 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e2898f-6c1e-42f0-8e7e-13c3ca37eb33 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:13.617125 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfedeb7-a4b5-4397-82a1-7535c309322f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:13.618717 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfedeb7-a4b5-4397-82a1-7535c309322f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:13.634083 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-bdfedeb7-a4b5-4397-82a1-7535c309322f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 18:55:13.634083 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:13.634083 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:13.634083 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:13.634083 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:13.634083 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:13.634083 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:13.634083 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:13.634083 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:13.634083 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:13.634083 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:13.634083 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:13.634083 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:55:13.634083 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:55:13.634083 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:55:13.634083 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:55:13.636286 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:13.636286 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:13.636286 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:55:13.636286 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:13.636286 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:55:13.636286 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:13.636286 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:13.636286 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:13.636286 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:13.636286 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:13.636286 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:13.636286 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:13.636286 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:13.636286 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:13.636286 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:13.636286 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:13.636286 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:13.636286 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:13.638695 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:13.638695 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:13.638695 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:55:13.638695 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:55:13.638695 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:55:13.638695 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:55:13.638695 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:55:13.638695 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:55:13.638695 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 18:55:13.638695 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:13.638695 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 348/690] 10.222.0.24 () {56 vars in 1096 bytes} [Mon May 16 18:55:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:55:13.645639 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 343/691] 10.222.0.24 () {56 vars in 1133 bytes} [Mon May 16 18:55:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:13.645888 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfedeb7-a4b5-4397-82a1-7535c309322f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:13.646047 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2898f-6c1e-42f0-8e7e-13c3ca37eb33 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:13.770960 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfedeb7-a4b5-4397-82a1-7535c309322f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:13.808148 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f9eaf3-14cb-40a4-9a00-8f5e515434d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:13.809663 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9eaf3-14cb-40a4-9a00-8f5e515434d1 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:13.810027 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9eaf3-14cb-40a4-9a00-8f5e515434d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:13.810301 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9eaf3-14cb-40a4-9a00-8f5e515434d1 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:13.811156 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f9eaf3-14cb-40a4-9a00-8f5e515434d1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:13.811464 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f9eaf3-14cb-40a4-9a00-8f5e515434d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:13.812982 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f9eaf3-14cb-40a4-9a00-8f5e515434d1 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:13.832386 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 349/692] 10.222.0.24 () {56 vars in 1135 bytes} [Mon May 16 18:55:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:55:13.841881 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f9eaf3-14cb-40a4-9a00-8f5e515434d1 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:13.857401 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2898f-6c1e-42f0-8e7e-13c3ca37eb33 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:13.899587 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c9a6c-980a-49eb-9a27-1ca6f585622e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:13.900253 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c9a6c-980a-49eb-9a27-1ca6f585622e None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:13.900530 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c9a6c-980a-49eb-9a27-1ca6f585622e None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:13.900801 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c9a6c-980a-49eb-9a27-1ca6f585622e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:13.955133 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f9eaf3-14cb-40a4-9a00-8f5e515434d1 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:13.991589 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92207255-59ab-454b-90a9-8efbba3d0bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:13.992312 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92207255-59ab-454b-90a9-8efbba3d0bff None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:13.992579 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92207255-59ab-454b-90a9-8efbba3d0bff None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:13.992854 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92207255-59ab-454b-90a9-8efbba3d0bff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:14.037681 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c9a6c-980a-49eb-9a27-1ca6f585622e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:14.037681 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c9a6c-980a-49eb-9a27-1ca6f585622e None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:14.071522 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92207255-59ab-454b-90a9-8efbba3d0bff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:14.073050 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92207255-59ab-454b-90a9-8efbba3d0bff None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:14.183243 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 350/693] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:55:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:55:14.189511 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92207255-59ab-454b-90a9-8efbba3d0bff None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:14.274253 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 344/694] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:55:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 18:55:14.281938 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c9a6c-980a-49eb-9a27-1ca6f585622e None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:14.330833 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92207255-59ab-454b-90a9-8efbba3d0bff None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:14.376198 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e3ff7-4e56-4a91-beb6-3dd581fc532f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:14.377860 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e3ff7-4e56-4a91-beb6-3dd581fc532f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:14.378644 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e3ff7-4e56-4a91-beb6-3dd581fc532f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:14.379401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e3ff7-4e56-4a91-beb6-3dd581fc532f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:14.394201 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e3ff7-4e56-4a91-beb6-3dd581fc532f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:14.396566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e3ff7-4e56-4a91-beb6-3dd581fc532f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:14.400778 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c9a6c-980a-49eb-9a27-1ca6f585622e None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:14.420414 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-135e3ff7-4e56-4a91-beb6-3dd581fc532f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:14.420414 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:14.420414 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:14.420414 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:14.420414 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:14.420414 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:14.420414 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:14.420414 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:14.420414 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:14.420414 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:14.420414 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:14.420414 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:14.420414 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:14.420414 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:14.420414 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:14.421353 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:14.421353 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:14.421353 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:14.421353 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:14.421353 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:14.421353 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:14.421353 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:14.421353 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:14.421353 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:14.421353 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:14.421353 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:14.421353 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:14.421353 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:14.421353 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:14.421353 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:14.421353 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:14.421353 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:14.422307 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:14.422307 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:14.422307 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:14.422307 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:14.425210 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 351/695] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:55:14.426829 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a2f5b-4f17-454c-a240-ab3f67103367 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:14.427112 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a2f5b-4f17-454c-a240-ab3f67103367 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:14.427384 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a2f5b-4f17-454c-a240-ab3f67103367 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:14.433345 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 352/696] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:14.433345 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a2f5b-4f17-454c-a240-ab3f67103367 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:14.444384 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7dd412-33e1-4828-a96d-c255dad33ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:14.445193 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7dd412-33e1-4828-a96d-c255dad33ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:14.445468 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7dd412-33e1-4828-a96d-c255dad33ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:14.445786 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7dd412-33e1-4828-a96d-c255dad33ca7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:14.457737 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7dd412-33e1-4828-a96d-c255dad33ca7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:14.459829 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7dd412-33e1-4828-a96d-c255dad33ca7 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:14.479525 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-0b7dd412-33e1-4828-a96d-c255dad33ca7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:14.479525 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:14.479525 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:14.479525 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:14.479525 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:14.479525 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:14.479525 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:14.479525 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:14.479525 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:14.479525 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:14.479525 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:14.479525 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:14.479525 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:14.479525 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:14.479525 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:14.480439 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:14.480439 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:14.480439 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:14.480439 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:14.480439 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:14.480439 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:14.480439 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:14.480439 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:14.480439 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:14.480439 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:14.480439 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:14.480439 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:14.480439 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:14.480439 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:14.480439 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:14.480439 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:14.480439 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:14.481351 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:14.481351 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:14.481351 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:14.481351 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:14.481351 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 345/697] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:55:14.482327 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15363a-7d02-4d82-8f3c-5c60700a2181 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:14.482609 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15363a-7d02-4d82-8f3c-5c60700a2181 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:14.482881 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15363a-7d02-4d82-8f3c-5c60700a2181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:14.499055 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-af15363a-7d02-4d82-8f3c-5c60700a2181 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:14.500222 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-af15363a-7d02-4d82-8f3c-5c60700a2181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:14.553763 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a2f5b-4f17-454c-a240-ab3f67103367 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:14.586022 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 346/698] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:55:14.586022 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af15363a-7d02-4d82-8f3c-5c60700a2181 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:14.601115 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17deef5d-aac2-40ff-9065-68215914b36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:14.601812 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17deef5d-aac2-40ff-9065-68215914b36d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:14.602090 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17deef5d-aac2-40ff-9065-68215914b36d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:14.602800 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17deef5d-aac2-40ff-9065-68215914b36d None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:14.603529 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17deef5d-aac2-40ff-9065-68215914b36d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:14.603831 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17deef5d-aac2-40ff-9065-68215914b36d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:14.605223 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17deef5d-aac2-40ff-9065-68215914b36d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:14.620426 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 353/699] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:55:14.621285 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17deef5d-aac2-40ff-9065-68215914b36d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:14.715247 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af15363a-7d02-4d82-8f3c-5c60700a2181 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:14.732489 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17deef5d-aac2-40ff-9065-68215914b36d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:14.759512 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0799e64-f05b-43d8-ba06-fd506794f9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:14.760323 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0799e64-f05b-43d8-ba06-fd506794f9ce None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:14.760660 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0799e64-f05b-43d8-ba06-fd506794f9ce None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:14.761004 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0799e64-f05b-43d8-ba06-fd506794f9ce None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:14.761886 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0799e64-f05b-43d8-ba06-fd506794f9ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:14.762300 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0799e64-f05b-43d8-ba06-fd506794f9ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:14.763816 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0799e64-f05b-43d8-ba06-fd506794f9ce None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:14.773380 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7b551-8c92-4609-9752-900c97df1d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:14.774578 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7b551-8c92-4609-9752-900c97df1d45 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:14.775090 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7b551-8c92-4609-9752-900c97df1d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:14.775537 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7b551-8c92-4609-9752-900c97df1d45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:14.780288 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 347/700] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:14.781255 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0799e64-f05b-43d8-ba06-fd506794f9ce None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:14.789971 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7b551-8c92-4609-9752-900c97df1d45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:14.792412 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7b551-8c92-4609-9752-900c97df1d45 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:14.814566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-11b7b551-8c92-4609-9752-900c97df1d45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:14.814566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:14.814566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:14.814566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:14.814566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:14.814566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:14.814566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:14.814566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:14.814566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:14.814566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:14.814566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:14.814566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:14.814566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:14.814566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:14.814566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:14.815898 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:14.815898 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:14.815898 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:14.815898 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:14.815898 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:14.815898 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:14.815898 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:14.815898 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:14.815898 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:14.815898 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:14.815898 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:14.815898 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:14.815898 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:14.815898 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:14.815898 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:14.815898 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:14.815898 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:14.816781 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:14.816781 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:14.816781 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:14.816781 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:14.823823 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 354/701] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:14.825042 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7b551-8c92-4609-9752-900c97df1d45 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:14.880976 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0799e64-f05b-43d8-ba06-fd506794f9ce None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:14.914512 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37af9cb-b3ad-40fa-ae9b-a4bc015dd0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:14.915428 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37af9cb-b3ad-40fa-ae9b-a4bc015dd0f8 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:14.915710 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37af9cb-b3ad-40fa-ae9b-a4bc015dd0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:14.915984 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37af9cb-b3ad-40fa-ae9b-a4bc015dd0f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:14.922781 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37af9cb-b3ad-40fa-ae9b-a4bc015dd0f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:14.924425 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37af9cb-b3ad-40fa-ae9b-a4bc015dd0f8 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:14.925058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7b551-8c92-4609-9752-900c97df1d45 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:14.939647 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-c37af9cb-b3ad-40fa-ae9b-a4bc015dd0f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:14.939647 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:14.939647 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:14.939647 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:14.939647 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:14.939647 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:14.939647 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:14.939647 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:14.939647 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:14.939647 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:14.939647 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:14.939647 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:14.939647 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:55:14.939647 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:55:14.939647 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:55:14.940582 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:55:14.940582 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:14.940582 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:14.940582 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:14.940582 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:14.940582 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:14.940582 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:14.940582 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:14.940582 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:14.940582 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:14.940582 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:14.940582 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:14.940582 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:14.940582 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:14.940582 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:14.940582 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:14.940582 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:14.941463 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:55:14.941463 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:55:14.941463 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:55:14.941463 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:55:14.941463 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:55:14.941463 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:55:14.941463 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:14.941463 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:14.941463 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 348/702] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:55:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:14.941973 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37af9cb-b3ad-40fa-ae9b-a4bc015dd0f8 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:14.961610 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd96abd-8253-4acf-bc75-51f877ae3ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:14.963277 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd96abd-8253-4acf-bc75-51f877ae3ceb None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:14.963761 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd96abd-8253-4acf-bc75-51f877ae3ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:14.964265 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd96abd-8253-4acf-bc75-51f877ae3ceb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:14.971541 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd96abd-8253-4acf-bc75-51f877ae3ceb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:14.973234 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd96abd-8253-4acf-bc75-51f877ae3ceb None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:14.987823 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-9cd96abd-8253-4acf-bc75-51f877ae3ceb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:14.987823 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:14.987823 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:14.987823 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:14.987823 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:14.987823 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:14.987823 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:14.987823 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:14.987823 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:14.987823 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:14.987823 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:14.987823 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:14.987823 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:55:14.987823 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:55:14.987823 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:55:14.988735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:55:14.988735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:14.988735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:14.988735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:14.988735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:14.988735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:14.988735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:14.988735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:14.988735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:14.988735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:14.988735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:14.988735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:14.988735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:14.988735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:14.988735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:14.988735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:14.988735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:14.989635 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:55:14.989635 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:55:14.989635 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:55:14.989635 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:55:14.989635 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:55:14.989635 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:55:14.989635 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:14.989635 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:14.992073 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 355/703] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:55:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:14.993178 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd96abd-8253-4acf-bc75-51f877ae3ceb None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:15.039541 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37af9cb-b3ad-40fa-ae9b-a4bc015dd0f8 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:15.072942 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788dbbb7-649c-4520-9045-da1e59cc1e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:15.073688 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788dbbb7-649c-4520-9045-da1e59cc1e96 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:15.073967 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788dbbb7-649c-4520-9045-da1e59cc1e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:15.074233 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788dbbb7-649c-4520-9045-da1e59cc1e96 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:15.074994 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788dbbb7-649c-4520-9045-da1e59cc1e96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:15.075366 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788dbbb7-649c-4520-9045-da1e59cc1e96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:15.076755 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788dbbb7-649c-4520-9045-da1e59cc1e96 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:15.088320 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 349/704] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:15.089088 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788dbbb7-649c-4520-9045-da1e59cc1e96 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:15.094305 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd96abd-8253-4acf-bc75-51f877ae3ceb None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:15.137665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466ef91-ff75-4b09-88c4-6fd67cd5d2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:15.137665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466ef91-ff75-4b09-88c4-6fd67cd5d2d1 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:15.137665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466ef91-ff75-4b09-88c4-6fd67cd5d2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:15.138047 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466ef91-ff75-4b09-88c4-6fd67cd5d2d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:15.138537 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466ef91-ff75-4b09-88c4-6fd67cd5d2d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:15.138904 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466ef91-ff75-4b09-88c4-6fd67cd5d2d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:15.140390 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466ef91-ff75-4b09-88c4-6fd67cd5d2d1 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:15.158822 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 356/705] 10.222.0.24 () {56 vars in 1148 bytes} [Mon May 16 18:55:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:15.159871 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466ef91-ff75-4b09-88c4-6fd67cd5d2d1 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:15.197833 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788dbbb7-649c-4520-9045-da1e59cc1e96 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:15.231844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ed155-de9a-4321-9047-b709a1c34c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:15.232767 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ed155-de9a-4321-9047-b709a1c34c70 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:15.233217 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ed155-de9a-4321-9047-b709a1c34c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:15.233700 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ed155-de9a-4321-9047-b709a1c34c70 None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:15.234630 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5ed155-de9a-4321-9047-b709a1c34c70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:15.235092 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5ed155-de9a-4321-9047-b709a1c34c70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:15.236739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5ed155-de9a-4321-9047-b709a1c34c70 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:15.249958 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 350/706] 10.222.0.24 () {56 vars in 1148 bytes} [Mon May 16 18:55:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:15.251008 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ed155-de9a-4321-9047-b709a1c34c70 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:15.261407 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466ef91-ff75-4b09-88c4-6fd67cd5d2d1 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:15.294959 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ce2f6-3e0c-48c5-a169-fd55d67e82dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:15.295748 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ce2f6-3e0c-48c5-a169-fd55d67e82dc None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:15.296100 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ce2f6-3e0c-48c5-a169-fd55d67e82dc None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:15.296442 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ce2f6-3e0c-48c5-a169-fd55d67e82dc None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:15.297229 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ce2f6-3e0c-48c5-a169-fd55d67e82dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:15.298777 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ce2f6-3e0c-48c5-a169-fd55d67e82dc None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:15.325722 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 357/707] 10.222.0.24 () {60 vars in 1132 bytes} [Mon May 16 18:55:15 2022] POST /identity/v3/users => generated 254 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:55:15.326897 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ce2f6-3e0c-48c5-a169-fd55d67e82dc None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:15.354158 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ed155-de9a-4321-9047-b709a1c34c70 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:15.396432 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e386908-651c-40b5-902b-23af0a1f2713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:15.397061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e386908-651c-40b5-902b-23af0a1f2713 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:15.397362 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e386908-651c-40b5-902b-23af0a1f2713 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:15.397653 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e386908-651c-40b5-902b-23af0a1f2713 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:15.398740 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e386908-651c-40b5-902b-23af0a1f2713 None admin] RBAC: Adding query filter params (role.id=48c59cffd0c84f83b89761ff42040687, scope.project.id=084e70bbad784892b195bb11a68bf857, user.id=654e435a35c4491eb87943734ce280f4) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:15.399061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e386908-651c-40b5-902b-23af0a1f2713 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:15.401464 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e386908-651c-40b5-902b-23af0a1f2713 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:15.409835 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 351/708] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:55:15 2022] GET /identity/v3/role_assignments?user.id=654e435a35c4491eb87943734ce280f4&scope.project.id=084e70bbad784892b195bb11a68bf857&role.id=48c59cffd0c84f83b89761ff42040687 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:15.411887 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fb78c-d1d4-4235-b260-5d5fe1ce3569 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:15.412542 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fb78c-d1d4-4235-b260-5d5fe1ce3569 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:15.412938 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fb78c-d1d4-4235-b260-5d5fe1ce3569 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:15.417724 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 352/709] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:15.420692 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73411565-19dd-42a2-b867-9103e28e00fe None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:15.422009 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73411565-19dd-42a2-b867-9103e28e00fe None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:15.422596 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73411565-19dd-42a2-b867-9103e28e00fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:15.445432 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-73411565-19dd-42a2-b867-9103e28e00fe None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:15.447263 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-73411565-19dd-42a2-b867-9103e28e00fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:15.467072 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ce2f6-3e0c-48c5-a169-fd55d67e82dc None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:15.503441 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55b656-b61c-4643-a4c1-05b9235b5150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:15.503892 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55b656-b61c-4643-a4c1-05b9235b5150 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:15.504264 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55b656-b61c-4643-a4c1-05b9235b5150 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:15.504628 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55b656-b61c-4643-a4c1-05b9235b5150 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:15.505598 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55b656-b61c-4643-a4c1-05b9235b5150 None admin] RBAC: Adding query filter params (role.id=5a6e54e81bb24eceb618d9ffa67f488e, scope.project.id=084e70bbad784892b195bb11a68bf857, user.id=1f03aa520ee14615b802cdbc3cd4f87d) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:15.506032 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55b656-b61c-4643-a4c1-05b9235b5150 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:15.507844 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55b656-b61c-4643-a4c1-05b9235b5150 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:15.514797 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 358/710] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:55:15 2022] GET /identity/v3/role_assignments?user.id=1f03aa520ee14615b802cdbc3cd4f87d&scope.project.id=084e70bbad784892b195bb11a68bf857&role.id=5a6e54e81bb24eceb618d9ffa67f488e => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:15.540664 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 353/711] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:55:15.580118 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55b656-b61c-4643-a4c1-05b9235b5150 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:15.707938 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55b656-b61c-4643-a4c1-05b9235b5150 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:15.749501 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e42ceb-1ac3-4c83-b672-76cb73868737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:15.750425 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e42ceb-1ac3-4c83-b672-76cb73868737 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:15.750702 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e42ceb-1ac3-4c83-b672-76cb73868737 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:15.750970 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e42ceb-1ac3-4c83-b672-76cb73868737 None admin] PATH_INFO: `/v3/services/network` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:15.751631 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e42ceb-1ac3-4c83-b672-76cb73868737 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:15.753589 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e42ceb-1ac3-4c83-b672-76cb73868737 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:15.767450 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-83e42ceb-1ac3-4c83-b672-76cb73868737 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 16 18:55:15.767450 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:15.767450 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:55:15.767450 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:55:15.767450 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:55:15.767450 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:55:15.767450 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:55:15.767450 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:15.767450 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 18:55:15.767450 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:15.767450 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:55:15.767450 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:15.767450 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:15.767450 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:15.767450 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:15.767450 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:15.767450 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:15.768515 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:15.768515 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:15.768515 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:15.768515 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:15.768515 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:15.768515 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:15.768515 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:55:15.768515 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:55:15.768515 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:55:15.768515 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:55:15.768515 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:15.768515 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:15.768515 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:15.768515 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:15.768515 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:15.768515 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:15.769365 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:15.769365 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:15.769365 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:15.769365 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:15.769365 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:15.769365 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:15.769365 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:15.769365 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:15.769365 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:15.769365 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:15.769365 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:55:15.769365 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:15.769365 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 18:55:15.769365 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:15.769365 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 359/712] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:55:15 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:15.779068 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73411565-19dd-42a2-b867-9103e28e00fe None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:15.819320 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452624e2-8e8e-4627-9341-8f2e7026e62d None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:15.819671 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452624e2-8e8e-4627-9341-8f2e7026e62d None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:15.820028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452624e2-8e8e-4627-9341-8f2e7026e62d None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:15.821684 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 360/713] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:55:15.827831 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b871506-bbc0-4e27-9033-a5ab87f0e5e0 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:15.828366 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b871506-bbc0-4e27-9033-a5ab87f0e5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:15.828854 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b871506-bbc0-4e27-9033-a5ab87f0e5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:15.849642 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-6b871506-bbc0-4e27-9033-a5ab87f0e5e0 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:15.851583 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6b871506-bbc0-4e27-9033-a5ab87f0e5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:15.888664 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73411565-19dd-42a2-b867-9103e28e00fe None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:15.926475 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10744e16-f72c-4626-87a2-e3c34dfb8669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:15.927146 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10744e16-f72c-4626-87a2-e3c34dfb8669 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:15.927433 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10744e16-f72c-4626-87a2-e3c34dfb8669 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:15.927702 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10744e16-f72c-4626-87a2-e3c34dfb8669 None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:15.928415 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10744e16-f72c-4626-87a2-e3c34dfb8669 None admin] RBAC: Adding query filter params (name=network) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:15.928722 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10744e16-f72c-4626-87a2-e3c34dfb8669 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:15.930207 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10744e16-f72c-4626-87a2-e3c34dfb8669 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:15.938184 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 354/714] 10.222.0.24 () {56 vars in 1112 bytes} [Mon May 16 18:55:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:15.939770 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 361/715] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:55:15.942574 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10744e16-f72c-4626-87a2-e3c34dfb8669 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:15.963067 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b871506-bbc0-4e27-9033-a5ab87f0e5e0 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:16.067590 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10744e16-f72c-4626-87a2-e3c34dfb8669 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:16.090097 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b871506-bbc0-4e27-9033-a5ab87f0e5e0 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:16.106383 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d25a5-2d47-40c9-aca2-28d7eec24f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:16.107421 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d25a5-2d47-40c9-aca2-28d7eec24f83 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:16.107947 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d25a5-2d47-40c9-aca2-28d7eec24f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:16.108416 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d25a5-2d47-40c9-aca2-28d7eec24f83 None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:16.109326 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751d25a5-2d47-40c9-aca2-28d7eec24f83 None admin] RBAC: Adding query filter params (type=network) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:16.109879 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751d25a5-2d47-40c9-aca2-28d7eec24f83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:16.111918 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751d25a5-2d47-40c9-aca2-28d7eec24f83 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:16.119493 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 355/716] 10.222.0.24 () {56 vars in 1112 bytes} [Mon May 16 18:55:15 2022] GET /identity/v3/services?type=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:16.154754 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad8d815-c7d6-4315-a970-7757746a59bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:16.155586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8d815-c7d6-4315-a970-7757746a59bb None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:16.155858 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8d815-c7d6-4315-a970-7757746a59bb None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:16.156123 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8d815-c7d6-4315-a970-7757746a59bb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:16.156787 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad8d815-c7d6-4315-a970-7757746a59bb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:16.158777 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad8d815-c7d6-4315-a970-7757746a59bb None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:16.173657 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-3ad8d815-c7d6-4315-a970-7757746a59bb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 18:55:16.173657 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:16.173657 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:55:16.173657 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:55:16.173657 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:55:16.173657 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:55:16.173657 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:55:16.173657 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:16.173657 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 18:55:16.173657 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:16.173657 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:55:16.173657 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:16.173657 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:16.173657 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:16.173657 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:16.173657 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:16.174665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:16.174665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:16.174665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:16.174665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:16.174665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:16.174665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:16.174665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:16.174665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:55:16.174665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:55:16.174665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:55:16.174665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:55:16.174665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:16.174665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:16.174665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:16.174665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:16.174665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:16.175480 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:16.175480 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:16.175480 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:16.175480 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:16.175480 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:16.175480 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:16.175480 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:16.175480 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:16.175480 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:16.175480 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:16.175480 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:16.175480 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:55:16.175480 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:16.175480 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 18:55:16.175480 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:16.175480 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 362/717] 10.222.0.24 () {56 vars in 1129 bytes} [Mon May 16 18:55:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:55:16.183069 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d25a5-2d47-40c9-aca2-28d7eec24f83 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:16.330170 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d25a5-2d47-40c9-aca2-28d7eec24f83 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:16.369110 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f2f49-3696-4c91-a0b6-7f92ab5a426b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:16.370196 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f2f49-3696-4c91-a0b6-7f92ab5a426b None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:16.370658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f2f49-3696-4c91-a0b6-7f92ab5a426b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:16.371106 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f2f49-3696-4c91-a0b6-7f92ab5a426b None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:16.371999 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f2f49-3696-4c91-a0b6-7f92ab5a426b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:16.372499 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f2f49-3696-4c91-a0b6-7f92ab5a426b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:16.374085 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f2f49-3696-4c91-a0b6-7f92ab5a426b None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:16.379484 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 356/718] 10.222.0.24 () {56 vars in 1124 bytes} [Mon May 16 18:55:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:16.385367 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad8d815-c7d6-4315-a970-7757746a59bb None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:16.499144 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad8d815-c7d6-4315-a970-7757746a59bb None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:16.536604 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6fb1f5-3a47-4ca3-b3ca-4fe1e2177878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:16.537696 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6fb1f5-3a47-4ca3-b3ca-4fe1e2177878 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:16.537978 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6fb1f5-3a47-4ca3-b3ca-4fe1e2177878 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:16.538243 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6fb1f5-3a47-4ca3-b3ca-4fe1e2177878 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:16.538963 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6fb1f5-3a47-4ca3-b3ca-4fe1e2177878 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:16.539271 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6fb1f5-3a47-4ca3-b3ca-4fe1e2177878 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:16.540702 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6fb1f5-3a47-4ca3-b3ca-4fe1e2177878 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:16.547403 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 363/719] 10.222.0.24 () {56 vars in 1124 bytes} [Mon May 16 18:55:16 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:18.040084 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3a94f-8b61-4525-a831-4c8ac93ef70f None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:18.041200 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3a94f-8b61-4525-a831-4c8ac93ef70f None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:18.041737 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3a94f-8b61-4525-a831-4c8ac93ef70f None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:18.043745 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 357/720] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:18.049280 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af9e61-9324-4d38-b29f-3432bba0845b None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:18.050221 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af9e61-9324-4d38-b29f-3432bba0845b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:18.050718 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af9e61-9324-4d38-b29f-3432bba0845b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:18.074460 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-d5af9e61-9324-4d38-b29f-3432bba0845b None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:18.075977 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d5af9e61-9324-4d38-b29f-3432bba0845b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:18.173217 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 364/721] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:55:18.219171 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3a94f-8b61-4525-a831-4c8ac93ef70f None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:18.361108 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3a94f-8b61-4525-a831-4c8ac93ef70f None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:18.404380 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4aabb9-cf01-4965-9a11-9ad735283a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:18.405197 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4aabb9-cf01-4965-9a11-9ad735283a5b None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:18.405478 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4aabb9-cf01-4965-9a11-9ad735283a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:18.405789 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4aabb9-cf01-4965-9a11-9ad735283a5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:18.418689 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4aabb9-cf01-4965-9a11-9ad735283a5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:55:18.426379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-bd4aabb9-cf01-4965-9a11-9ad735283a5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:55:18.426379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:18.426379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:18.426379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:18.426379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:18.426379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:18.426379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:18.426379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:18.426379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:18.426379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:18.426379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:18.426379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:18.426379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:55:18.426379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:55:18.426379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:55:18.426379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:55:18.427429 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:55:18.427429 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:55:18.427429 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:55:18.427429 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:55:18.427429 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:18.427429 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:18.427429 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:18.427429 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:18.427429 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:18.427429 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:18.427429 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:18.427429 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:18.427429 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:18.427429 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:18.427429 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:18.427429 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:18.428341 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:18.428341 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:18.428341 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:18.428341 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:18.428341 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:55:18.428341 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:55:18.428341 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:55:18.428341 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:55:18.428341 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:55:18.428341 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:55:18.428341 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:55:18.428341 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:18.428341 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 358/722] 10.222.0.24 () {56 vars in 1096 bytes} [Mon May 16 18:55:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:18.435645 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af9e61-9324-4d38-b29f-3432bba0845b None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:18.507212 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa8d61-ba96-43ad-9a62-15a852cbf24e None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:18.507510 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa8d61-ba96-43ad-9a62-15a852cbf24e None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:18.507949 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa8d61-ba96-43ad-9a62-15a852cbf24e None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:18.509782 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 359/723] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:18.518278 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37750b95-2a06-4fe8-be69-f22e6cc34899 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:18.518636 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37750b95-2a06-4fe8-be69-f22e6cc34899 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:18.518991 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37750b95-2a06-4fe8-be69-f22e6cc34899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:18.540026 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-37750b95-2a06-4fe8-be69-f22e6cc34899 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:18.541566 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-37750b95-2a06-4fe8-be69-f22e6cc34899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:18.588624 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af9e61-9324-4d38-b29f-3432bba0845b None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:18.660294 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77f0e8-99ab-4344-9d1e-46145698c928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:18.660987 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77f0e8-99ab-4344-9d1e-46145698c928 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:18.661265 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77f0e8-99ab-4344-9d1e-46145698c928 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:18.661551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77f0e8-99ab-4344-9d1e-46145698c928 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:18.662679 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad77f0e8-99ab-4344-9d1e-46145698c928 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:18.662985 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad77f0e8-99ab-4344-9d1e-46145698c928 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:18.664398 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad77f0e8-99ab-4344-9d1e-46145698c928 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:18.669558 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 360/724] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:55:18.676703 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 365/725] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:55:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:18.686755 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37750b95-2a06-4fe8-be69-f22e6cc34899 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:18.694224 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77f0e8-99ab-4344-9d1e-46145698c928 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:18.793376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37750b95-2a06-4fe8-be69-f22e6cc34899 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:18.799633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77f0e8-99ab-4344-9d1e-46145698c928 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:18.827523 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1db47c-53db-4864-8a9d-792722627cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:18.828230 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1db47c-53db-4864-8a9d-792722627cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:18.828515 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1db47c-53db-4864-8a9d-792722627cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:18.828789 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1db47c-53db-4864-8a9d-792722627cf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:18.839457 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e6d84-1087-4197-a35a-36b13393e1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:18.839773 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1db47c-53db-4864-8a9d-792722627cf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:18.840812 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e6d84-1087-4197-a35a-36b13393e1ae None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:18.841254 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1db47c-53db-4864-8a9d-792722627cf8 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:18.841738 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e6d84-1087-4197-a35a-36b13393e1ae None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:18.842278 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e6d84-1087-4197-a35a-36b13393e1ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:18.853395 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e6d84-1087-4197-a35a-36b13393e1ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:55:18.859568 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-ff1db47c-53db-4864-8a9d-792722627cf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:18.859568 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:18.859568 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:18.859568 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:18.859568 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:18.859568 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:18.859568 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:18.859568 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:18.859568 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:18.859568 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:18.859568 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:18.859568 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:18.859568 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:18.859568 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:18.859568 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:18.860440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:18.860440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:18.860440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:18.860440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:18.860440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:18.860440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:18.860440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:18.860440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:18.860440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:18.860440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:18.860440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:18.860440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:18.860440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:18.860440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:18.860440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:18.860440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:18.860440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:18.861316 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:18.861316 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:18.861316 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:18.861316 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:18.861316 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 361/726] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:18.861622 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-372e6d84-1087-4197-a35a-36b13393e1ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 18:55:18.861622 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:18.861622 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:18.861622 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:18.861622 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:18.861622 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:18.861622 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:18.861622 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:18.861622 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:18.861622 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:18.861622 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:18.861622 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:18.861622 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:55:18.861622 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:55:18.861622 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:55:18.861622 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:55:18.862481 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:55:18.862481 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:55:18.862481 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:55:18.862481 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:55:18.862481 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:18.862481 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:18.862481 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:18.862481 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:18.862481 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:18.862481 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:18.862481 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:18.862481 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:18.862481 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:18.862481 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:18.862481 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:18.862481 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:18.863323 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:18.863323 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:18.863323 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:18.863323 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:18.863323 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:55:18.863323 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:55:18.863323 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:55:18.863323 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:55:18.863323 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:55:18.863323 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:55:18.863323 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 18:55:18.863323 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:18.863951 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca00cb9-03bd-4901-ab1d-faf39313367a None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:18.863951 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca00cb9-03bd-4901-ab1d-faf39313367a None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:18.863951 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca00cb9-03bd-4901-ab1d-faf39313367a None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:18.865055 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 362/727] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:18.869614 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f81020-53e0-41f7-85d8-c5dd44c0fcd3 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:18.869614 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f81020-53e0-41f7-85d8-c5dd44c0fcd3 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:18.869614 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f81020-53e0-41f7-85d8-c5dd44c0fcd3 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:18.870140 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 366/728] 10.222.0.24 () {56 vars in 1102 bytes} [Mon May 16 18:55:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:18.870287 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 363/729] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:18.870429 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e6d84-1087-4197-a35a-36b13393e1ae None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:18.870583 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43307524-86f5-4fca-b75a-c9cfa9866126 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:18.870583 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43307524-86f5-4fca-b75a-c9cfa9866126 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:18.870583 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43307524-86f5-4fca-b75a-c9cfa9866126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:18.889429 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-43307524-86f5-4fca-b75a-c9cfa9866126 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:18.890897 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-43307524-86f5-4fca-b75a-c9cfa9866126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:18.955383 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 364/730] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:55:18.956260 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43307524-86f5-4fca-b75a-c9cfa9866126 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:18.980496 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e6d84-1087-4197-a35a-36b13393e1ae None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:19.013473 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4bbe86-a1de-4eec-a9d9-b9998a919632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:19.014444 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bbe86-a1de-4eec-a9d9-b9998a919632 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:19.014729 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bbe86-a1de-4eec-a9d9-b9998a919632 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:19.015002 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bbe86-a1de-4eec-a9d9-b9998a919632 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:19.015756 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4bbe86-a1de-4eec-a9d9-b9998a919632 None admin] RBAC: Adding query filter params (name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:19.016063 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4bbe86-a1de-4eec-a9d9-b9998a919632 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:19.017486 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4bbe86-a1de-4eec-a9d9-b9998a919632 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:19.030202 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 367/731] 10.222.0.24 () {56 vars in 1103 bytes} [Mon May 16 18:55:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:55:19.030202 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07a4ae-65bc-4867-966a-607f0b908131 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:19.030202 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07a4ae-65bc-4867-966a-607f0b908131 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:19.030202 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07a4ae-65bc-4867-966a-607f0b908131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:19.045982 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-2e07a4ae-65bc-4867-966a-607f0b908131 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:19.047161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2e07a4ae-65bc-4867-966a-607f0b908131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:19.058155 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43307524-86f5-4fca-b75a-c9cfa9866126 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:19.091121 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a11686-90de-4927-965b-72dbfe4ef2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:19.091896 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a11686-90de-4927-965b-72dbfe4ef2fe None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:19.092193 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a11686-90de-4927-965b-72dbfe4ef2fe None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:19.092498 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a11686-90de-4927-965b-72dbfe4ef2fe None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:19.093197 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a11686-90de-4927-965b-72dbfe4ef2fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:19.093506 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a11686-90de-4927-965b-72dbfe4ef2fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:19.094916 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a11686-90de-4927-965b-72dbfe4ef2fe None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:19.106527 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 365/732] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:19.107259 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a11686-90de-4927-965b-72dbfe4ef2fe None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:19.114521 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 368/733] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:55:19.115965 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07a4ae-65bc-4867-966a-607f0b908131 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:19.211152 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a11686-90de-4927-965b-72dbfe4ef2fe None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:19.224155 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07a4ae-65bc-4867-966a-607f0b908131 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:19.246197 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0feb8-f289-468f-915a-c20674a90a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:19.247017 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0feb8-f289-468f-915a-c20674a90a53 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:19.247293 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0feb8-f289-468f-915a-c20674a90a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:19.247570 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0feb8-f289-468f-915a-c20674a90a53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:19.257303 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e78537-1bb1-4311-a6c0-863593001783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:19.257439 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df0feb8-f289-468f-915a-c20674a90a53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:55:19.258123 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e78537-1bb1-4311-a6c0-863593001783 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:19.258564 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e78537-1bb1-4311-a6c0-863593001783 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:19.258847 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e78537-1bb1-4311-a6c0-863593001783 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:19.265292 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-0df0feb8-f289-468f-915a-c20674a90a53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:55:19.265292 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:19.265292 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:19.265292 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:19.265292 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:19.265292 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:19.265292 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:19.265292 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:19.265292 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:19.265292 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:19.265292 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:19.265292 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:19.265292 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:55:19.265292 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:55:19.265292 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:55:19.265292 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:55:19.266235 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:55:19.266235 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:55:19.266235 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:55:19.266235 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:55:19.266235 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:19.266235 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:19.266235 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:19.266235 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:19.266235 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:19.266235 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:19.266235 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:19.266235 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:19.266235 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:19.266235 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:19.266235 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:19.266235 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:19.267165 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:19.267165 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:19.267165 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:19.267165 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:19.267165 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:55:19.267165 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:55:19.267165 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:55:19.267165 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:55:19.267165 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:55:19.267165 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:55:19.267165 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:55:19.267165 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:19.267165 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 366/734] 10.222.0.24 () {56 vars in 1096 bytes} [Mon May 16 18:55:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:19.267849 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0feb8-f289-468f-915a-c20674a90a53 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:19.273242 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e78537-1bb1-4311-a6c0-863593001783 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:19.274768 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e78537-1bb1-4311-a6c0-863593001783 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:19.292644 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-65e78537-1bb1-4311-a6c0-863593001783 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:19.292644 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:19.292644 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:19.292644 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:19.292644 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:19.292644 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:19.292644 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:19.292644 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:19.292644 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:19.292644 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:19.292644 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:19.292644 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:19.292644 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:19.292644 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:19.292644 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:19.293560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:19.293560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:19.293560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:19.293560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:19.293560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:19.293560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:19.293560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:19.293560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:19.293560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:19.293560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:19.293560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:19.293560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:19.293560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:19.293560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:19.293560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:19.293560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:19.293560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:19.294523 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:19.294523 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:19.294523 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:19.294523 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:19.294523 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 369/735] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:19.295395 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e78537-1bb1-4311-a6c0-863593001783 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:19.373174 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0feb8-f289-468f-915a-c20674a90a53 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:19.390546 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e78537-1bb1-4311-a6c0-863593001783 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:19.404206 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca13c3-8ae8-44d6-838d-61e7ff01a3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:19.405013 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca13c3-8ae8-44d6-838d-61e7ff01a3a7 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:19.405297 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca13c3-8ae8-44d6-838d-61e7ff01a3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:19.405599 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca13c3-8ae8-44d6-838d-61e7ff01a3a7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:19.413278 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca13c3-8ae8-44d6-838d-61e7ff01a3a7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:19.414811 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca13c3-8ae8-44d6-838d-61e7ff01a3a7 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:19.423507 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3278790-6071-4b5a-9abf-9f2a42c921cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:19.424169 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3278790-6071-4b5a-9abf-9f2a42c921cd None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:19.424453 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3278790-6071-4b5a-9abf-9f2a42c921cd None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:19.424728 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3278790-6071-4b5a-9abf-9f2a42c921cd None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:19.425453 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3278790-6071-4b5a-9abf-9f2a42c921cd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:19.426850 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3278790-6071-4b5a-9abf-9f2a42c921cd None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:19.428723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-b6ca13c3-8ae8-44d6-838d-61e7ff01a3a7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 18:55:19.428723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:19.428723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:19.428723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:19.428723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:19.428723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:19.428723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:19.428723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:19.428723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:19.428723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:19.428723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:19.428723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:19.428723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:55:19.428723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:55:19.428723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:55:19.428723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:55:19.429658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:19.429658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:19.429658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:55:19.429658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:19.429658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:55:19.429658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:19.429658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:19.429658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:19.429658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:19.429658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:19.429658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:19.429658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:19.429658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:19.429658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:19.429658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:19.429658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:19.429658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:19.429658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:19.430739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:19.430739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:19.430739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:55:19.430739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:55:19.430739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:55:19.430739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:55:19.430739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:55:19.430739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:55:19.430739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 18:55:19.430739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:19.430739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 367/736] 10.222.0.24 () {56 vars in 1093 bytes} [Mon May 16 18:55:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:19.430739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca13c3-8ae8-44d6-838d-61e7ff01a3a7 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:19.446129 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 370/737] 10.222.0.24 () {60 vars in 1141 bytes} [Mon May 16 18:55:19 2022] POST /identity/v3/services => generated 240 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:55:19.446962 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3278790-6071-4b5a-9abf-9f2a42c921cd None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:19.536070 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca13c3-8ae8-44d6-838d-61e7ff01a3a7 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:19.582443 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22858313-34fe-4a1f-9f11-fedba1398735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:19.583318 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22858313-34fe-4a1f-9f11-fedba1398735 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:19.583604 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22858313-34fe-4a1f-9f11-fedba1398735 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:19.583881 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22858313-34fe-4a1f-9f11-fedba1398735 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:19.584355 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3278790-6071-4b5a-9abf-9f2a42c921cd None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:19.584655 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22858313-34fe-4a1f-9f11-fedba1398735 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:19.584966 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22858313-34fe-4a1f-9f11-fedba1398735 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:19.586825 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22858313-34fe-4a1f-9f11-fedba1398735 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:19.598209 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 368/738] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:55:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:19.599825 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5bbaf-8f45-47a0-ad23-0cbd22f3cdeb None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:19.600114 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5bbaf-8f45-47a0-ad23-0cbd22f3cdeb None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:19.600389 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5bbaf-8f45-47a0-ad23-0cbd22f3cdeb None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:19.601907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 369/739] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:19.602463 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5bbaf-8f45-47a0-ad23-0cbd22f3cdeb None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:19.636210 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36787a-b4d5-4634-9ab5-14d5fca1b8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:19.636431 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36787a-b4d5-4634-9ab5-14d5fca1b8ac None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:19.636637 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36787a-b4d5-4634-9ab5-14d5fca1b8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:19.636911 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36787a-b4d5-4634-9ab5-14d5fca1b8ac None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:19.637685 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c36787a-b4d5-4634-9ab5-14d5fca1b8ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:19.637989 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c36787a-b4d5-4634-9ab5-14d5fca1b8ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:19.639408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c36787a-b4d5-4634-9ab5-14d5fca1b8ac None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:19.651427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 371/740] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:19.652805 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36787a-b4d5-4634-9ab5-14d5fca1b8ac None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:19.712505 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5bbaf-8f45-47a0-ad23-0cbd22f3cdeb None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:19.743949 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62dd2c2-4095-4fce-a447-5267797c8ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:19.744621 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62dd2c2-4095-4fce-a447-5267797c8ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:19.744917 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62dd2c2-4095-4fce-a447-5267797c8ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:19.745191 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62dd2c2-4095-4fce-a447-5267797c8ed2 None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:19.746072 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62dd2c2-4095-4fce-a447-5267797c8ed2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:19.746384 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62dd2c2-4095-4fce-a447-5267797c8ed2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:19.747835 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62dd2c2-4095-4fce-a447-5267797c8ed2 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:19.754088 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36787a-b4d5-4634-9ab5-14d5fca1b8ac None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:19.764990 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 370/741] 10.222.0.24 () {56 vars in 1133 bytes} [Mon May 16 18:55:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:19.766382 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542478ea-7573-4ae5-a757-5acac31855d0 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:19.766739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542478ea-7573-4ae5-a757-5acac31855d0 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:19.767075 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542478ea-7573-4ae5-a757-5acac31855d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:19.783267 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-542478ea-7573-4ae5-a757-5acac31855d0 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:19.784433 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-542478ea-7573-4ae5-a757-5acac31855d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:19.791795 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21be92-6436-4587-836f-78e940706a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:19.792943 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21be92-6436-4587-836f-78e940706a9d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:19.793230 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21be92-6436-4587-836f-78e940706a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:19.793506 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21be92-6436-4587-836f-78e940706a9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:19.804666 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21be92-6436-4587-836f-78e940706a9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:19.806235 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21be92-6436-4587-836f-78e940706a9d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:19.823201 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-ab21be92-6436-4587-836f-78e940706a9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:19.823201 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:19.823201 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:19.823201 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:19.823201 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:19.823201 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:19.823201 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:19.823201 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:19.823201 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:19.823201 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:19.823201 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:19.823201 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:19.823201 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:19.823201 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:19.823201 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:19.824175 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:19.824175 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:19.824175 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:19.824175 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:19.824175 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:19.824175 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:19.824175 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:19.824175 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:19.824175 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:19.824175 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:19.824175 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:19.824175 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:19.824175 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:19.824175 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:19.824175 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:19.824175 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:19.824175 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:19.825133 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:19.825133 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:19.825133 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:19.825133 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:19.825133 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 372/742] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:19.825413 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21be92-6436-4587-836f-78e940706a9d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:19.861715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 371/743] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:19 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:55:19.861715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542478ea-7573-4ae5-a757-5acac31855d0 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:19.934696 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21be92-6436-4587-836f-78e940706a9d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:19.953610 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542478ea-7573-4ae5-a757-5acac31855d0 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:19.966836 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ca3ee-05e6-452e-9dbb-e9dae2585bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:19.967677 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ca3ee-05e6-452e-9dbb-e9dae2585bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:19.967960 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ca3ee-05e6-452e-9dbb-e9dae2585bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:19.968239 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ca3ee-05e6-452e-9dbb-e9dae2585bf3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:19.976004 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ca3ee-05e6-452e-9dbb-e9dae2585bf3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:19.977581 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ca3ee-05e6-452e-9dbb-e9dae2585bf3 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:19.990226 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770571a-9a3c-46dd-a946-77b98772246d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:19.991190 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770571a-9a3c-46dd-a946-77b98772246d None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:19.991471 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770571a-9a3c-46dd-a946-77b98772246d None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:19.991743 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770571a-9a3c-46dd-a946-77b98772246d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:19.993333 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-588ca3ee-05e6-452e-9dbb-e9dae2585bf3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 18:55:19.993333 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:19.993333 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:19.993333 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:19.993333 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:19.993333 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:19.993333 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:19.993333 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:19.993333 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:19.993333 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:19.993333 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:19.993333 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:19.993333 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:55:19.993333 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:55:19.993333 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:55:19.993333 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:55:19.994431 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:19.994431 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:19.994431 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:55:19.994431 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:19.994431 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:55:19.994431 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:19.994431 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:19.994431 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:19.994431 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:19.994431 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:19.994431 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:19.994431 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:19.994431 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:19.994431 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:19.994431 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:19.994431 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:19.994431 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:19.994431 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:19.995424 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:19.995424 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:19.995424 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:55:19.995424 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:55:19.995424 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:55:19.995424 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:55:19.995424 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:55:19.995424 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:55:19.995424 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 18:55:19.995424 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:19.995424 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 373/744] 10.222.0.24 () {56 vars in 1117 bytes} [Mon May 16 18:55:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:19.996024 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ca3ee-05e6-452e-9dbb-e9dae2585bf3 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:20.007793 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e770571a-9a3c-46dd-a946-77b98772246d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:20.009375 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e770571a-9a3c-46dd-a946-77b98772246d None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:20.026658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-e770571a-9a3c-46dd-a946-77b98772246d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:20.026658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:20.026658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:20.026658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:20.026658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:20.026658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:20.026658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:20.026658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:20.026658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:20.026658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:20.026658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:20.026658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:20.026658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:20.026658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:20.026658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:20.027588 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:20.027588 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:20.027588 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:20.027588 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:20.027588 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:20.027588 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:20.027588 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:20.027588 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:20.027588 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:20.027588 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:20.027588 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:20.027588 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:20.027588 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:20.027588 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:20.027588 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:20.027588 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:20.027588 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:20.028507 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:20.028507 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:20.028507 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:20.028507 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:20.028507 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 372/745] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:20.028807 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770571a-9a3c-46dd-a946-77b98772246d None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:20.099145 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ca3ee-05e6-452e-9dbb-e9dae2585bf3 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:20.134120 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a8755-1dc3-4510-a3e9-d0fb0afeb7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:20.135153 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770571a-9a3c-46dd-a946-77b98772246d None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:20.136101 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a8755-1dc3-4510-a3e9-d0fb0afeb7e8 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:20.136603 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a8755-1dc3-4510-a3e9-d0fb0afeb7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:20.137072 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a8755-1dc3-4510-a3e9-d0fb0afeb7e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:20.138035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a8755-1dc3-4510-a3e9-d0fb0afeb7e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:20.138537 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a8755-1dc3-4510-a3e9-d0fb0afeb7e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:20.140112 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a8755-1dc3-4510-a3e9-d0fb0afeb7e8 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:20.157663 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 374/746] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:20.157663 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a8755-1dc3-4510-a3e9-d0fb0afeb7e8 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:20.168504 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da07d29-c2f1-4e82-ab4c-46a13ec7fcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:20.169184 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da07d29-c2f1-4e82-ab4c-46a13ec7fcea None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:20.169466 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da07d29-c2f1-4e82-ab4c-46a13ec7fcea None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:20.169769 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da07d29-c2f1-4e82-ab4c-46a13ec7fcea None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:20.170502 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da07d29-c2f1-4e82-ab4c-46a13ec7fcea None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:20.171894 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da07d29-c2f1-4e82-ab4c-46a13ec7fcea None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:20.187185 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 373/747] 10.222.0.24 () {60 vars in 1141 bytes} [Mon May 16 18:55:20 2022] POST /identity/v3/services => generated 251 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:55:20.198640 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da07d29-c2f1-4e82-ab4c-46a13ec7fcea None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:20.266021 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a8755-1dc3-4510-a3e9-d0fb0afeb7e8 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:20.309797 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed6ec4-7f9b-49cc-ac7c-544f54da1dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:20.310585 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed6ec4-7f9b-49cc-ac7c-544f54da1dcf None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:20.310953 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed6ec4-7f9b-49cc-ac7c-544f54da1dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:20.311165 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed6ec4-7f9b-49cc-ac7c-544f54da1dcf None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:20.312179 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed6ec4-7f9b-49cc-ac7c-544f54da1dcf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:20.312495 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed6ec4-7f9b-49cc-ac7c-544f54da1dcf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:20.313996 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed6ec4-7f9b-49cc-ac7c-544f54da1dcf None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:20.314466 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da07d29-c2f1-4e82-ab4c-46a13ec7fcea None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:20.337946 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 375/748] 10.222.0.24 () {56 vars in 1149 bytes} [Mon May 16 18:55:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:20.338967 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed6ec4-7f9b-49cc-ac7c-544f54da1dcf None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:20.352058 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3774f-b655-432e-97ce-742f92c85dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:20.353160 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3774f-b655-432e-97ce-742f92c85dbd None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:20.353685 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3774f-b655-432e-97ce-742f92c85dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:20.354181 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3774f-b655-432e-97ce-742f92c85dbd None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:20.355111 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a3774f-b655-432e-97ce-742f92c85dbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:20.355656 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a3774f-b655-432e-97ce-742f92c85dbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:20.357404 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a3774f-b655-432e-97ce-742f92c85dbd None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:20.375303 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 374/749] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:20.376746 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3774f-b655-432e-97ce-742f92c85dbd None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:20.448517 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed6ec4-7f9b-49cc-ac7c-544f54da1dcf None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:20.493225 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d85e6-9c06-4dab-8f05-c1f2d53c73b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:20.494455 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d85e6-9c06-4dab-8f05-c1f2d53c73b9 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:20.495325 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d85e6-9c06-4dab-8f05-c1f2d53c73b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:20.495919 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d85e6-9c06-4dab-8f05-c1f2d53c73b9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:20.498178 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3774f-b655-432e-97ce-742f92c85dbd None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:20.506670 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d85e6-9c06-4dab-8f05-c1f2d53c73b9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:20.509156 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d85e6-9c06-4dab-8f05-c1f2d53c73b9 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:20.532001 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-c43d85e6-9c06-4dab-8f05-c1f2d53c73b9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 18:55:20.532001 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:20.532001 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:20.532001 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:20.532001 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:20.532001 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:20.532001 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:20.532001 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:20.532001 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:20.532001 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:20.532001 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:20.532001 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:20.532001 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:55:20.532001 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:55:20.532001 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:55:20.532001 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:55:20.533015 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:20.533015 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:20.533015 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:55:20.533015 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:20.533015 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:55:20.533015 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:20.533015 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:20.533015 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:20.533015 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:20.533015 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:20.533015 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:20.533015 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:20.533015 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:20.533015 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:20.533015 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:20.533015 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:20.533015 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:20.533015 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:20.534017 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:20.534017 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:20.534017 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:55:20.534017 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:55:20.534017 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:55:20.534017 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:55:20.534017 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:55:20.534017 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:55:20.534017 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 18:55:20.534017 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:20.537603 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 376/750] 10.222.0.24 () {56 vars in 1096 bytes} [Mon May 16 18:55:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:20.538665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d85e6-9c06-4dab-8f05-c1f2d53c73b9 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:20.542176 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610dd39-7a1f-4c55-9167-1e3f32347d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:20.543413 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610dd39-7a1f-4c55-9167-1e3f32347d97 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:20.544832 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610dd39-7a1f-4c55-9167-1e3f32347d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:20.545322 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610dd39-7a1f-4c55-9167-1e3f32347d97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:20.628790 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610dd39-7a1f-4c55-9167-1e3f32347d97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:20.630756 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610dd39-7a1f-4c55-9167-1e3f32347d97 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:20.675639 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d85e6-9c06-4dab-8f05-c1f2d53c73b9 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:20.718734 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ed91b-383d-4fce-aaf4-6048cb542a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:20.719774 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ed91b-383d-4fce-aaf4-6048cb542a97 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:20.720119 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ed91b-383d-4fce-aaf4-6048cb542a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:20.720459 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ed91b-383d-4fce-aaf4-6048cb542a97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:20.729627 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ed91b-383d-4fce-aaf4-6048cb542a97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:20.731888 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ed91b-383d-4fce-aaf4-6048cb542a97 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:20.735812 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 375/751] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:55:20 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 18:55:20.736908 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610dd39-7a1f-4c55-9167-1e3f32347d97 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:20.749757 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-c64ed91b-383d-4fce-aaf4-6048cb542a97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:20.749757 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:20.749757 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:20.749757 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:20.749757 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:20.749757 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:20.749757 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:20.749757 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:20.749757 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:20.749757 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:20.749757 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:20.749757 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:20.749757 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:55:20.749757 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:55:20.749757 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:55:20.750692 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:55:20.750692 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:20.750692 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:20.750692 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:20.750692 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:20.750692 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:20.750692 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:20.750692 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:20.750692 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:20.750692 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:20.750692 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:20.750692 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:20.750692 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:20.750692 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:20.750692 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:20.750692 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:20.750692 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:20.751562 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:55:20.751562 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:55:20.751562 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:55:20.751562 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:55:20.751562 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:55:20.751562 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:55:20.751562 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:20.751562 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:20.753616 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 377/752] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:55:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:20.754643 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ed91b-383d-4fce-aaf4-6048cb542a97 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:20.845515 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610dd39-7a1f-4c55-9167-1e3f32347d97 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:20.879182 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde7838-e307-44f5-85a9-f48b6782c72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:20.880222 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde7838-e307-44f5-85a9-f48b6782c72e None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:20.880705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde7838-e307-44f5-85a9-f48b6782c72e None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:20.881173 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde7838-e307-44f5-85a9-f48b6782c72e None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:20.881945 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ed91b-383d-4fce-aaf4-6048cb542a97 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:20.882499 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde7838-e307-44f5-85a9-f48b6782c72e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:20.883020 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde7838-e307-44f5-85a9-f48b6782c72e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:20.884749 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde7838-e307-44f5-85a9-f48b6782c72e None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:20.902860 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 376/753] 10.222.0.24 () {56 vars in 1135 bytes} [Mon May 16 18:55:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:20.904050 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde7838-e307-44f5-85a9-f48b6782c72e None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:20.922403 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39473a-885a-4efd-9d20-a8c0e3b9b0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:20.923574 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39473a-885a-4efd-9d20-a8c0e3b9b0c5 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:20.924103 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39473a-885a-4efd-9d20-a8c0e3b9b0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:20.924732 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39473a-885a-4efd-9d20-a8c0e3b9b0c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:20.935208 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39473a-885a-4efd-9d20-a8c0e3b9b0c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:20.936970 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39473a-885a-4efd-9d20-a8c0e3b9b0c5 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:20.954826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-2a39473a-885a-4efd-9d20-a8c0e3b9b0c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:20.954826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:20.954826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:20.954826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:20.954826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:20.954826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:20.954826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:20.954826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:20.954826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:20.954826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:20.954826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:20.954826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:20.954826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:20.954826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:20.954826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:20.955768 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:20.955768 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:20.955768 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:20.955768 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:20.955768 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:20.955768 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:20.955768 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:20.955768 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:20.955768 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:20.955768 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:20.955768 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:20.955768 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:20.955768 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:20.955768 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:20.955768 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:20.955768 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:20.955768 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:20.956650 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:20.956650 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:20.956650 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:20.956650 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:20.958951 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 378/754] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:20.960011 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39473a-885a-4efd-9d20-a8c0e3b9b0c5 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:21.022088 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde7838-e307-44f5-85a9-f48b6782c72e None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:21.060773 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cef328-c307-487f-8fad-e14ad3f34599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:21.062024 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cef328-c307-487f-8fad-e14ad3f34599 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:21.062510 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cef328-c307-487f-8fad-e14ad3f34599 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:21.062978 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cef328-c307-487f-8fad-e14ad3f34599 None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:21.063979 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cef328-c307-487f-8fad-e14ad3f34599 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:21.064488 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cef328-c307-487f-8fad-e14ad3f34599 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:21.066198 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cef328-c307-487f-8fad-e14ad3f34599 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:21.069355 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39473a-885a-4efd-9d20-a8c0e3b9b0c5 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:21.079625 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 377/755] 10.222.0.24 () {56 vars in 1148 bytes} [Mon May 16 18:55:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:21.080880 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cef328-c307-487f-8fad-e14ad3f34599 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:21.106466 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd255add-1eda-418f-a5b4-4e06353c577e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:21.107524 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd255add-1eda-418f-a5b4-4e06353c577e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:21.108009 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd255add-1eda-418f-a5b4-4e06353c577e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:21.108479 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd255add-1eda-418f-a5b4-4e06353c577e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:21.180798 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd255add-1eda-418f-a5b4-4e06353c577e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:21.183092 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd255add-1eda-418f-a5b4-4e06353c577e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:21.191965 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cef328-c307-487f-8fad-e14ad3f34599 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:21.225312 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4df465-a815-4ad3-abab-2285934c227e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:21.225848 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4df465-a815-4ad3-abab-2285934c227e None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:21.226129 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4df465-a815-4ad3-abab-2285934c227e None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:21.226401 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4df465-a815-4ad3-abab-2285934c227e None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:21.227178 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4df465-a815-4ad3-abab-2285934c227e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:21.227473 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4df465-a815-4ad3-abab-2285934c227e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:21.228930 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4df465-a815-4ad3-abab-2285934c227e None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:21.241772 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 378/756] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:21.243027 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4df465-a815-4ad3-abab-2285934c227e None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:21.289644 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 379/757] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:55:20 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 18:55:21.291039 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd255add-1eda-418f-a5b4-4e06353c577e None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:21.340386 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4df465-a815-4ad3-abab-2285934c227e None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:21.374190 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6235c5-1235-44d9-a2bf-21d030229668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:21.375141 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6235c5-1235-44d9-a2bf-21d030229668 None admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:21.375427 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6235c5-1235-44d9-a2bf-21d030229668 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:21.375694 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6235c5-1235-44d9-a2bf-21d030229668 None admin] PATH_INFO: `/v3/projects/084e70bbad784892b195bb11a68bf857/users/1f03aa520ee14615b802cdbc3cd4f87d/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:21.377724 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6235c5-1235-44d9-a2bf-21d030229668 None admin] RBAC: Authorizing `identity:create_grant(project_id=084e70bbad784892b195bb11a68bf857, user_id=1f03aa520ee14615b802cdbc3cd4f87d, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:21.379219 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6235c5-1235-44d9-a2bf-21d030229668 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:21.393101 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd255add-1eda-418f-a5b4-4e06353c577e None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:21.397623 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 379/758] 10.222.0.24 () {58 vars in 1439 bytes} [Mon May 16 18:55:21 2022] PUT /identity/v3/projects/084e70bbad784892b195bb11a68bf857/users/1f03aa520ee14615b802cdbc3cd4f87d/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:55:21.398852 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6235c5-1235-44d9-a2bf-21d030229668 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:21.463726 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cdba12-fee0-465a-bd2d-94d0ac0ea169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:21.464895 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdba12-fee0-465a-bd2d-94d0ac0ea169 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:21.465399 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdba12-fee0-465a-bd2d-94d0ac0ea169 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:21.465895 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdba12-fee0-465a-bd2d-94d0ac0ea169 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:21.474064 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cdba12-fee0-465a-bd2d-94d0ac0ea169 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:21.475971 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cdba12-fee0-465a-bd2d-94d0ac0ea169 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:21.492786 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-35cdba12-fee0-465a-bd2d-94d0ac0ea169 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:21.492786 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:21.492786 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:21.492786 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:21.492786 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:21.492786 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:21.492786 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:21.492786 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:21.492786 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:21.492786 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:21.492786 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:21.492786 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:21.492786 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:55:21.492786 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:55:21.492786 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:55:21.493806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:55:21.493806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:21.493806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:21.493806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:21.493806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:21.493806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:21.493806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:21.493806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:21.493806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:21.493806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:21.493806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:21.493806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:21.493806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:21.493806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:21.493806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:21.493806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:21.493806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:21.494716 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:55:21.494716 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:55:21.494716 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:55:21.494716 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:55:21.494716 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:55:21.494716 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:55:21.494716 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:21.494716 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:21.498623 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 380/759] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:55:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:21.507367 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cdba12-fee0-465a-bd2d-94d0ac0ea169 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:21.593235 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6235c5-1235-44d9-a2bf-21d030229668 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:21.645988 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a676e-2ede-40b9-b7e1-4ab757389eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:21.646819 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a676e-2ede-40b9-b7e1-4ab757389eac None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:21.647096 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a676e-2ede-40b9-b7e1-4ab757389eac None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:21.647365 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a676e-2ede-40b9-b7e1-4ab757389eac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:21.661054 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a676e-2ede-40b9-b7e1-4ab757389eac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:21.663459 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a676e-2ede-40b9-b7e1-4ab757389eac None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:21.683935 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cdba12-fee0-465a-bd2d-94d0ac0ea169 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:21.684362 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-366a676e-2ede-40b9-b7e1-4ab757389eac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:21.684362 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:21.684362 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:21.684362 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:21.684362 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:21.684362 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:21.684362 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:21.684362 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:21.684362 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:21.684362 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:21.684362 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:21.684362 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:21.684362 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:21.684362 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:21.684362 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:21.685218 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:21.685218 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:21.685218 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:21.685218 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:21.685218 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:21.685218 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:21.685218 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:21.685218 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:21.685218 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:21.685218 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:21.685218 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:21.685218 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:21.685218 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:21.685218 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:21.685218 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:21.685218 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:21.685218 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:21.686795 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:21.686795 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:21.686795 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:21.686795 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:21.686795 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 380/760] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:21.691309 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a676e-2ede-40b9-b7e1-4ab757389eac None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:21.722319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7327a8-3f68-49df-8091-a2e60e3ca0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:21.723341 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7327a8-3f68-49df-8091-a2e60e3ca0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:21.723818 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7327a8-3f68-49df-8091-a2e60e3ca0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:21.724282 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7327a8-3f68-49df-8091-a2e60e3ca0e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:21.725262 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7327a8-3f68-49df-8091-a2e60e3ca0e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:21.725801 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7327a8-3f68-49df-8091-a2e60e3ca0e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:21.727489 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7327a8-3f68-49df-8091-a2e60e3ca0e9 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:21.740102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 381/761] 10.222.0.24 () {56 vars in 1148 bytes} [Mon May 16 18:55:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:21.746091 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7327a8-3f68-49df-8091-a2e60e3ca0e9 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:21.796160 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a676e-2ede-40b9-b7e1-4ab757389eac None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:21.831382 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93101ee-18cb-4034-80a5-acaccca6ea2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:21.832026 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93101ee-18cb-4034-80a5-acaccca6ea2c None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:21.832309 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93101ee-18cb-4034-80a5-acaccca6ea2c None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:21.832577 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93101ee-18cb-4034-80a5-acaccca6ea2c None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:21.833387 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93101ee-18cb-4034-80a5-acaccca6ea2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:21.833724 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93101ee-18cb-4034-80a5-acaccca6ea2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:21.835108 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93101ee-18cb-4034-80a5-acaccca6ea2c None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:21.851773 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 381/762] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:55:21.853191 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752a4fd-f007-46cf-a836-6390da111fcd None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:21.853480 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752a4fd-f007-46cf-a836-6390da111fcd None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:21.853777 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752a4fd-f007-46cf-a836-6390da111fcd None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:21.855636 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 382/763] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:21.856696 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752a4fd-f007-46cf-a836-6390da111fcd None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:21.870806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7327a8-3f68-49df-8091-a2e60e3ca0e9 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:21.913277 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cdd3bf-e731-4122-ae8a-edf057ca6524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:21.914633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdd3bf-e731-4122-ae8a-edf057ca6524 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:21.915353 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdd3bf-e731-4122-ae8a-edf057ca6524 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:21.915800 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdd3bf-e731-4122-ae8a-edf057ca6524 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:21.917241 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cdd3bf-e731-4122-ae8a-edf057ca6524 None admin] RBAC: Adding query filter params (role.id=48c59cffd0c84f83b89761ff42040687, scope.project.id=084e70bbad784892b195bb11a68bf857, user.id=4775e9dd7aea448d95ec7378b4ff3124) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:21.917772 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cdd3bf-e731-4122-ae8a-edf057ca6524 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:21.919797 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cdd3bf-e731-4122-ae8a-edf057ca6524 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:21.927484 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 382/764] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:55:21 2022] GET /identity/v3/role_assignments?user.id=4775e9dd7aea448d95ec7378b4ff3124&scope.project.id=084e70bbad784892b195bb11a68bf857&role.id=48c59cffd0c84f83b89761ff42040687 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:21.936475 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba041c-a5f1-42ad-941d-20fcdabc7732 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:21.936475 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba041c-a5f1-42ad-941d-20fcdabc7732 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:21.936475 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba041c-a5f1-42ad-941d-20fcdabc7732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:21.968980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752a4fd-f007-46cf-a836-6390da111fcd None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:21.978845 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-4bba041c-a5f1-42ad-941d-20fcdabc7732 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:21.980011 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4bba041c-a5f1-42ad-941d-20fcdabc7732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:22.031010 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f8c8d-71ee-47e7-9289-bc1dd9acac1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:22.031845 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f8c8d-71ee-47e7-9289-bc1dd9acac1e None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:22.032123 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f8c8d-71ee-47e7-9289-bc1dd9acac1e None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:22.032401 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f8c8d-71ee-47e7-9289-bc1dd9acac1e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:22.043092 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f8c8d-71ee-47e7-9289-bc1dd9acac1e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:22.044586 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f8c8d-71ee-47e7-9289-bc1dd9acac1e None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:22.071172 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-8f8f8c8d-71ee-47e7-9289-bc1dd9acac1e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:22.071172 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:22.071172 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:22.071172 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:22.071172 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:22.071172 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:22.071172 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:22.071172 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:22.071172 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:22.071172 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:22.071172 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:22.071172 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:22.071172 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:55:22.071172 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:55:22.071172 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:55:22.072323 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:55:22.072323 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:22.072323 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:22.072323 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:22.072323 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:22.072323 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:22.072323 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:22.072323 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:22.072323 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:22.072323 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:22.072323 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:22.072323 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:22.072323 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:22.072323 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:22.072323 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:22.072323 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:22.072323 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:22.073440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:55:22.073440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:55:22.073440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:55:22.073440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:55:22.073440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:55:22.073440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:55:22.073440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:22.073440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:22.083739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 383/765] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:55:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:55:22.084730 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f8c8d-71ee-47e7-9289-bc1dd9acac1e None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:22.110740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 383/766] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:55:22.148384 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba041c-a5f1-42ad-941d-20fcdabc7732 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:22.240648 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f8c8d-71ee-47e7-9289-bc1dd9acac1e None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:22.274107 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba041c-a5f1-42ad-941d-20fcdabc7732 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:22.315359 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ea367-3f8e-49d1-be76-6319fe558435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:22.316606 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ea367-3f8e-49d1-be76-6319fe558435 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:22.317917 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ee449-67cb-4137-90ea-5ca86996d46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:22.318875 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ee449-67cb-4137-90ea-5ca86996d46a None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:22.319318 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ee449-67cb-4137-90ea-5ca86996d46a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:22.319726 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ee449-67cb-4137-90ea-5ca86996d46a None admin] PATH_INFO: `/v3/services/network` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:22.320524 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ee449-67cb-4137-90ea-5ca86996d46a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:22.321932 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ea367-3f8e-49d1-be76-6319fe558435 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:22.322220 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ea367-3f8e-49d1-be76-6319fe558435 None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:22.322694 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ee449-67cb-4137-90ea-5ca86996d46a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:22.323053 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ea367-3f8e-49d1-be76-6319fe558435 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:22.323373 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ea367-3f8e-49d1-be76-6319fe558435 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:22.324986 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ea367-3f8e-49d1-be76-6319fe558435 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:22.341566 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 384/767] 10.222.0.24 () {56 vars in 1148 bytes} [Mon May 16 18:55:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:22.341907 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-286ee449-67cb-4137-90ea-5ca86996d46a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 16 18:55:22.341907 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:22.341907 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:55:22.341907 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:55:22.341907 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:55:22.341907 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:55:22.341907 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:55:22.341907 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:22.341907 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 18:55:22.341907 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:22.341907 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:55:22.341907 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:22.341907 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:22.341907 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:22.341907 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:22.341907 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:22.341907 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:22.343063 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:22.343063 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:22.343063 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:22.343063 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:22.343063 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:22.343063 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:22.343063 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:55:22.343063 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:55:22.343063 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:55:22.343063 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:55:22.343063 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:22.343063 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:22.343063 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:22.343063 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:22.343063 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:22.343063 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:22.344012 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:22.344012 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:22.344012 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:22.344012 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:22.344012 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:22.344012 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:22.344012 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:22.344012 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:22.344012 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:22.344012 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:22.344012 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:55:22.344012 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:22.344012 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 18:55:22.344012 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:22.346395 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 384/768] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:55:22 2022] GET /identity/v3/services/network => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:55:22.348139 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ea367-3f8e-49d1-be76-6319fe558435 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:22.351995 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ee449-67cb-4137-90ea-5ca86996d46a None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:22.518642 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ee449-67cb-4137-90ea-5ca86996d46a None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:22.535736 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ea367-3f8e-49d1-be76-6319fe558435 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:22.582493 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e8cff-4db1-45fa-936f-9320966e8e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:22.583196 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e8cff-4db1-45fa-936f-9320966e8e9e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:22.583482 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e8cff-4db1-45fa-936f-9320966e8e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:22.583760 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e8cff-4db1-45fa-936f-9320966e8e9e None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:22.584667 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e8cff-4db1-45fa-936f-9320966e8e9e None admin] RBAC: Adding query filter params (name=network) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:22.585123 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e8cff-4db1-45fa-936f-9320966e8e9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:22.586879 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e8cff-4db1-45fa-936f-9320966e8e9e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:22.592967 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 385/769] 10.222.0.24 () {56 vars in 1112 bytes} [Mon May 16 18:55:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:55:22.598594 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e8cff-4db1-45fa-936f-9320966e8e9e None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:22.623594 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc642a5c-4b7c-4fc7-bdd1-0649571b78ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:22.624262 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc642a5c-4b7c-4fc7-bdd1-0649571b78ec None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:22.624544 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc642a5c-4b7c-4fc7-bdd1-0649571b78ec None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:22.624820 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc642a5c-4b7c-4fc7-bdd1-0649571b78ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:22.626465 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc642a5c-4b7c-4fc7-bdd1-0649571b78ec None admin] RBAC: Adding query filter params (role.id=5a6e54e81bb24eceb618d9ffa67f488e, scope.project.id=084e70bbad784892b195bb11a68bf857, user.id=654e435a35c4491eb87943734ce280f4) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:22.626786 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc642a5c-4b7c-4fc7-bdd1-0649571b78ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:22.628241 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc642a5c-4b7c-4fc7-bdd1-0649571b78ec None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:22.637846 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 385/770] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:55:22 2022] GET /identity/v3/role_assignments?user.id=654e435a35c4491eb87943734ce280f4&scope.project.id=084e70bbad784892b195bb11a68bf857&role.id=5a6e54e81bb24eceb618d9ffa67f488e => generated 259 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:22.725104 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e8cff-4db1-45fa-936f-9320966e8e9e None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:22.767731 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90afcd-5227-4d06-a7d1-69873e6b16a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:22.768466 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90afcd-5227-4d06-a7d1-69873e6b16a0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:22.768805 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90afcd-5227-4d06-a7d1-69873e6b16a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:22.769022 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90afcd-5227-4d06-a7d1-69873e6b16a0 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:22.769781 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e90afcd-5227-4d06-a7d1-69873e6b16a0 None admin] RBAC: Adding query filter params (type=network) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:22.770091 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e90afcd-5227-4d06-a7d1-69873e6b16a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:22.771489 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e90afcd-5227-4d06-a7d1-69873e6b16a0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:22.777718 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 386/771] 10.222.0.24 () {56 vars in 1112 bytes} [Mon May 16 18:55:22 2022] GET /identity/v3/services?type=network => generated 350 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:22.783501 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc642a5c-4b7c-4fc7-bdd1-0649571b78ec None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:22.883084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65232c-dd52-44bb-a7b6-2a7ff9cba465 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:22.883526 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65232c-dd52-44bb-a7b6-2a7ff9cba465 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:22.883713 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65232c-dd52-44bb-a7b6-2a7ff9cba465 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:22.885333 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 387/772] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:55:22.901284 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d3cca-2bcf-4dd6-96db-ac81667d04c7 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:22.901284 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d3cca-2bcf-4dd6-96db-ac81667d04c7 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:22.901284 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d3cca-2bcf-4dd6-96db-ac81667d04c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:22.901665 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc642a5c-4b7c-4fc7-bdd1-0649571b78ec None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:22.930118 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-d31d3cca-2bcf-4dd6-96db-ac81667d04c7 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:22.931677 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d31d3cca-2bcf-4dd6-96db-ac81667d04c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:22.944862 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656e9cc-11b4-4535-9289-87852733f5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:22.950633 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656e9cc-11b4-4535-9289-87852733f5bf None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:22.950813 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656e9cc-11b4-4535-9289-87852733f5bf None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:22.951034 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656e9cc-11b4-4535-9289-87852733f5bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:22.951850 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656e9cc-11b4-4535-9289-87852733f5bf None admin] RBAC: Adding query filter params (interface=public, service_id=a473a8c5805c4d69b635baea16bac289, region_id=RegionOne) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:22.952166 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656e9cc-11b4-4535-9289-87852733f5bf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:22.953660 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656e9cc-11b4-4535-9289-87852733f5bf None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:22.963313 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 386/773] 10.222.0.24 () {56 vars in 1251 bytes} [Mon May 16 18:55:22 2022] GET /identity/v3/endpoints?service_id=a473a8c5805c4d69b635baea16bac289&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:22.968051 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656e9cc-11b4-4535-9289-87852733f5bf None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:23.027324 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 388/774] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:55:23.049278 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d3cca-2bcf-4dd6-96db-ac81667d04c7 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:23.069088 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656e9cc-11b4-4535-9289-87852733f5bf None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:23.107507 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3950ec3-49cb-47d9-af79-34871970b927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:23.108196 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3950ec3-49cb-47d9-af79-34871970b927 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:23.108466 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3950ec3-49cb-47d9-af79-34871970b927 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:23.108744 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3950ec3-49cb-47d9-af79-34871970b927 None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:23.109424 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3950ec3-49cb-47d9-af79-34871970b927 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:23.110841 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3950ec3-49cb-47d9-af79-34871970b927 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:23.119651 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 387/775] 10.222.0.24 () {56 vars in 1087 bytes} [Mon May 16 18:55:22 2022] GET /identity/v3/services => generated 772 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:23.176690 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d3cca-2bcf-4dd6-96db-ac81667d04c7 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:23.212349 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0acc5d3-36a5-42b0-b691-14c989882f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:23.213203 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0acc5d3-36a5-42b0-b691-14c989882f9d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:23.213484 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0acc5d3-36a5-42b0-b691-14c989882f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:23.213784 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0acc5d3-36a5-42b0-b691-14c989882f9d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:23.214499 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0acc5d3-36a5-42b0-b691-14c989882f9d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:23.215912 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0acc5d3-36a5-42b0-b691-14c989882f9d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:23.229093 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-a0acc5d3-36a5-42b0-b691-14c989882f9d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 18:55:23.229093 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:23.229093 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:55:23.229093 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:55:23.229093 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:55:23.229093 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:55:23.229093 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:55:23.229093 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:23.229093 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 18:55:23.229093 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:23.229093 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:55:23.229093 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:23.229093 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:23.229093 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:23.229093 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:23.229093 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:23.230149 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:23.230149 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:23.230149 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:23.230149 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:23.230149 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:23.230149 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:23.230149 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:23.230149 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:55:23.230149 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:55:23.230149 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:55:23.230149 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:55:23.230149 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:23.230149 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:23.230149 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:23.230149 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:23.230149 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:23.231420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:23.231420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:23.231420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:23.231420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:23.231420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:23.231420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:23.231420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:23.231420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:23.231420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:23.231420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:23.231420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:23.231420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:55:23.231420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:23.231420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 18:55:23.231420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:23.231420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 389/776] 10.222.0.24 () {56 vars in 1129 bytes} [Mon May 16 18:55:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:23.236820 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3950ec3-49cb-47d9-af79-34871970b927 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:23.347285 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3950ec3-49cb-47d9-af79-34871970b927 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:23.382159 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7aaab4-f6d8-49bd-b0be-d9d5b494d832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:23.382864 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7aaab4-f6d8-49bd-b0be-d9d5b494d832 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:23.383208 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7aaab4-f6d8-49bd-b0be-d9d5b494d832 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:23.383485 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7aaab4-f6d8-49bd-b0be-d9d5b494d832 None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:23.384216 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7aaab4-f6d8-49bd-b0be-d9d5b494d832 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:23.384524 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7aaab4-f6d8-49bd-b0be-d9d5b494d832 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:23.385980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7aaab4-f6d8-49bd-b0be-d9d5b494d832 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:23.391573 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 388/777] 10.222.0.24 () {56 vars in 1124 bytes} [Mon May 16 18:55:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:23.397311 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0acc5d3-36a5-42b0-b691-14c989882f9d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:23.499100 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0acc5d3-36a5-42b0-b691-14c989882f9d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:23.532161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33943147-ad64-4b7f-b551-a1e7fc4896bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:23.532833 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33943147-ad64-4b7f-b551-a1e7fc4896bb None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:23.533114 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33943147-ad64-4b7f-b551-a1e7fc4896bb None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:23.533386 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33943147-ad64-4b7f-b551-a1e7fc4896bb None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:23.534130 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33943147-ad64-4b7f-b551-a1e7fc4896bb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:23.534437 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33943147-ad64-4b7f-b551-a1e7fc4896bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:23.535812 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33943147-ad64-4b7f-b551-a1e7fc4896bb None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:23.541414 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 390/778] 10.222.0.24 () {56 vars in 1124 bytes} [Mon May 16 18:55:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:23.547200 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7aaab4-f6d8-49bd-b0be-d9d5b494d832 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:23.646152 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7aaab4-f6d8-49bd-b0be-d9d5b494d832 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:23.678924 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb236d15-43bc-44e5-a27b-a614b626e6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:23.679589 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb236d15-43bc-44e5-a27b-a614b626e6cb None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:23.679877 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb236d15-43bc-44e5-a27b-a614b626e6cb None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:23.680172 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb236d15-43bc-44e5-a27b-a614b626e6cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:23.680969 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb236d15-43bc-44e5-a27b-a614b626e6cb None admin] RBAC: Adding query filter params (interface=public, service_id=0f78ccf99de144609e7668135e721bdc, region_id=RegionOne) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:23.681278 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb236d15-43bc-44e5-a27b-a614b626e6cb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:23.682698 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb236d15-43bc-44e5-a27b-a614b626e6cb None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:23.688143 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 389/779] 10.222.0.24 () {56 vars in 1251 bytes} [Mon May 16 18:55:23 2022] GET /identity/v3/endpoints?service_id=0f78ccf99de144609e7668135e721bdc&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:23.693509 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33943147-ad64-4b7f-b551-a1e7fc4896bb None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:23.791289 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33943147-ad64-4b7f-b551-a1e7fc4896bb None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:23.824282 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7c314-fbfb-4c0c-a43e-58a7d747dfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:23.824961 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7c314-fbfb-4c0c-a43e-58a7d747dfc3 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:23.825232 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7c314-fbfb-4c0c-a43e-58a7d747dfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:23.825504 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7c314-fbfb-4c0c-a43e-58a7d747dfc3 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:23.826213 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e7c314-fbfb-4c0c-a43e-58a7d747dfc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:23.827593 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e7c314-fbfb-4c0c-a43e-58a7d747dfc3 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:23.833069 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 391/780] 10.222.0.24 () {56 vars in 1087 bytes} [Mon May 16 18:55:23 2022] GET /identity/v3/services => generated 772 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:24.139776 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0809e-9618-40ea-8fde-85ccd50da4e3 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:24.140160 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0809e-9618-40ea-8fde-85ccd50da4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:24.140357 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0809e-9618-40ea-8fde-85ccd50da4e3 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:24.142045 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 390/781] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:24.149106 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f015c0-28de-4f6d-a372-ad563ef38c97 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:24.149106 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f015c0-28de-4f6d-a372-ad563ef38c97 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:24.149106 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f015c0-28de-4f6d-a372-ad563ef38c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:24.168036 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-b7f015c0-28de-4f6d-a372-ad563ef38c97 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:24.169244 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b7f015c0-28de-4f6d-a372-ad563ef38c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:24.257050 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 392/782] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:55:24.292172 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0809e-9618-40ea-8fde-85ccd50da4e3 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:24.394449 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c47692-6a85-4e78-90a6-76b2975590ee None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:24.394640 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c47692-6a85-4e78-90a6-76b2975590ee None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:24.394908 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c47692-6a85-4e78-90a6-76b2975590ee None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:24.396537 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 393/783] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:24.412329 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca0a59-011a-4b42-9a04-8c5e718f1e83 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:24.412896 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca0a59-011a-4b42-9a04-8c5e718f1e83 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:24.412896 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca0a59-011a-4b42-9a04-8c5e718f1e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:24.420033 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0809e-9618-40ea-8fde-85ccd50da4e3 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:24.451808 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-feca0a59-011a-4b42-9a04-8c5e718f1e83 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:24.452997 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-feca0a59-011a-4b42-9a04-8c5e718f1e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:24.455709 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6711099-669e-48a9-b063-a465e3bc76e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:24.456526 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6711099-669e-48a9-b063-a465e3bc76e6 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:24.456808 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6711099-669e-48a9-b063-a465e3bc76e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:24.457083 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6711099-669e-48a9-b063-a465e3bc76e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:24.468596 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6711099-669e-48a9-b063-a465e3bc76e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:55:24.478268 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-f6711099-669e-48a9-b063-a465e3bc76e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:55:24.478268 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:24.478268 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:24.478268 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:24.478268 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:24.478268 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:24.478268 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:24.478268 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:24.478268 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:24.478268 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:24.478268 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:24.478268 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:24.478268 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:55:24.478268 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:55:24.478268 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:55:24.478268 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:55:24.480337 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:55:24.480337 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:55:24.480337 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:55:24.480337 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:55:24.480337 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:24.480337 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:24.480337 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:24.480337 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:24.480337 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:24.480337 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:24.480337 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:24.480337 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:24.480337 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:24.480337 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:24.480337 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:24.480337 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:24.481938 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:24.481938 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:24.481938 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:24.481938 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:24.481938 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:55:24.481938 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:55:24.481938 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:55:24.481938 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:55:24.481938 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:55:24.481938 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:55:24.481938 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:55:24.481938 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:24.481938 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 391/784] 10.222.0.24 () {56 vars in 1096 bytes} [Mon May 16 18:55:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:24.485802 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6711099-669e-48a9-b063-a465e3bc76e6 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:24.538495 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 394/785] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:55:24.560318 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca0a59-011a-4b42-9a04-8c5e718f1e83 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:24.686847 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6711099-669e-48a9-b063-a465e3bc76e6 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:24.719775 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca0a59-011a-4b42-9a04-8c5e718f1e83 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:24.743488 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b026c42-4ddb-437d-8476-83086124c579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:24.744173 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b026c42-4ddb-437d-8476-83086124c579 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:24.744455 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b026c42-4ddb-437d-8476-83086124c579 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:24.744729 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b026c42-4ddb-437d-8476-83086124c579 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:24.745492 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b026c42-4ddb-437d-8476-83086124c579 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:24.745820 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b026c42-4ddb-437d-8476-83086124c579 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:24.747225 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b026c42-4ddb-437d-8476-83086124c579 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:24.765115 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 392/786] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:55:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:24.771123 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b026c42-4ddb-437d-8476-83086124c579 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:24.795022 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64baa5d0-ab52-4d06-b0ab-e5cf8a0c5570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:24.796270 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64baa5d0-ab52-4d06-b0ab-e5cf8a0c5570 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:24.796941 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64baa5d0-ab52-4d06-b0ab-e5cf8a0c5570 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:24.797411 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64baa5d0-ab52-4d06-b0ab-e5cf8a0c5570 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:24.817256 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64baa5d0-ab52-4d06-b0ab-e5cf8a0c5570 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:55:24.827102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-64baa5d0-ab52-4d06-b0ab-e5cf8a0c5570 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 18:55:24.827102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:24.827102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:24.827102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:24.827102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:24.827102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:24.827102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:24.827102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:24.827102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:24.827102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:24.827102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:24.827102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:24.827102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:55:24.827102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:55:24.827102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:55:24.827102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:55:24.828041 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:55:24.828041 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:55:24.828041 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:55:24.828041 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:55:24.828041 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:24.828041 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:24.828041 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:24.828041 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:24.828041 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:24.828041 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:24.828041 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:24.828041 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:24.828041 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:24.828041 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:24.828041 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:24.828041 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:24.828882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:24.828882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:24.828882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:24.828882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:24.828882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:55:24.828882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:55:24.828882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:55:24.828882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:55:24.828882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:55:24.828882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:55:24.828882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 18:55:24.828882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:24.839046 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 395/787] 10.222.0.24 () {56 vars in 1102 bytes} [Mon May 16 18:55:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:55:24.850673 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64baa5d0-ab52-4d06-b0ab-e5cf8a0c5570 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:24.907873 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b026c42-4ddb-437d-8476-83086124c579 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:24.951250 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8080f46-4c7f-4201-85dd-93fc1579b265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:24.951990 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8080f46-4c7f-4201-85dd-93fc1579b265 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:24.952264 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8080f46-4c7f-4201-85dd-93fc1579b265 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:24.952536 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8080f46-4c7f-4201-85dd-93fc1579b265 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:24.969761 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8080f46-4c7f-4201-85dd-93fc1579b265 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:24.971254 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8080f46-4c7f-4201-85dd-93fc1579b265 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:24.994158 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64baa5d0-ab52-4d06-b0ab-e5cf8a0c5570 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:25.009696 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-f8080f46-4c7f-4201-85dd-93fc1579b265 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:25.009696 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:25.009696 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:25.009696 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:25.009696 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:25.009696 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:25.009696 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:25.009696 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:25.009696 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:25.009696 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:25.009696 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:25.009696 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:25.009696 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:25.009696 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:25.009696 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:25.010617 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:25.010617 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:25.010617 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:25.010617 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:25.010617 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:25.010617 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:25.010617 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:25.010617 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:25.010617 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:25.010617 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:25.010617 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:25.010617 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:25.010617 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:25.010617 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:25.010617 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:25.010617 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:25.010617 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:25.011499 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:25.011499 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:25.011499 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:25.011499 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:25.011499 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 393/788] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:25.017790 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8080f46-4c7f-4201-85dd-93fc1579b265 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:25.041498 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3a706-063d-4f2f-95b5-b5e4e4fc1be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:25.042252 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3a706-063d-4f2f-95b5-b5e4e4fc1be4 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:25.042538 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3a706-063d-4f2f-95b5-b5e4e4fc1be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:25.042814 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3a706-063d-4f2f-95b5-b5e4e4fc1be4 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:25.043580 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c3a706-063d-4f2f-95b5-b5e4e4fc1be4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:25.043888 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c3a706-063d-4f2f-95b5-b5e4e4fc1be4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:25.045283 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c3a706-063d-4f2f-95b5-b5e4e4fc1be4 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:25.060346 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 396/789] 10.222.0.24 () {56 vars in 1103 bytes} [Mon May 16 18:55:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:25.070611 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3a706-063d-4f2f-95b5-b5e4e4fc1be4 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:25.149743 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8080f46-4c7f-4201-85dd-93fc1579b265 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:25.191737 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d996b-5b8c-4853-b075-096ae92246e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:25.192404 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d996b-5b8c-4853-b075-096ae92246e4 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:25.192682 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d996b-5b8c-4853-b075-096ae92246e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:25.192952 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d996b-5b8c-4853-b075-096ae92246e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:25.193699 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d996b-5b8c-4853-b075-096ae92246e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:25.194005 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d996b-5b8c-4853-b075-096ae92246e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:25.195390 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d996b-5b8c-4853-b075-096ae92246e4 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:25.220222 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 394/790] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:55:25.225730 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d996b-5b8c-4853-b075-096ae92246e4 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:25.269196 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3a706-063d-4f2f-95b5-b5e4e4fc1be4 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:25.332769 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d996b-5b8c-4853-b075-096ae92246e4 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:25.334219 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e8d21-69c2-4e05-8256-d405bf0733a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:25.335042 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e8d21-69c2-4e05-8256-d405bf0733a9 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:25.335335 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e8d21-69c2-4e05-8256-d405bf0733a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:25.335608 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e8d21-69c2-4e05-8256-d405bf0733a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:25.350758 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e8d21-69c2-4e05-8256-d405bf0733a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:25.352309 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e8d21-69c2-4e05-8256-d405bf0733a9 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:25.374271 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33be03-1ebd-4efe-8cdd-783e7d0b4ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:25.375067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33be03-1ebd-4efe-8cdd-783e7d0b4ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:25.375344 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33be03-1ebd-4efe-8cdd-783e7d0b4ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:25.375615 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33be03-1ebd-4efe-8cdd-783e7d0b4ab9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:25.379231 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-ab2e8d21-69c2-4e05-8256-d405bf0733a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:25.379231 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:25.379231 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:25.379231 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:25.379231 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:25.379231 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:25.379231 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:25.379231 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:25.379231 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:25.379231 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:25.379231 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:25.379231 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:25.379231 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:25.379231 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:25.379231 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:25.381171 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:25.381171 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:25.381171 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:25.381171 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:25.381171 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:25.381171 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:25.381171 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:25.381171 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:25.381171 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:25.381171 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:25.381171 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:25.381171 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:25.381171 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:25.381171 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:25.381171 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:25.381171 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:25.381171 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:25.383375 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:25.383375 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:25.383375 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:25.383375 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:25.387775 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc33be03-1ebd-4efe-8cdd-783e7d0b4ab9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:25.389252 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc33be03-1ebd-4efe-8cdd-783e7d0b4ab9 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:25.389925 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 397/791] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:25.390822 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e8d21-69c2-4e05-8256-d405bf0733a9 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:25.418101 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-dc33be03-1ebd-4efe-8cdd-783e7d0b4ab9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 18:55:25.418101 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:25.418101 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:25.418101 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:25.418101 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:25.418101 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:25.418101 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:25.418101 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:25.418101 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:25.418101 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:25.418101 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:25.418101 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:25.418101 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:55:25.418101 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:55:25.418101 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:55:25.418101 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:55:25.420740 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:25.420740 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:25.420740 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:55:25.420740 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:25.420740 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:55:25.420740 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:25.420740 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:25.420740 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:25.420740 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:25.420740 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:25.420740 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:25.420740 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:25.420740 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:25.420740 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:25.420740 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:25.420740 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:25.420740 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:25.420740 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:25.422968 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:25.422968 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:25.422968 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:55:25.422968 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:55:25.422968 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:55:25.422968 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:55:25.422968 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:55:25.422968 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:55:25.422968 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 18:55:25.422968 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:25.422968 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 395/792] 10.222.0.24 () {56 vars in 1093 bytes} [Mon May 16 18:55:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:25.429630 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33be03-1ebd-4efe-8cdd-783e7d0b4ab9 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:25.502955 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e8d21-69c2-4e05-8256-d405bf0733a9 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:25.535490 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33be03-1ebd-4efe-8cdd-783e7d0b4ab9 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:25.536296 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305e2ea-299d-4f26-8775-7bffaef97251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:25.537380 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305e2ea-299d-4f26-8775-7bffaef97251 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:25.537695 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305e2ea-299d-4f26-8775-7bffaef97251 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:25.537970 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305e2ea-299d-4f26-8775-7bffaef97251 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:25.538696 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305e2ea-299d-4f26-8775-7bffaef97251 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:25.539002 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305e2ea-299d-4f26-8775-7bffaef97251 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:25.540420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305e2ea-299d-4f26-8775-7bffaef97251 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:25.552798 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 398/793] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:25.554188 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241aed5-c8a3-4152-a179-c3f6149c8962 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:25.554472 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241aed5-c8a3-4152-a179-c3f6149c8962 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:25.554747 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241aed5-c8a3-4152-a179-c3f6149c8962 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:25.556300 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 399/794] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:25.558095 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241aed5-c8a3-4152-a179-c3f6149c8962 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:25.574224 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1de0e-38a1-4171-8ff5-e3a386576cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:25.575211 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1de0e-38a1-4171-8ff5-e3a386576cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:25.575689 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1de0e-38a1-4171-8ff5-e3a386576cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:25.576157 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1de0e-38a1-4171-8ff5-e3a386576cf6 None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:25.577224 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1de0e-38a1-4171-8ff5-e3a386576cf6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:25.577773 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1de0e-38a1-4171-8ff5-e3a386576cf6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:25.579471 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1de0e-38a1-4171-8ff5-e3a386576cf6 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:25.600340 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 396/795] 10.222.0.24 () {56 vars in 1133 bytes} [Mon May 16 18:55:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:55:25.602132 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8782bc-51a0-417b-9d4c-07b40541ac14 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:25.602619 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8782bc-51a0-417b-9d4c-07b40541ac14 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:25.603157 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8782bc-51a0-417b-9d4c-07b40541ac14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:25.621586 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-8f8782bc-51a0-417b-9d4c-07b40541ac14 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:25.623065 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-8f8782bc-51a0-417b-9d4c-07b40541ac14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:25.666129 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241aed5-c8a3-4152-a179-c3f6149c8962 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:25.701739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 397/796] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:55:25.702630 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8782bc-51a0-417b-9d4c-07b40541ac14 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:25.706161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d55308-64e9-481c-8076-db6fa14c0b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:25.708590 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d55308-64e9-481c-8076-db6fa14c0b31 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:25.708863 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d55308-64e9-481c-8076-db6fa14c0b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:25.709444 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d55308-64e9-481c-8076-db6fa14c0b31 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:25.721271 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d55308-64e9-481c-8076-db6fa14c0b31 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:25.722875 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d55308-64e9-481c-8076-db6fa14c0b31 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:25.738084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-29d55308-64e9-481c-8076-db6fa14c0b31 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 18:55:25.738084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:25.738084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:25.738084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:25.738084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:25.738084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:25.738084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:25.738084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:25.738084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:25.738084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:25.738084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:25.738084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:25.738084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:55:25.738084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:55:25.738084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:55:25.738084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:55:25.739084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:25.739084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:25.739084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:55:25.739084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:25.739084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:55:25.739084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:25.739084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:25.739084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:25.739084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:25.739084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:25.739084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:25.739084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:25.739084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:25.739084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:25.739084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:25.739084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:25.739084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:25.739084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:25.740022 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:25.740022 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:25.740022 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:55:25.740022 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:55:25.740022 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:55:25.740022 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:55:25.740022 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:55:25.740022 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:55:25.740022 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 18:55:25.740022 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:25.740022 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 400/797] 10.222.0.24 () {56 vars in 1117 bytes} [Mon May 16 18:55:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:25.740620 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d55308-64e9-481c-8076-db6fa14c0b31 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:25.812910 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8782bc-51a0-417b-9d4c-07b40541ac14 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:25.838188 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d55308-64e9-481c-8076-db6fa14c0b31 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:25.846900 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca95d1-6f02-4ca5-b230-f8007c668a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:25.847866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca95d1-6f02-4ca5-b230-f8007c668a41 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:25.848344 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca95d1-6f02-4ca5-b230-f8007c668a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:25.848812 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca95d1-6f02-4ca5-b230-f8007c668a41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:25.872669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1243f-d89d-4289-bb6a-8ec1734e3a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:25.873710 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1243f-d89d-4289-bb6a-8ec1734e3a9b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:25.873838 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1243f-d89d-4289-bb6a-8ec1734e3a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:25.874158 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1243f-d89d-4289-bb6a-8ec1734e3a9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:25.884453 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1243f-d89d-4289-bb6a-8ec1734e3a9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:55:25.892351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-f7c1243f-d89d-4289-bb6a-8ec1734e3a9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:55:25.892351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:25.892351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:25.892351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:25.892351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:25.892351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:25.892351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:25.892351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:25.892351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:25.892351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:25.892351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:25.892351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:25.892351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:55:25.892351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:55:25.892351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:55:25.892351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:55:25.893374 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:55:25.893374 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:55:25.893374 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:55:25.893374 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:55:25.893374 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:25.893374 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:25.893374 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:25.893374 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:25.893374 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:25.893374 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:25.893374 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:25.893374 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:25.893374 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:25.893374 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:25.893374 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:25.893374 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:25.894280 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:25.894280 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:25.894280 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:25.894280 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:25.894280 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:55:25.894280 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:55:25.894280 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:55:25.894280 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:55:25.894280 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:55:25.894280 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:55:25.894280 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:55:25.894280 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:25.894280 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 401/798] 10.222.0.24 () {56 vars in 1096 bytes} [Mon May 16 18:55:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:25.894965 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1243f-d89d-4289-bb6a-8ec1734e3a9b None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:25.919864 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca95d1-6f02-4ca5-b230-f8007c668a41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:25.921719 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca95d1-6f02-4ca5-b230-f8007c668a41 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:25.998247 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1243f-d89d-4289-bb6a-8ec1734e3a9b None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:26.026349 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 398/799] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:55:25 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 18:55:26.027588 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca95d1-6f02-4ca5-b230-f8007c668a41 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:26.031411 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81aea9-4d78-4830-a830-620b15c3cba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:26.032108 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81aea9-4d78-4830-a830-620b15c3cba2 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:26.032382 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81aea9-4d78-4830-a830-620b15c3cba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:26.032654 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81aea9-4d78-4830-a830-620b15c3cba2 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:26.033507 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81aea9-4d78-4830-a830-620b15c3cba2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:26.033843 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81aea9-4d78-4830-a830-620b15c3cba2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:26.035364 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81aea9-4d78-4830-a830-620b15c3cba2 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:26.053970 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 402/800] 10.222.0.24 () {56 vars in 1149 bytes} [Mon May 16 18:55:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:26.054930 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81aea9-4d78-4830-a830-620b15c3cba2 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:26.131713 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca95d1-6f02-4ca5-b230-f8007c668a41 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:26.151981 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81aea9-4d78-4830-a830-620b15c3cba2 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:26.167456 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58585656-dc60-450d-8ecf-4421ac134a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:26.168140 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58585656-dc60-450d-8ecf-4421ac134a0f None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:26.168421 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58585656-dc60-450d-8ecf-4421ac134a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:26.168694 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58585656-dc60-450d-8ecf-4421ac134a0f None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:26.169452 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58585656-dc60-450d-8ecf-4421ac134a0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:26.169802 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58585656-dc60-450d-8ecf-4421ac134a0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:26.171187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58585656-dc60-450d-8ecf-4421ac134a0f None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:26.179230 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 399/801] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:55:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:26.180085 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58585656-dc60-450d-8ecf-4421ac134a0f None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:26.189579 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d984e-25e7-4b5a-8751-306f5838cf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:26.189579 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d984e-25e7-4b5a-8751-306f5838cf85 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:26.189579 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d984e-25e7-4b5a-8751-306f5838cf85 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:26.189579 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d984e-25e7-4b5a-8751-306f5838cf85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:26.199669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d984e-25e7-4b5a-8751-306f5838cf85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:26.201141 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d984e-25e7-4b5a-8751-306f5838cf85 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:26.220422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-a07d984e-25e7-4b5a-8751-306f5838cf85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:26.220422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:26.220422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:26.220422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:26.220422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:26.220422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:26.220422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:26.220422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:26.220422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:26.220422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:26.220422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:26.220422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:26.220422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:26.220422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:26.220422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:26.221378 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:26.221378 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:26.221378 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:26.221378 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:26.221378 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:26.221378 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:26.221378 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:26.221378 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:26.221378 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:26.221378 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:26.221378 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:26.221378 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:26.221378 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:26.221378 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:26.221378 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:26.221378 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:26.221378 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:26.222565 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:26.222565 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:26.222565 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:26.222565 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:26.223121 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 403/802] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:26.224444 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e96a7-afb0-46fc-957b-aaa76f1d7881 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:26.224719 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e96a7-afb0-46fc-957b-aaa76f1d7881 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:26.224997 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e96a7-afb0-46fc-957b-aaa76f1d7881 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:26.226500 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 404/803] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:26.227156 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e96a7-afb0-46fc-957b-aaa76f1d7881 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:26.281056 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58585656-dc60-450d-8ecf-4421ac134a0f None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:26.313068 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24b34f-9970-429a-8357-39aa49482858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:26.313890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24b34f-9970-429a-8357-39aa49482858 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:26.314169 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24b34f-9970-429a-8357-39aa49482858 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:26.314440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24b34f-9970-429a-8357-39aa49482858 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:26.324808 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef24b34f-9970-429a-8357-39aa49482858 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:26.326289 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef24b34f-9970-429a-8357-39aa49482858 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:26.328012 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e96a7-afb0-46fc-957b-aaa76f1d7881 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:26.346065 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-ef24b34f-9970-429a-8357-39aa49482858 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:26.346065 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:26.346065 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:26.346065 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:26.346065 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:26.346065 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:26.346065 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:26.346065 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:26.346065 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:26.346065 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:26.346065 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:26.346065 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:26.346065 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:26.346065 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:26.346065 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:26.347052 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:26.347052 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:26.347052 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:26.347052 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:26.347052 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:26.347052 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:26.347052 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:26.347052 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:26.347052 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:26.347052 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:26.347052 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:26.347052 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:26.347052 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:26.347052 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:26.347052 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:26.347052 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:26.347052 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:26.347963 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:26.347963 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:26.347963 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:26.347963 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:26.347963 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 400/804] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:26.348824 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24b34f-9970-429a-8357-39aa49482858 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:26.367966 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e453d-cc73-49fb-841b-dc04bd2c3f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:26.368810 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e453d-cc73-49fb-841b-dc04bd2c3f5f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:26.369085 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e453d-cc73-49fb-841b-dc04bd2c3f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:26.369520 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e453d-cc73-49fb-841b-dc04bd2c3f5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:26.381132 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e453d-cc73-49fb-841b-dc04bd2c3f5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:26.382732 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e453d-cc73-49fb-841b-dc04bd2c3f5f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:26.401272 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-e83e453d-cc73-49fb-841b-dc04bd2c3f5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:26.401272 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:26.401272 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:26.401272 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:26.401272 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:26.401272 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:26.401272 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:26.401272 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:26.401272 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:26.401272 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:26.401272 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:26.401272 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:26.401272 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:26.401272 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:26.401272 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:26.402254 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:26.402254 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:26.402254 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:26.402254 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:26.402254 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:26.402254 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:26.402254 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:26.402254 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:26.402254 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:26.402254 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:26.402254 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:26.402254 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:26.402254 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:26.402254 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:26.402254 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:26.402254 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:26.402254 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:26.403119 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:26.403119 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:26.403119 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:26.403119 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:26.403119 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 405/805] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:26.403936 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5287e1-a732-4bba-b278-fc170b951d2e None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:26.404033 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5287e1-a732-4bba-b278-fc170b951d2e None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:26.404300 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5287e1-a732-4bba-b278-fc170b951d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:26.420728 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-3c5287e1-a732-4bba-b278-fc170b951d2e None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:26.421936 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3c5287e1-a732-4bba-b278-fc170b951d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:26.455980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24b34f-9970-429a-8357-39aa49482858 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:26.489138 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8dfad-05df-4045-b8dc-b391e87380a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:26.489924 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8dfad-05df-4045-b8dc-b391e87380a2 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:26.490206 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8dfad-05df-4045-b8dc-b391e87380a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:26.490480 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8dfad-05df-4045-b8dc-b391e87380a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:26.491198 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b8dfad-05df-4045-b8dc-b391e87380a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:26.501729 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b8dfad-05df-4045-b8dc-b391e87380a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:26.501889 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 406/806] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:55:26.501889 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5287e1-a732-4bba-b278-fc170b951d2e None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:26.502042 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b8dfad-05df-4045-b8dc-b391e87380a2 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:26.504896 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 401/807] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:26.505821 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8dfad-05df-4045-b8dc-b391e87380a2 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:26.596656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5287e1-a732-4bba-b278-fc170b951d2e None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:26.601969 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8dfad-05df-4045-b8dc-b391e87380a2 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:26.627809 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cb0fa-a174-41ce-82ec-983ceea812bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:26.628473 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cb0fa-a174-41ce-82ec-983ceea812bd None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:26.628762 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cb0fa-a174-41ce-82ec-983ceea812bd None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:26.629035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cb0fa-a174-41ce-82ec-983ceea812bd None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:26.629787 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371cb0fa-a174-41ce-82ec-983ceea812bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:26.630096 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371cb0fa-a174-41ce-82ec-983ceea812bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:26.631483 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371cb0fa-a174-41ce-82ec-983ceea812bd None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:26.632460 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716fcb2-19d2-4479-8da4-9be1b23e09dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:26.633253 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716fcb2-19d2-4479-8da4-9be1b23e09dc None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:26.633482 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716fcb2-19d2-4479-8da4-9be1b23e09dc None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:26.633789 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716fcb2-19d2-4479-8da4-9be1b23e09dc None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:26.634497 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f716fcb2-19d2-4479-8da4-9be1b23e09dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:26.634796 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f716fcb2-19d2-4479-8da4-9be1b23e09dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:26.636185 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f716fcb2-19d2-4479-8da4-9be1b23e09dc None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:26.642208 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 407/808] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:26.643029 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cb0fa-a174-41ce-82ec-983ceea812bd None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:26.647652 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 402/809] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:26.648469 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716fcb2-19d2-4479-8da4-9be1b23e09dc None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:26.740554 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cb0fa-a174-41ce-82ec-983ceea812bd None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:26.742666 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716fcb2-19d2-4479-8da4-9be1b23e09dc None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:26.774053 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed41ead-7791-461b-8a47-2da85e859464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:26.774852 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed41ead-7791-461b-8a47-2da85e859464 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:26.775132 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed41ead-7791-461b-8a47-2da85e859464 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:26.775404 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed41ead-7791-461b-8a47-2da85e859464 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:26.776777 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749254b-9aa8-4017-b5ec-dd4a5f65e0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:26.777614 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749254b-9aa8-4017-b5ec-dd4a5f65e0ed None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:26.777916 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749254b-9aa8-4017-b5ec-dd4a5f65e0ed None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:26.778180 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749254b-9aa8-4017-b5ec-dd4a5f65e0ed None admin] PATH_INFO: `/v3/services/network` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:26.778831 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749254b-9aa8-4017-b5ec-dd4a5f65e0ed None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:26.780205 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749254b-9aa8-4017-b5ec-dd4a5f65e0ed None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:26.781944 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed41ead-7791-461b-8a47-2da85e859464 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:26.783367 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed41ead-7791-461b-8a47-2da85e859464 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:26.793931 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-0749254b-9aa8-4017-b5ec-dd4a5f65e0ed None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 16 18:55:26.793931 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:26.793931 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:55:26.793931 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:55:26.793931 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:55:26.793931 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:55:26.793931 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:55:26.793931 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:26.793931 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 18:55:26.793931 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:26.793931 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:55:26.793931 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:26.793931 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:26.793931 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:26.793931 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:26.793931 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:26.793931 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:26.794907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:26.794907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:26.794907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:26.794907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:26.794907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:26.794907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:26.794907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:55:26.794907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:55:26.794907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:55:26.794907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:55:26.794907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:26.794907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:26.794907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:26.794907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:26.794907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:26.794907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:26.795733 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:26.795733 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:26.795733 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:26.795733 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:26.795733 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:26.795733 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:26.795733 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:26.795733 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:26.795733 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:26.795733 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:26.795733 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:55:26.795733 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:26.795733 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 18:55:26.795733 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:26.795733 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 403/810] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:55:26 2022] GET /identity/v3/services/network => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:26.796539 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10c0f4-ba7e-4d9e-91d7-c4dda04deded None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:26.796609 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10c0f4-ba7e-4d9e-91d7-c4dda04deded None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:26.797026 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10c0f4-ba7e-4d9e-91d7-c4dda04deded None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:26.797633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-8ed41ead-7791-461b-8a47-2da85e859464 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:26.797633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:26.797633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:26.797633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:26.797633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:26.797633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:26.797633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:26.797633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:26.797633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:26.797633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:26.797633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:26.797633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:26.797633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:55:26.797633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:55:26.797633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:55:26.798474 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:55:26.798474 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:26.798474 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:26.798474 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:26.798474 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:26.798474 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:26.798474 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:26.798474 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:26.798474 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:26.798474 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:26.798474 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:26.798474 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:26.798474 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:26.798474 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:26.798474 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:26.798474 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:26.798474 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:26.799651 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:55:26.799651 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:55:26.799651 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:55:26.799651 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:55:26.799651 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:55:26.799651 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:55:26.799651 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:26.799651 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:26.800507 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 404/811] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:26.800507 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10c0f4-ba7e-4d9e-91d7-c4dda04deded None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:26.805626 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 408/812] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:55:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:26.805626 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed41ead-7791-461b-8a47-2da85e859464 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:26.893850 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10c0f4-ba7e-4d9e-91d7-c4dda04deded None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:26.898062 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed41ead-7791-461b-8a47-2da85e859464 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:26.927380 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f8cb2-109a-45e0-812c-4c8b5c4ae0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:26.928181 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f8cb2-109a-45e0-812c-4c8b5c4ae0ba None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:26.928469 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f8cb2-109a-45e0-812c-4c8b5c4ae0ba None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:26.928733 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f8cb2-109a-45e0-812c-4c8b5c4ae0ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:26.930698 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87162d47-621b-4429-8e03-cdc4f526e357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:26.931491 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87162d47-621b-4429-8e03-cdc4f526e357 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:26.931770 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87162d47-621b-4429-8e03-cdc4f526e357 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:26.932038 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87162d47-621b-4429-8e03-cdc4f526e357 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:26.935335 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f8cb2-109a-45e0-812c-4c8b5c4ae0ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:26.936795 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f8cb2-109a-45e0-812c-4c8b5c4ae0ba None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:26.938923 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87162d47-621b-4429-8e03-cdc4f526e357 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:26.940353 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87162d47-621b-4429-8e03-cdc4f526e357 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:26.950205 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-2e7f8cb2-109a-45e0-812c-4c8b5c4ae0ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:26.950205 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:26.950205 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:26.950205 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:26.950205 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:26.950205 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:26.950205 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:26.950205 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:26.950205 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:26.950205 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:26.950205 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:26.950205 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:26.950205 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:55:26.950205 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:55:26.950205 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:55:26.951079 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:55:26.951079 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:26.951079 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:26.951079 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:26.951079 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:26.951079 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:26.951079 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:26.951079 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:26.951079 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:26.951079 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:26.951079 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:26.951079 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:26.951079 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:26.951079 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:26.951079 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:26.951079 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:26.951079 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:26.951950 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:55:26.951950 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:55:26.951950 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:55:26.951950 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:55:26.951950 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:55:26.951950 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:55:26.951950 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:26.951950 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:26.951950 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 405/813] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:55:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:26.952427 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f8cb2-109a-45e0-812c-4c8b5c4ae0ba None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:26.954531 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-87162d47-621b-4429-8e03-cdc4f526e357 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 18:55:26.954531 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:26.954531 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:26.954531 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:26.954531 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:26.954531 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:26.954531 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:26.954531 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:26.954531 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:26.954531 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:26.954531 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:26.954531 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:26.954531 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:55:26.954531 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:55:26.954531 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:55:26.954531 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:55:26.955586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:26.955586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:26.955586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:55:26.955586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:26.955586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:55:26.955586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:26.955586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:26.955586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:26.955586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:26.955586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:26.955586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:26.955586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:26.955586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:26.955586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:26.955586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:26.955586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:26.955586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:26.955586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:26.958322 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:26.958322 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:26.958322 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:55:26.958322 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:55:26.958322 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:55:26.958322 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:55:26.958322 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:55:26.958322 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:55:26.958322 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 18:55:26.958322 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:26.958322 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 409/814] 10.222.0.24 () {56 vars in 1096 bytes} [Mon May 16 18:55:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:26.958322 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d2b03-50b1-4feb-bf26-e8f461725cee None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:26.958322 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d2b03-50b1-4feb-bf26-e8f461725cee None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:26.959699 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d2b03-50b1-4feb-bf26-e8f461725cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:26.973478 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-979d2b03-50b1-4feb-bf26-e8f461725cee None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:26.974691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-979d2b03-50b1-4feb-bf26-e8f461725cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:27.034976 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 410/815] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:55:27.035798 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d2b03-50b1-4feb-bf26-e8f461725cee None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:27.056494 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f8cb2-109a-45e0-812c-4c8b5c4ae0ba None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:27.087947 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1f0c5-0375-4681-bed6-394c92de057b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:27.088604 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1f0c5-0375-4681-bed6-394c92de057b None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:27.088880 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1f0c5-0375-4681-bed6-394c92de057b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:27.089147 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1f0c5-0375-4681-bed6-394c92de057b None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:27.089889 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1f0c5-0375-4681-bed6-394c92de057b None admin] RBAC: Adding query filter params (name=network) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:27.090179 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1f0c5-0375-4681-bed6-394c92de057b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:27.091548 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1f0c5-0375-4681-bed6-394c92de057b None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:27.095764 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 406/816] 10.222.0.24 () {56 vars in 1112 bytes} [Mon May 16 18:55:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:27.096523 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1f0c5-0375-4681-bed6-394c92de057b None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:27.132641 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d2b03-50b1-4feb-bf26-e8f461725cee None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:27.164833 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d466936-e100-4dd4-9b87-54277a168af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:27.165501 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d466936-e100-4dd4-9b87-54277a168af3 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:27.165807 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d466936-e100-4dd4-9b87-54277a168af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:27.166080 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d466936-e100-4dd4-9b87-54277a168af3 None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:27.166865 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d466936-e100-4dd4-9b87-54277a168af3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:27.167172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d466936-e100-4dd4-9b87-54277a168af3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:27.168618 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d466936-e100-4dd4-9b87-54277a168af3 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:27.179731 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 411/817] 10.222.0.24 () {56 vars in 1148 bytes} [Mon May 16 18:55:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:27.180532 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d466936-e100-4dd4-9b87-54277a168af3 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:27.192944 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1f0c5-0375-4681-bed6-394c92de057b None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:27.226113 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b1e73-a49b-4342-848f-071cc3bb2f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:27.226772 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b1e73-a49b-4342-848f-071cc3bb2f7c None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:27.227048 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b1e73-a49b-4342-848f-071cc3bb2f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:27.227307 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b1e73-a49b-4342-848f-071cc3bb2f7c None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:27.228095 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b1e73-a49b-4342-848f-071cc3bb2f7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:27.228395 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b1e73-a49b-4342-848f-071cc3bb2f7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:27.229870 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b1e73-a49b-4342-848f-071cc3bb2f7c None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:27.241255 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 407/818] 10.222.0.24 () {56 vars in 1148 bytes} [Mon May 16 18:55:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:27.242037 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b1e73-a49b-4342-848f-071cc3bb2f7c None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:27.276207 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d466936-e100-4dd4-9b87-54277a168af3 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:27.310608 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217136ed-a1af-4ed8-bce7-b2078a5f4222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:27.311276 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217136ed-a1af-4ed8-bce7-b2078a5f4222 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:27.311559 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217136ed-a1af-4ed8-bce7-b2078a5f4222 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:27.311830 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217136ed-a1af-4ed8-bce7-b2078a5f4222 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:27.312657 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217136ed-a1af-4ed8-bce7-b2078a5f4222 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:27.312966 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217136ed-a1af-4ed8-bce7-b2078a5f4222 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:27.314432 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217136ed-a1af-4ed8-bce7-b2078a5f4222 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:27.332121 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 412/819] 10.222.0.24 () {56 vars in 1135 bytes} [Mon May 16 18:55:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:27.332938 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217136ed-a1af-4ed8-bce7-b2078a5f4222 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:27.335929 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b1e73-a49b-4342-848f-071cc3bb2f7c None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:27.368285 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f9fd9-0968-4d39-8af2-23a345ac0b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:27.369092 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f9fd9-0968-4d39-8af2-23a345ac0b78 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:27.369367 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f9fd9-0968-4d39-8af2-23a345ac0b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:27.369661 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f9fd9-0968-4d39-8af2-23a345ac0b78 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:27.370306 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f9fd9-0968-4d39-8af2-23a345ac0b78 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:27.371685 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f9fd9-0968-4d39-8af2-23a345ac0b78 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:27.383481 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-667f9fd9-0968-4d39-8af2-23a345ac0b78 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 18:55:27.383481 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:27.383481 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:55:27.383481 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:55:27.383481 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:55:27.383481 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:55:27.383481 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:55:27.383481 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:27.383481 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 18:55:27.383481 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:27.383481 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:55:27.383481 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:27.383481 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:27.383481 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:27.383481 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:27.383481 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:27.384594 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:27.384594 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:27.384594 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:27.384594 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:27.384594 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:27.384594 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:27.384594 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:27.384594 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:55:27.384594 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:55:27.384594 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:55:27.384594 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:55:27.384594 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:27.384594 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:27.384594 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:27.384594 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:27.384594 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:27.385672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:27.385672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:27.385672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:27.385672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:27.385672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:27.385672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:27.385672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:27.385672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:27.385672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:27.385672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:27.385672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:27.385672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:55:27.385672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:27.385672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 18:55:27.385672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:27.385672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 408/820] 10.222.0.24 () {56 vars in 1129 bytes} [Mon May 16 18:55:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:27.386520 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f9fd9-0968-4d39-8af2-23a345ac0b78 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:27.431549 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217136ed-a1af-4ed8-bce7-b2078a5f4222 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:27.462822 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599135f-6e50-4e6c-8195-56ee5ea8227d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:27.463489 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599135f-6e50-4e6c-8195-56ee5ea8227d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:27.463768 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599135f-6e50-4e6c-8195-56ee5ea8227d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:27.464042 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599135f-6e50-4e6c-8195-56ee5ea8227d None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:27.464758 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599135f-6e50-4e6c-8195-56ee5ea8227d None admin] RBAC: Adding query filter params (type=network) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:27.465055 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599135f-6e50-4e6c-8195-56ee5ea8227d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:27.466453 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599135f-6e50-4e6c-8195-56ee5ea8227d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:27.471279 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 413/821] 10.222.0.24 () {56 vars in 1112 bytes} [Mon May 16 18:55:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:27.472028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599135f-6e50-4e6c-8195-56ee5ea8227d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:27.482342 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f9fd9-0968-4d39-8af2-23a345ac0b78 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:27.515670 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e5c2c2-2419-4682-bd90-d75fa8d1664f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:27.516329 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5c2c2-2419-4682-bd90-d75fa8d1664f None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:27.516609 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5c2c2-2419-4682-bd90-d75fa8d1664f None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:27.516878 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5c2c2-2419-4682-bd90-d75fa8d1664f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:27.517725 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e5c2c2-2419-4682-bd90-d75fa8d1664f None admin] RBAC: Adding query filter params (role.id=5a6e54e81bb24eceb618d9ffa67f488e, scope.project.id=084e70bbad784892b195bb11a68bf857, user.id=1f03aa520ee14615b802cdbc3cd4f87d) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:27.518030 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e5c2c2-2419-4682-bd90-d75fa8d1664f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:27.519511 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e5c2c2-2419-4682-bd90-d75fa8d1664f None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:27.525249 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 409/822] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:55:27 2022] GET /identity/v3/role_assignments?user.id=1f03aa520ee14615b802cdbc3cd4f87d&scope.project.id=084e70bbad784892b195bb11a68bf857&role.id=5a6e54e81bb24eceb618d9ffa67f488e => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:27.525891 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e5c2c2-2419-4682-bd90-d75fa8d1664f None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:27.581154 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599135f-6e50-4e6c-8195-56ee5ea8227d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:27.619767 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5181d8f-327f-4ccc-8111-65c7c2ccefb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:27.620684 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5181d8f-327f-4ccc-8111-65c7c2ccefb9 None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:27.620963 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5181d8f-327f-4ccc-8111-65c7c2ccefb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:27.621238 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5181d8f-327f-4ccc-8111-65c7c2ccefb9 None admin] PATH_INFO: `/v3/projects/084e70bbad784892b195bb11a68bf857/users/4775e9dd7aea448d95ec7378b4ff3124/roles/48c59cffd0c84f83b89761ff42040687` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:27.630491 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e5c2c2-2419-4682-bd90-d75fa8d1664f None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:27.638546 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5181d8f-327f-4ccc-8111-65c7c2ccefb9 None admin] RBAC: Authorizing `identity:create_grant(project_id=084e70bbad784892b195bb11a68bf857, user_id=4775e9dd7aea448d95ec7378b4ff3124, role_id=48c59cffd0c84f83b89761ff42040687)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:27.640054 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5181d8f-327f-4ccc-8111-65c7c2ccefb9 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:27.665570 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 414/823] 10.222.0.24 () {58 vars in 1439 bytes} [Mon May 16 18:55:27 2022] PUT /identity/v3/projects/084e70bbad784892b195bb11a68bf857/users/4775e9dd7aea448d95ec7378b4ff3124/roles/48c59cffd0c84f83b89761ff42040687 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:55:27.665570 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5181d8f-327f-4ccc-8111-65c7c2ccefb9 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:27.680800 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ba06c-f7fd-4208-a255-0c13d456b4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:27.681851 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ba06c-f7fd-4208-a255-0c13d456b4f9 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:27.682139 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ba06c-f7fd-4208-a255-0c13d456b4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:27.682474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ba06c-f7fd-4208-a255-0c13d456b4f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:27.695419 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71ba06c-f7fd-4208-a255-0c13d456b4f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:27.697086 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71ba06c-f7fd-4208-a255-0c13d456b4f9 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:27.715564 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-e71ba06c-f7fd-4208-a255-0c13d456b4f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:27.715564 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:27.715564 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:27.715564 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:27.715564 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:27.715564 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:27.715564 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:27.715564 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:27.715564 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:27.715564 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:27.715564 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:27.715564 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:27.715564 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:27.715564 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:27.715564 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:27.716705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:27.716705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:27.716705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:27.716705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:27.716705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:27.716705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:27.716705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:27.716705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:27.716705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:27.716705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:27.716705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:27.716705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:27.716705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:27.716705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:27.716705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:27.716705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:27.716705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:27.717769 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:27.717769 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:27.717769 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:27.717769 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:27.723355 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 410/824] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:27.724480 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ba06c-f7fd-4208-a255-0c13d456b4f9 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:27.807094 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5181d8f-327f-4ccc-8111-65c7c2ccefb9 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:27.845588 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c3afc-e81e-45f0-b62b-1c333a7a4dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:27.846652 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c3afc-e81e-45f0-b62b-1c333a7a4dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:27.846652 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c3afc-e81e-45f0-b62b-1c333a7a4dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:27.846935 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c3afc-e81e-45f0-b62b-1c333a7a4dc2 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:27.847781 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c3afc-e81e-45f0-b62b-1c333a7a4dc2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:27.848158 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c3afc-e81e-45f0-b62b-1c333a7a4dc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:27.849679 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c3afc-e81e-45f0-b62b-1c333a7a4dc2 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:27.855734 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 415/825] 10.222.0.24 () {56 vars in 1124 bytes} [Mon May 16 18:55:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:27.856719 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c3afc-e81e-45f0-b62b-1c333a7a4dc2 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:27.861692 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ba06c-f7fd-4208-a255-0c13d456b4f9 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:27.906686 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507f1ad-2cb0-4d6f-88e6-6e77e2944e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:27.907357 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507f1ad-2cb0-4d6f-88e6-6e77e2944e78 None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:27.907692 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507f1ad-2cb0-4d6f-88e6-6e77e2944e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:27.907963 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507f1ad-2cb0-4d6f-88e6-6e77e2944e78 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:27.908710 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507f1ad-2cb0-4d6f-88e6-6e77e2944e78 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:27.910315 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507f1ad-2cb0-4d6f-88e6-6e77e2944e78 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:27.934708 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 411/826] 10.222.0.24 () {60 vars in 1144 bytes} [Mon May 16 18:55:27 2022] POST /identity/v3/endpoints => generated 327 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:55:27.936296 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507f1ad-2cb0-4d6f-88e6-6e77e2944e78 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:27.968773 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c3afc-e81e-45f0-b62b-1c333a7a4dc2 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:28.013969 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d86edd-fe06-409c-8999-30cbca9f1e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:28.014658 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d86edd-fe06-409c-8999-30cbca9f1e95 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:28.014941 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d86edd-fe06-409c-8999-30cbca9f1e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:28.015209 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d86edd-fe06-409c-8999-30cbca9f1e95 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:28.015943 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d86edd-fe06-409c-8999-30cbca9f1e95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:28.016247 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d86edd-fe06-409c-8999-30cbca9f1e95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:28.017811 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d86edd-fe06-409c-8999-30cbca9f1e95 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:28.033699 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 416/827] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:28.040531 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d86edd-fe06-409c-8999-30cbca9f1e95 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:28.125572 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507f1ad-2cb0-4d6f-88e6-6e77e2944e78 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:28.169159 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d86edd-fe06-409c-8999-30cbca9f1e95 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:28.194558 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4023411-0a0d-4259-8646-1bcf8aaea81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:28.195775 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4023411-0a0d-4259-8646-1bcf8aaea81e None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:28.196261 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4023411-0a0d-4259-8646-1bcf8aaea81e None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:28.196754 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4023411-0a0d-4259-8646-1bcf8aaea81e None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:28.197853 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4023411-0a0d-4259-8646-1bcf8aaea81e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:28.198498 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4023411-0a0d-4259-8646-1bcf8aaea81e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:28.200702 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4023411-0a0d-4259-8646-1bcf8aaea81e None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:28.207656 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 412/828] 10.222.0.24 () {56 vars in 1124 bytes} [Mon May 16 18:55:27 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:28.209410 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48831ddf-5538-44d5-860d-c2c667db655f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:28.210461 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48831ddf-5538-44d5-860d-c2c667db655f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:28.210901 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48831ddf-5538-44d5-860d-c2c667db655f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:28.211395 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48831ddf-5538-44d5-860d-c2c667db655f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:28.214392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4023411-0a0d-4259-8646-1bcf8aaea81e None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:28.220209 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48831ddf-5538-44d5-860d-c2c667db655f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:28.221712 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48831ddf-5538-44d5-860d-c2c667db655f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:28.240223 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-48831ddf-5538-44d5-860d-c2c667db655f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:28.240223 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:28.240223 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:28.240223 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:28.240223 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:28.240223 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:28.240223 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:28.240223 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:28.240223 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:28.240223 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:28.240223 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:28.240223 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:28.240223 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:55:28.240223 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:55:28.240223 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:55:28.241576 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:55:28.241576 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:28.241576 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:28.241576 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:28.241576 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:28.241576 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:28.241576 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:28.241576 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:28.241576 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:28.241576 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:28.241576 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:28.241576 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:28.241576 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:28.241576 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:28.241576 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:28.241576 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:28.241576 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:28.242731 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:55:28.242731 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:55:28.242731 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:55:28.242731 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:55:28.242731 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:55:28.242731 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:55:28.242731 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:28.242731 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:28.242731 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 417/829] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:55:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:55:28.248264 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48831ddf-5538-44d5-860d-c2c667db655f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:28.324606 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4023411-0a0d-4259-8646-1bcf8aaea81e None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:28.369015 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48831ddf-5538-44d5-860d-c2c667db655f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:28.370116 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228dfb89-1f71-4153-8dd0-3d33525ac599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:28.371996 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228dfb89-1f71-4153-8dd0-3d33525ac599 None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:28.372517 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228dfb89-1f71-4153-8dd0-3d33525ac599 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:28.372989 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228dfb89-1f71-4153-8dd0-3d33525ac599 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:28.374177 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228dfb89-1f71-4153-8dd0-3d33525ac599 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:28.375785 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228dfb89-1f71-4153-8dd0-3d33525ac599 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:28.410014 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 413/830] 10.222.0.24 () {60 vars in 1144 bytes} [Mon May 16 18:55:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:55:28.414972 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f3f29-9466-470e-aa92-12c53f32cd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:28.416037 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f3f29-9466-470e-aa92-12c53f32cd11 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:28.416516 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f3f29-9466-470e-aa92-12c53f32cd11 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:28.416984 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f3f29-9466-470e-aa92-12c53f32cd11 None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:28.418406 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f3f29-9466-470e-aa92-12c53f32cd11 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:28.418972 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f3f29-9466-470e-aa92-12c53f32cd11 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:28.420762 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f3f29-9466-470e-aa92-12c53f32cd11 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:28.435481 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 418/831] 10.222.0.24 () {56 vars in 1148 bytes} [Mon May 16 18:55:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:28.441269 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228dfb89-1f71-4153-8dd0-3d33525ac599 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:28.556955 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228dfb89-1f71-4153-8dd0-3d33525ac599 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:28.593283 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e06441-a5d9-499b-9d47-be591c49dc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:28.594282 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e06441-a5d9-499b-9d47-be591c49dc11 None admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:28.594567 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e06441-a5d9-499b-9d47-be591c49dc11 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:28.594860 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e06441-a5d9-499b-9d47-be591c49dc11 None admin] PATH_INFO: `/v3/projects/084e70bbad784892b195bb11a68bf857/users/654e435a35c4491eb87943734ce280f4/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:28.598324 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e06441-a5d9-499b-9d47-be591c49dc11 None admin] RBAC: Authorizing `identity:create_grant(project_id=084e70bbad784892b195bb11a68bf857, user_id=654e435a35c4491eb87943734ce280f4, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:28.599804 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e06441-a5d9-499b-9d47-be591c49dc11 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:28.616365 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 414/832] 10.222.0.24 () {58 vars in 1439 bytes} [Mon May 16 18:55:28 2022] PUT /identity/v3/projects/084e70bbad784892b195bb11a68bf857/users/654e435a35c4491eb87943734ce280f4/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:55:29.947290 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec2b66-de11-4cfb-8d9d-4ae1939b11af None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:29.947861 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec2b66-de11-4cfb-8d9d-4ae1939b11af None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:29.947861 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec2b66-de11-4cfb-8d9d-4ae1939b11af None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:29.949471 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 419/833] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:29.954893 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee56d25-8284-417f-91b2-8c8f1644045b None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:29.955367 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee56d25-8284-417f-91b2-8c8f1644045b None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:29.955524 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee56d25-8284-417f-91b2-8c8f1644045b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:29.973440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-5ee56d25-8284-417f-91b2-8c8f1644045b None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:29.974666 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-5ee56d25-8284-417f-91b2-8c8f1644045b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:30.040688 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 415/834] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 18:55:30.062564 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec2b66-de11-4cfb-8d9d-4ae1939b11af None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:30.073496 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e97ab-a2cd-42f9-bdfb-62f711aa5a38 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:30.073837 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e97ab-a2cd-42f9-bdfb-62f711aa5a38 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:30.074093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e97ab-a2cd-42f9-bdfb-62f711aa5a38 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:30.075639 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 416/835] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:30.082405 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb747231-b826-423f-a329-6d452810a582 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:30.082680 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb747231-b826-423f-a329-6d452810a582 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:30.082952 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb747231-b826-423f-a329-6d452810a582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:30.104393 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-eb747231-b826-423f-a329-6d452810a582 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:30.106620 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-eb747231-b826-423f-a329-6d452810a582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:30.186863 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec2b66-de11-4cfb-8d9d-4ae1939b11af None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:30.197497 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 417/836] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:55:30.214433 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb747231-b826-423f-a329-6d452810a582 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:30.230534 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94951a5a-a3f7-4589-8b04-fad3588084e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:30.231885 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94951a5a-a3f7-4589-8b04-fad3588084e7 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:30.232590 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94951a5a-a3f7-4589-8b04-fad3588084e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:30.233036 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94951a5a-a3f7-4589-8b04-fad3588084e7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:30.233915 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94951a5a-a3f7-4589-8b04-fad3588084e7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:30.235921 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94951a5a-a3f7-4589-8b04-fad3588084e7 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:30.251960 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-94951a5a-a3f7-4589-8b04-fad3588084e7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 18:55:30.251960 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:30.251960 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:55:30.251960 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:55:30.251960 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:55:30.251960 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:55:30.251960 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:55:30.251960 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:30.251960 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 18:55:30.251960 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:30.251960 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:55:30.251960 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:30.251960 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:30.251960 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:30.251960 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:30.251960 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:30.252919 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:30.252919 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:30.252919 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:30.252919 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:30.252919 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:30.252919 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:30.252919 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:30.252919 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:55:30.252919 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:55:30.252919 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:55:30.252919 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:55:30.252919 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:30.252919 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:30.252919 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:30.252919 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:30.252919 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:30.253765 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:30.253765 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:30.253765 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:30.253765 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:30.253765 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:30.253765 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:30.253765 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:30.253765 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:30.253765 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:30.253765 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:30.253765 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:30.253765 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:55:30.253765 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:30.253765 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 18:55:30.253765 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:30.255529 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 420/837] 10.222.0.24 () {56 vars in 1132 bytes} [Mon May 16 18:55:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:30.261041 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94951a5a-a3f7-4589-8b04-fad3588084e7 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:30.327552 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb747231-b826-423f-a329-6d452810a582 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:30.356975 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94951a5a-a3f7-4589-8b04-fad3588084e7 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:30.370291 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20da10-bba9-44d3-b8b6-e01583415713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:30.372650 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20da10-bba9-44d3-b8b6-e01583415713 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:30.373208 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20da10-bba9-44d3-b8b6-e01583415713 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:30.374069 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20da10-bba9-44d3-b8b6-e01583415713 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:30.389938 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20da10-bba9-44d3-b8b6-e01583415713 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:55:30.396283 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb942c53-5eb4-437c-8f41-92039f1f4d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:30.397125 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb942c53-5eb4-437c-8f41-92039f1f4d64 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:30.397722 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb942c53-5eb4-437c-8f41-92039f1f4d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:30.398136 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb942c53-5eb4-437c-8f41-92039f1f4d64 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:30.398355 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-7b20da10-bba9-44d3-b8b6-e01583415713 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 18:55:30.398355 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:30.398355 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:30.398355 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:30.398355 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:30.398355 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:30.398355 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:30.398355 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:30.398355 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:30.398355 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:30.398355 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:30.398355 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:30.398355 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:55:30.398355 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:55:30.398355 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:55:30.398355 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:55:30.399440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:55:30.399440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:55:30.399440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:55:30.399440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:55:30.399440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:30.399440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:30.399440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:30.399440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:30.399440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:30.399440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:30.399440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:30.399440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:30.399440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:30.399440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:30.399440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:30.399440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:30.400478 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:30.400478 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:30.400478 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:30.400478 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:30.400478 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:55:30.400478 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:55:30.400478 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:55:30.400478 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:55:30.400478 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:55:30.400478 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:55:30.400478 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 18:55:30.400478 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:30.402172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb942c53-5eb4-437c-8f41-92039f1f4d64 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:30.403626 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb942c53-5eb4-437c-8f41-92039f1f4d64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:30.403741 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 418/838] 10.222.0.24 () {56 vars in 1102 bytes} [Mon May 16 18:55:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:55:30.405265 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb942c53-5eb4-437c-8f41-92039f1f4d64 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:30.410563 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 421/839] 10.222.0.24 () {56 vars in 1126 bytes} [Mon May 16 18:55:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:30.411001 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20da10-bba9-44d3-b8b6-e01583415713 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:30.417141 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb942c53-5eb4-437c-8f41-92039f1f4d64 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:30.523370 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20da10-bba9-44d3-b8b6-e01583415713 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:30.549040 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb942c53-5eb4-437c-8f41-92039f1f4d64 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:30.561779 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81408c8a-0924-45be-97ff-25c8956033d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:30.562824 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81408c8a-0924-45be-97ff-25c8956033d8 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:30.563354 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81408c8a-0924-45be-97ff-25c8956033d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:30.563874 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81408c8a-0924-45be-97ff-25c8956033d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:30.564838 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81408c8a-0924-45be-97ff-25c8956033d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:30.565342 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81408c8a-0924-45be-97ff-25c8956033d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:30.566968 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81408c8a-0924-45be-97ff-25c8956033d8 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:30.577313 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 419/840] 10.222.0.24 () {56 vars in 1103 bytes} [Mon May 16 18:55:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:30.583189 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81408c8a-0924-45be-97ff-25c8956033d8 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:30.589656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e5c67-2903-41cf-8c14-91943ca38f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:30.590331 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e5c67-2903-41cf-8c14-91943ca38f4b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:30.590608 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e5c67-2903-41cf-8c14-91943ca38f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:30.590880 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e5c67-2903-41cf-8c14-91943ca38f4b None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:30.591585 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e5c67-2903-41cf-8c14-91943ca38f4b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:30.591885 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e5c67-2903-41cf-8c14-91943ca38f4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:30.593260 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e5c67-2903-41cf-8c14-91943ca38f4b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:30.604881 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 422/841] 10.222.0.24 () {56 vars in 1126 bytes} [Mon May 16 18:55:30 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:30.679753 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8332e1d-2873-43c4-b973-5e6f73f6b9ad None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:30.680198 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8332e1d-2873-43c4-b973-5e6f73f6b9ad None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:30.680604 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8332e1d-2873-43c4-b973-5e6f73f6b9ad None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:30.682598 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 423/842] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:30.688681 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500e8e1-2357-4c01-85bc-6e6d56afd3b6 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:30.688988 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500e8e1-2357-4c01-85bc-6e6d56afd3b6 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:30.689248 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500e8e1-2357-4c01-85bc-6e6d56afd3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:30.708743 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81408c8a-0924-45be-97ff-25c8956033d8 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:30.709312 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-4500e8e1-2357-4c01-85bc-6e6d56afd3b6 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:30.711430 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4500e8e1-2357-4c01-85bc-6e6d56afd3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:30.746226 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f5805-4f0d-4731-975a-cb6019e574d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:30.747459 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f5805-4f0d-4731-975a-cb6019e574d0 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:30.747966 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f5805-4f0d-4731-975a-cb6019e574d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:30.748437 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f5805-4f0d-4731-975a-cb6019e574d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:30.760757 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f5805-4f0d-4731-975a-cb6019e574d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:30.762678 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f5805-4f0d-4731-975a-cb6019e574d0 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:30.782723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-e61f5805-4f0d-4731-975a-cb6019e574d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:30.782723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:30.782723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:30.782723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:30.782723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:30.782723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:30.782723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:30.782723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:30.782723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:30.782723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:30.782723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:30.782723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:30.782723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:30.782723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:30.782723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:30.783673 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:30.783673 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:30.783673 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:30.783673 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:30.783673 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:30.783673 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:30.783673 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:30.783673 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:30.783673 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:30.783673 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:30.783673 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:30.783673 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:30.783673 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:30.783673 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:30.783673 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:30.783673 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:30.783673 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:30.784590 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:30.784590 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:30.784590 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:30.784590 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:30.791749 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 420/843] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:30.793008 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f5805-4f0d-4731-975a-cb6019e574d0 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:30.800006 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 424/844] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:55:30.827595 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4500e8e1-2357-4c01-85bc-6e6d56afd3b6 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:30.904059 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f5805-4f0d-4731-975a-cb6019e574d0 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:30.928866 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4500e8e1-2357-4c01-85bc-6e6d56afd3b6 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:30.935851 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed48991-db5b-4fca-9272-41e897ccc0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:30.936519 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed48991-db5b-4fca-9272-41e897ccc0dd None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:30.936804 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed48991-db5b-4fca-9272-41e897ccc0dd None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:30.937075 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed48991-db5b-4fca-9272-41e897ccc0dd None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:30.937832 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed48991-db5b-4fca-9272-41e897ccc0dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:30.938140 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed48991-db5b-4fca-9272-41e897ccc0dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:30.939523 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed48991-db5b-4fca-9272-41e897ccc0dd None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:30.951506 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 421/845] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:30.957126 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3507b97-6da9-4eb0-a5eb-400784c7ff29 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:30.957708 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3507b97-6da9-4eb0-a5eb-400784c7ff29 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:30.957708 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3507b97-6da9-4eb0-a5eb-400784c7ff29 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:30.959095 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 422/846] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:30.959651 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3507b97-6da9-4eb0-a5eb-400784c7ff29 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:30.966323 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1467ff-d196-4466-9b5b-7b48fd82f045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:30.967140 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1467ff-d196-4466-9b5b-7b48fd82f045 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:30.967420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1467ff-d196-4466-9b5b-7b48fd82f045 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:30.967692 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1467ff-d196-4466-9b5b-7b48fd82f045 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:30.968347 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1467ff-d196-4466-9b5b-7b48fd82f045 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:30.969758 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1467ff-d196-4466-9b5b-7b48fd82f045 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:30.981447 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-2e1467ff-d196-4466-9b5b-7b48fd82f045 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 18:55:30.981447 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:30.981447 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:55:30.981447 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:55:30.981447 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:55:30.981447 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:55:30.981447 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:55:30.981447 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:30.981447 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 18:55:30.981447 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:30.981447 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:55:30.981447 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:30.981447 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:30.981447 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:30.981447 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:30.981447 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:30.981447 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:30.982487 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:30.982487 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:30.982487 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:30.982487 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:30.982487 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:30.982487 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:30.982487 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:55:30.982487 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:55:30.982487 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:55:30.982487 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:55:30.982487 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:30.982487 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:30.982487 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:30.982487 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:30.982487 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:30.982487 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:30.983351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:30.983351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:30.983351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:30.983351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:30.983351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:30.983351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:30.983351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:30.983351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:30.983351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:30.983351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:30.983351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:55:30.983351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:30.983351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 18:55:30.983351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:30.985959 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 425/847] 10.222.0.24 () {56 vars in 1114 bytes} [Mon May 16 18:55:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:30.987765 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb73c4-03c5-4330-be7d-0fdd54dcc1d5 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:30.988065 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb73c4-03c5-4330-be7d-0fdd54dcc1d5 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:30.988656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb73c4-03c5-4330-be7d-0fdd54dcc1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:31.004681 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-a2eb73c4-03c5-4330-be7d-0fdd54dcc1d5 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:31.005887 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a2eb73c4-03c5-4330-be7d-0fdd54dcc1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:31.061762 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3507b97-6da9-4eb0-a5eb-400784c7ff29 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:31.070781 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 426/848] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:55:31.071874 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb73c4-03c5-4330-be7d-0fdd54dcc1d5 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:31.101977 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f2f71-0c73-40d8-909a-053a0db164f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:31.103128 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f2f71-0c73-40d8-909a-053a0db164f8 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:31.103662 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f2f71-0c73-40d8-909a-053a0db164f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:31.103952 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f2f71-0c73-40d8-909a-053a0db164f8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:31.112506 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f2f71-0c73-40d8-909a-053a0db164f8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:31.114672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f2f71-0c73-40d8-909a-053a0db164f8 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:31.132346 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-4f0f2f71-0c73-40d8-909a-053a0db164f8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 18:55:31.132346 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:31.132346 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:31.132346 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:31.132346 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:31.132346 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:31.132346 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:31.132346 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:31.132346 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:31.132346 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:31.132346 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:31.132346 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:31.132346 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:55:31.132346 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:55:31.132346 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:55:31.132346 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:55:31.133672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:31.133672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:31.133672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:55:31.133672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:31.133672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:55:31.133672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:31.133672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:31.133672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:31.133672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:31.133672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:31.133672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:31.133672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:31.133672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:31.133672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:31.133672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:31.133672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:31.133672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:31.133672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:31.134616 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:31.134616 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:31.134616 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:55:31.134616 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:55:31.134616 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:55:31.134616 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:55:31.134616 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:55:31.134616 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:55:31.134616 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 18:55:31.134616 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:31.134616 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 423/849] 10.222.0.24 () {56 vars in 1117 bytes} [Mon May 16 18:55:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:31.135196 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f2f71-0c73-40d8-909a-053a0db164f8 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:31.172549 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb73c4-03c5-4330-be7d-0fdd54dcc1d5 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:31.204267 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a5c8a-11ce-4b42-889c-75116138dc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:31.204938 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a5c8a-11ce-4b42-889c-75116138dc6c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:31.205217 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a5c8a-11ce-4b42-889c-75116138dc6c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:31.205488 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a5c8a-11ce-4b42-889c-75116138dc6c None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:31.206239 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a5c8a-11ce-4b42-889c-75116138dc6c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:31.206544 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a5c8a-11ce-4b42-889c-75116138dc6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:31.207917 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a5c8a-11ce-4b42-889c-75116138dc6c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:31.212219 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 427/850] 10.222.0.24 () {56 vars in 1114 bytes} [Mon May 16 18:55:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:31.213009 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a5c8a-11ce-4b42-889c-75116138dc6c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:31.247152 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f2f71-0c73-40d8-909a-053a0db164f8 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:31.283143 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8502d29-802f-4558-b9e5-7a64f9f393dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:31.284359 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8502d29-802f-4558-b9e5-7a64f9f393dd None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:31.284646 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8502d29-802f-4558-b9e5-7a64f9f393dd None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:31.284928 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8502d29-802f-4558-b9e5-7a64f9f393dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:31.298488 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8502d29-802f-4558-b9e5-7a64f9f393dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:55:31.306847 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a5c8a-11ce-4b42-889c-75116138dc6c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:31.308453 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-a8502d29-802f-4558-b9e5-7a64f9f393dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:55:31.308453 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:31.308453 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:31.308453 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:31.308453 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:31.308453 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:31.308453 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:31.308453 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:31.308453 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:31.308453 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:31.308453 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:31.308453 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:31.308453 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:55:31.308453 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:55:31.308453 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:55:31.308453 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:55:31.309368 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:55:31.309368 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:55:31.309368 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:55:31.309368 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:55:31.309368 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:31.309368 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:31.309368 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:31.309368 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:31.309368 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:31.309368 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:31.309368 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:31.309368 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:31.309368 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:31.309368 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:31.309368 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:31.309368 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:31.310237 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:31.310237 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:31.310237 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:31.310237 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:31.310237 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:55:31.310237 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:55:31.310237 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:55:31.310237 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:55:31.310237 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:55:31.310237 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:55:31.310237 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:55:31.310237 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:31.315966 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 424/851] 10.222.0.24 () {56 vars in 1096 bytes} [Mon May 16 18:55:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:31.315966 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8502d29-802f-4558-b9e5-7a64f9f393dd None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:31.339253 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225780e-7871-45b4-8c89-d32e8cac9ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:31.339943 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225780e-7871-45b4-8c89-d32e8cac9ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:31.340219 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225780e-7871-45b4-8c89-d32e8cac9ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:31.340497 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225780e-7871-45b4-8c89-d32e8cac9ed0 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:31.341337 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225780e-7871-45b4-8c89-d32e8cac9ed0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:31.341688 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225780e-7871-45b4-8c89-d32e8cac9ed0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:31.343125 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225780e-7871-45b4-8c89-d32e8cac9ed0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:31.359709 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 428/852] 10.222.0.24 () {56 vars in 1149 bytes} [Mon May 16 18:55:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:31.360550 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225780e-7871-45b4-8c89-d32e8cac9ed0 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:31.419144 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8502d29-802f-4558-b9e5-7a64f9f393dd None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:31.451371 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01655c8f-7a45-4144-9bdf-3afb24780c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:31.452297 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01655c8f-7a45-4144-9bdf-3afb24780c4c None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:31.452578 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01655c8f-7a45-4144-9bdf-3afb24780c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:31.452856 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01655c8f-7a45-4144-9bdf-3afb24780c4c None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:31.453590 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01655c8f-7a45-4144-9bdf-3afb24780c4c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:31.453911 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01655c8f-7a45-4144-9bdf-3afb24780c4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:31.455300 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01655c8f-7a45-4144-9bdf-3afb24780c4c None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:31.459639 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225780e-7871-45b4-8c89-d32e8cac9ed0 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:31.469626 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 425/853] 10.222.0.24 () {56 vars in 1114 bytes} [Mon May 16 18:55:31 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:31.469626 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01655c8f-7a45-4144-9bdf-3afb24780c4c None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:31.513559 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8996186-f850-4303-83db-8c67013a787b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:31.514365 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8996186-f850-4303-83db-8c67013a787b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:31.514648 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8996186-f850-4303-83db-8c67013a787b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:31.514975 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8996186-f850-4303-83db-8c67013a787b None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:31.515799 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8996186-f850-4303-83db-8c67013a787b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:31.516104 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8996186-f850-4303-83db-8c67013a787b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:31.517612 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8996186-f850-4303-83db-8c67013a787b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:31.527318 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 429/854] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:55:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:31.534298 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8996186-f850-4303-83db-8c67013a787b None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:31.581913 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01655c8f-7a45-4144-9bdf-3afb24780c4c None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:31.620198 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea909f5-049e-46d7-a500-eb3d3fc8a621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:31.620985 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea909f5-049e-46d7-a500-eb3d3fc8a621 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:31.621270 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea909f5-049e-46d7-a500-eb3d3fc8a621 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:31.621560 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea909f5-049e-46d7-a500-eb3d3fc8a621 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:31.657381 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8996186-f850-4303-83db-8c67013a787b None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:31.697130 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365b8cf-3a2f-4549-b169-cee14731fd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:31.697981 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365b8cf-3a2f-4549-b169-cee14731fd07 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:31.698261 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365b8cf-3a2f-4549-b169-cee14731fd07 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:31.698533 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365b8cf-3a2f-4549-b169-cee14731fd07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:31.702639 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea909f5-049e-46d7-a500-eb3d3fc8a621 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:31.704431 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea909f5-049e-46d7-a500-eb3d3fc8a621 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:31.709205 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6365b8cf-3a2f-4549-b169-cee14731fd07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:31.710706 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6365b8cf-3a2f-4549-b169-cee14731fd07 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:31.728187 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-6365b8cf-3a2f-4549-b169-cee14731fd07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:31.728187 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:31.728187 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:31.728187 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:31.728187 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:31.728187 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:31.728187 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:31.728187 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:31.728187 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:31.728187 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:31.728187 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:31.728187 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:31.728187 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:31.728187 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:31.728187 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:31.729172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:31.729172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:31.729172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:31.729172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:31.729172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:31.729172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:31.729172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:31.729172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:31.729172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:31.729172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:31.729172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:31.729172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:31.729172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:31.729172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:31.729172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:31.729172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:31.729172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:31.730114 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:31.730114 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:31.730114 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:31.730114 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:31.734039 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 430/855] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:31.735776 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365b8cf-3a2f-4549-b169-cee14731fd07 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:31.823749 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 426/856] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:55:31 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 18:55:31.825016 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea909f5-049e-46d7-a500-eb3d3fc8a621 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:31.854932 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365b8cf-3a2f-4549-b169-cee14731fd07 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:31.900318 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db32775-42ea-4c9e-a302-63aa3addac01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:31.901729 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db32775-42ea-4c9e-a302-63aa3addac01 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:31.902518 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db32775-42ea-4c9e-a302-63aa3addac01 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:31.903290 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db32775-42ea-4c9e-a302-63aa3addac01 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:31.904219 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db32775-42ea-4c9e-a302-63aa3addac01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:31.904885 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db32775-42ea-4c9e-a302-63aa3addac01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:31.907271 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db32775-42ea-4c9e-a302-63aa3addac01 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:31.923575 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 431/857] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:55:31.928926 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db32775-42ea-4c9e-a302-63aa3addac01 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:31.930426 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea909f5-049e-46d7-a500-eb3d3fc8a621 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:31.968810 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398b9d0-1228-49c9-a68a-2b8dd8d7865d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:31.970825 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398b9d0-1228-49c9-a68a-2b8dd8d7865d None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:31.971312 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398b9d0-1228-49c9-a68a-2b8dd8d7865d None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:31.971799 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398b9d0-1228-49c9-a68a-2b8dd8d7865d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:31.982348 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398b9d0-1228-49c9-a68a-2b8dd8d7865d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:31.984042 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398b9d0-1228-49c9-a68a-2b8dd8d7865d None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:32.001921 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-3398b9d0-1228-49c9-a68a-2b8dd8d7865d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:32.001921 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:32.001921 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:32.001921 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:32.001921 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:32.001921 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:32.001921 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:32.001921 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:32.001921 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:32.001921 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:32.001921 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:32.001921 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:32.001921 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:32.001921 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:32.001921 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:32.002857 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:32.002857 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:32.002857 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:32.002857 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:32.002857 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:32.002857 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:32.002857 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:32.002857 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:32.002857 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:32.002857 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:32.002857 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:32.002857 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:32.002857 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:32.002857 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:32.002857 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:32.002857 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:32.002857 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:32.003724 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:32.003724 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:32.003724 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:32.003724 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:32.006140 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 427/858] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:55:32.012296 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398b9d0-1228-49c9-a68a-2b8dd8d7865d None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:32.027963 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db32775-42ea-4c9e-a302-63aa3addac01 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:32.070054 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c683c19-b1fa-4b8c-aff7-aa9ef4c5ce3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:32.071059 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c683c19-b1fa-4b8c-aff7-aa9ef4c5ce3d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:32.071644 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c683c19-b1fa-4b8c-aff7-aa9ef4c5ce3d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:32.071916 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c683c19-b1fa-4b8c-aff7-aa9ef4c5ce3d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:32.082203 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c683c19-b1fa-4b8c-aff7-aa9ef4c5ce3d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:32.083790 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c683c19-b1fa-4b8c-aff7-aa9ef4c5ce3d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:32.102720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-6c683c19-b1fa-4b8c-aff7-aa9ef4c5ce3d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 18:55:32.102720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:32.102720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:32.102720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:32.102720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:32.102720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:32.102720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:32.102720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:32.102720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:32.102720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:32.102720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:32.102720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:32.102720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:55:32.102720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:55:32.102720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:55:32.102720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:55:32.103884 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:32.103884 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:32.103884 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:55:32.103884 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:32.103884 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:55:32.103884 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:32.103884 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:32.103884 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:32.103884 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:32.103884 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:32.103884 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:32.103884 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:32.103884 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:32.103884 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:32.103884 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:32.103884 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:32.103884 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:32.103884 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:32.105457 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:32.105457 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:32.105457 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:55:32.105457 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:55:32.105457 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:55:32.105457 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:55:32.105457 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:55:32.105457 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:55:32.105457 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 18:55:32.105457 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:32.105457 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 432/859] 10.222.0.24 () {56 vars in 1096 bytes} [Mon May 16 18:55:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:32.111041 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c683c19-b1fa-4b8c-aff7-aa9ef4c5ce3d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:32.115222 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398b9d0-1228-49c9-a68a-2b8dd8d7865d None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:32.154173 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb2ace-1d76-4bd3-a2b7-cbf025418724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:32.154865 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb2ace-1d76-4bd3-a2b7-cbf025418724 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:32.155142 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb2ace-1d76-4bd3-a2b7-cbf025418724 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:32.155409 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb2ace-1d76-4bd3-a2b7-cbf025418724 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:32.156127 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bb2ace-1d76-4bd3-a2b7-cbf025418724 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:32.156438 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bb2ace-1d76-4bd3-a2b7-cbf025418724 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:32.158238 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bb2ace-1d76-4bd3-a2b7-cbf025418724 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:32.177651 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 428/860] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:55:32.179239 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb2ace-1d76-4bd3-a2b7-cbf025418724 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:32.233659 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c683c19-b1fa-4b8c-aff7-aa9ef4c5ce3d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:32.266620 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0222297-4689-40ed-b1f8-0bbf24e0954d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:32.268056 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0222297-4689-40ed-b1f8-0bbf24e0954d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:32.268615 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0222297-4689-40ed-b1f8-0bbf24e0954d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:32.269126 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0222297-4689-40ed-b1f8-0bbf24e0954d None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:32.270339 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0222297-4689-40ed-b1f8-0bbf24e0954d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:32.270789 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0222297-4689-40ed-b1f8-0bbf24e0954d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:32.273212 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0222297-4689-40ed-b1f8-0bbf24e0954d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:32.299142 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 433/861] 10.222.0.24 () {56 vars in 1135 bytes} [Mon May 16 18:55:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:55:32.300784 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0222297-4689-40ed-b1f8-0bbf24e0954d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:32.310397 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb2ace-1d76-4bd3-a2b7-cbf025418724 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:32.344866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e16394-c41d-491e-b766-291065e3abaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:32.346083 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e16394-c41d-491e-b766-291065e3abaa None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:32.346556 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e16394-c41d-491e-b766-291065e3abaa None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:32.347136 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e16394-c41d-491e-b766-291065e3abaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:32.354280 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e16394-c41d-491e-b766-291065e3abaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:32.356071 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e16394-c41d-491e-b766-291065e3abaa None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:32.370832 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-34e16394-c41d-491e-b766-291065e3abaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:32.370832 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:32.370832 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:32.370832 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:32.370832 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:32.370832 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:32.370832 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:32.370832 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:32.370832 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:32.370832 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:32.370832 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:32.370832 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:32.370832 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:55:32.370832 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:55:32.370832 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:55:32.371776 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:55:32.371776 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:32.371776 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:32.371776 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:32.371776 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:32.371776 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:32.371776 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:32.371776 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:32.371776 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:32.371776 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:32.371776 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:32.371776 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:32.371776 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:32.371776 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:32.371776 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:32.371776 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:32.371776 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:32.372656 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:55:32.372656 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:55:32.372656 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:55:32.372656 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:55:32.372656 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:55:32.372656 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:55:32.372656 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:32.372656 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:32.379549 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 429/862] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:55:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:32.381059 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e16394-c41d-491e-b766-291065e3abaa None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:32.407367 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0222297-4689-40ed-b1f8-0bbf24e0954d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:32.443519 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b046b9-9027-405f-92bf-2248c0d194c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:32.444220 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b046b9-9027-405f-92bf-2248c0d194c1 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:32.444504 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b046b9-9027-405f-92bf-2248c0d194c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:32.444776 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b046b9-9027-405f-92bf-2248c0d194c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:32.487286 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e16394-c41d-491e-b766-291065e3abaa None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:32.521205 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfff852-c4b9-4a4a-a3a9-c78226fe0672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:32.522242 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfff852-c4b9-4a4a-a3a9-c78226fe0672 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:32.522717 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfff852-c4b9-4a4a-a3a9-c78226fe0672 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:32.523222 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfff852-c4b9-4a4a-a3a9-c78226fe0672 None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:32.524263 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfff852-c4b9-4a4a-a3a9-c78226fe0672 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:32.524761 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfff852-c4b9-4a4a-a3a9-c78226fe0672 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:32.526806 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfff852-c4b9-4a4a-a3a9-c78226fe0672 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:32.528961 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b046b9-9027-405f-92bf-2248c0d194c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:32.530782 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b046b9-9027-405f-92bf-2248c0d194c1 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:32.547218 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 430/863] 10.222.0.24 () {56 vars in 1148 bytes} [Mon May 16 18:55:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:55:32.548785 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfff852-c4b9-4a4a-a3a9-c78226fe0672 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:32.646406 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 434/864] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:55:32 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 16 18:55:32.648242 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b046b9-9027-405f-92bf-2248c0d194c1 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:32.660118 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfff852-c4b9-4a4a-a3a9-c78226fe0672 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:32.703258 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe7f81-98b8-44f1-b59e-b01bae846778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:32.704318 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe7f81-98b8-44f1-b59e-b01bae846778 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:32.704791 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe7f81-98b8-44f1-b59e-b01bae846778 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:32.705273 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe7f81-98b8-44f1-b59e-b01bae846778 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:32.706353 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe7f81-98b8-44f1-b59e-b01bae846778 None admin] RBAC: Adding query filter params (role.id=48c59cffd0c84f83b89761ff42040687, scope.project.id=084e70bbad784892b195bb11a68bf857, user.id=4775e9dd7aea448d95ec7378b4ff3124) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:32.706885 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe7f81-98b8-44f1-b59e-b01bae846778 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:32.708572 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe7f81-98b8-44f1-b59e-b01bae846778 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:32.721645 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 431/865] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:55:32 2022] GET /identity/v3/role_assignments?user.id=4775e9dd7aea448d95ec7378b4ff3124&scope.project.id=084e70bbad784892b195bb11a68bf857&role.id=48c59cffd0c84f83b89761ff42040687 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:32.766987 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b046b9-9027-405f-92bf-2248c0d194c1 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:32.805052 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9319aad-fa35-48ae-83c1-48cfb2d3c052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:32.806313 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9319aad-fa35-48ae-83c1-48cfb2d3c052 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:32.806807 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9319aad-fa35-48ae-83c1-48cfb2d3c052 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:32.807269 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9319aad-fa35-48ae-83c1-48cfb2d3c052 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:32.818977 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9319aad-fa35-48ae-83c1-48cfb2d3c052 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:32.821022 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9319aad-fa35-48ae-83c1-48cfb2d3c052 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:32.840701 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-a9319aad-fa35-48ae-83c1-48cfb2d3c052 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:32.840701 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:32.840701 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:32.840701 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:32.840701 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:32.840701 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:32.840701 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:32.840701 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:32.840701 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:32.840701 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:32.840701 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:32.840701 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:32.840701 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:32.840701 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:32.840701 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:32.841695 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:32.841695 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:32.841695 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:32.841695 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:32.841695 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:32.841695 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:32.841695 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:32.841695 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:32.841695 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:32.841695 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:32.841695 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:32.841695 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:32.841695 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:32.841695 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:32.841695 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:32.841695 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:32.841695 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:32.842574 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:32.842574 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:32.842574 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:32.842574 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:32.849321 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 435/866] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:55:32.851166 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe7f81-98b8-44f1-b59e-b01bae846778 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:32.871047 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8973fd-de28-460c-a674-7d92fc399279 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:32.871384 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8973fd-de28-460c-a674-7d92fc399279 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:32.871591 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8973fd-de28-460c-a674-7d92fc399279 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:32.873164 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 436/867] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:55:32.879011 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b7807-30f8-4dcb-8c5b-35191e639f8b None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:32.879362 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b7807-30f8-4dcb-8c5b-35191e639f8b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:32.879554 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b7807-30f8-4dcb-8c5b-35191e639f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:32.899229 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-370b7807-30f8-4dcb-8c5b-35191e639f8b None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:32.900199 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-370b7807-30f8-4dcb-8c5b-35191e639f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:32.973945 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe7f81-98b8-44f1-b59e-b01bae846778 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:32.975639 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 437/868] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 18:55:32.998263 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b7807-30f8-4dcb-8c5b-35191e639f8b None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:33.012540 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74e6bd-706b-4edd-9de0-9b05d6b41599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:33.013227 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74e6bd-706b-4edd-9de0-9b05d6b41599 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:33.013509 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74e6bd-706b-4edd-9de0-9b05d6b41599 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:33.013811 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74e6bd-706b-4edd-9de0-9b05d6b41599 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:33.014542 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74e6bd-706b-4edd-9de0-9b05d6b41599 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:33.014847 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74e6bd-706b-4edd-9de0-9b05d6b41599 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:33.016237 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74e6bd-706b-4edd-9de0-9b05d6b41599 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:33.030008 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 432/869] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:33.035452 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74e6bd-706b-4edd-9de0-9b05d6b41599 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:33.124411 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b7807-30f8-4dcb-8c5b-35191e639f8b None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:33.146662 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74e6bd-706b-4edd-9de0-9b05d6b41599 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:33.163917 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43be1aa-25cf-4499-bba5-8ff2d9502a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:33.164801 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43be1aa-25cf-4499-bba5-8ff2d9502a38 None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:33.165234 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43be1aa-25cf-4499-bba5-8ff2d9502a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:33.165709 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43be1aa-25cf-4499-bba5-8ff2d9502a38 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:33.166577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43be1aa-25cf-4499-bba5-8ff2d9502a38 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:33.168125 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43be1aa-25cf-4499-bba5-8ff2d9502a38 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:33.185692 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09bf66-564d-4bb0-858b-c40cf6ce94b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:33.186511 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09bf66-564d-4bb0-858b-c40cf6ce94b3 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:33.186794 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09bf66-564d-4bb0-858b-c40cf6ce94b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:33.187066 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09bf66-564d-4bb0-858b-c40cf6ce94b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:33.188209 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 438/870] 10.222.0.24 () {60 vars in 1141 bytes} [Mon May 16 18:55:32 2022] POST /identity/v3/services => generated 269 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:55:33.203986 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09bf66-564d-4bb0-858b-c40cf6ce94b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:33.205916 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09bf66-564d-4bb0-858b-c40cf6ce94b3 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:33.221989 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-7b09bf66-564d-4bb0-858b-c40cf6ce94b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:33.221989 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:33.221989 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:33.221989 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:33.221989 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:33.221989 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:33.221989 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:33.221989 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:33.221989 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:33.221989 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:33.221989 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:33.221989 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:33.221989 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:55:33.221989 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:55:33.221989 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:55:33.223145 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:55:33.223145 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:33.223145 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:33.223145 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:33.223145 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:33.223145 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:33.223145 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:33.223145 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:33.223145 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:33.223145 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:33.223145 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:33.223145 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:33.223145 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:33.223145 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:33.223145 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:33.223145 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:33.223145 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:33.224146 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:55:33.224146 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:55:33.224146 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:55:33.224146 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:55:33.224146 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:55:33.224146 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:55:33.224146 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:33.224146 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:33.226781 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 433/871] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:55:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:55:33.232948 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43be1aa-25cf-4499-bba5-8ff2d9502a38 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:33.349900 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43be1aa-25cf-4499-bba5-8ff2d9502a38 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:33.386222 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f2a00-5d89-48e7-a76a-b1d9d7bc24b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:33.387139 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f2a00-5d89-48e7-a76a-b1d9d7bc24b4 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:33.387556 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f2a00-5d89-48e7-a76a-b1d9d7bc24b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:33.387965 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f2a00-5d89-48e7-a76a-b1d9d7bc24b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:33.388919 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f2a00-5d89-48e7-a76a-b1d9d7bc24b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:33.389379 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f2a00-5d89-48e7-a76a-b1d9d7bc24b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:33.390970 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f2a00-5d89-48e7-a76a-b1d9d7bc24b4 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:33.404330 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 439/872] 10.222.0.24 () {56 vars in 1148 bytes} [Mon May 16 18:55:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:33.410987 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09bf66-564d-4bb0-858b-c40cf6ce94b3 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:33.514501 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09bf66-564d-4bb0-858b-c40cf6ce94b3 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:33.549244 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfd3fe-4be6-4e5b-a453-5fc3bd367872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:33.550624 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfd3fe-4be6-4e5b-a453-5fc3bd367872 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:33.551114 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfd3fe-4be6-4e5b-a453-5fc3bd367872 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:33.551610 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfd3fe-4be6-4e5b-a453-5fc3bd367872 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:33.552707 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dfd3fe-4be6-4e5b-a453-5fc3bd367872 None admin] RBAC: Adding query filter params (role.id=5a6e54e81bb24eceb618d9ffa67f488e, scope.project.id=084e70bbad784892b195bb11a68bf857, user.id=654e435a35c4491eb87943734ce280f4) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:33.553246 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dfd3fe-4be6-4e5b-a453-5fc3bd367872 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:33.555120 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dfd3fe-4be6-4e5b-a453-5fc3bd367872 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:33.562353 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 434/873] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:55:33 2022] GET /identity/v3/role_assignments?user.id=654e435a35c4491eb87943734ce280f4&scope.project.id=084e70bbad784892b195bb11a68bf857&role.id=5a6e54e81bb24eceb618d9ffa67f488e => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:55:33.780680 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cc86b-af22-4d6f-a5e3-d0027a9671e6 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:33.780897 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cc86b-af22-4d6f-a5e3-d0027a9671e6 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:33.781168 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cc86b-af22-4d6f-a5e3-d0027a9671e6 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:33.782584 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 440/874] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:33.788505 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbbb9a-266f-4176-aff4-51aaca1b1f10 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:33.788823 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbbb9a-266f-4176-aff4-51aaca1b1f10 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:33.789104 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbbb9a-266f-4176-aff4-51aaca1b1f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:33.806486 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-70bbbb9a-266f-4176-aff4-51aaca1b1f10 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:33.807988 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-70bbbb9a-266f-4176-aff4-51aaca1b1f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:33.872885 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 435/875] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:33 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:55:33.894929 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1cc86b-af22-4d6f-a5e3-d0027a9671e6 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:34.004592 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1cc86b-af22-4d6f-a5e3-d0027a9671e6 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:34.040536 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed19aa-337a-44df-820a-96ca1a1ae1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:34.041597 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed19aa-337a-44df-820a-96ca1a1ae1a7 None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:34.042078 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed19aa-337a-44df-820a-96ca1a1ae1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:34.042545 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed19aa-337a-44df-820a-96ca1a1ae1a7 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:34.043545 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ed19aa-337a-44df-820a-96ca1a1ae1a7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:34.045149 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ed19aa-337a-44df-820a-96ca1a1ae1a7 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:34.062752 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 441/876] 10.222.0.24 () {60 vars in 1141 bytes} [Mon May 16 18:55:33 2022] POST /identity/v3/services => generated 251 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:55:35.125859 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fba2d3-1c6e-4359-92a3-56ed79f0dd39 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:35.126394 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fba2d3-1c6e-4359-92a3-56ed79f0dd39 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:35.126745 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fba2d3-1c6e-4359-92a3-56ed79f0dd39 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:35.128494 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 436/877] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:35.134308 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b75e9b-a521-4f50-b643-757c01458e2a None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:35.134723 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b75e9b-a521-4f50-b643-757c01458e2a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:35.135048 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b75e9b-a521-4f50-b643-757c01458e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:35.151794 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-c6b75e9b-a521-4f50-b643-757c01458e2a None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:35.152969 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c6b75e9b-a521-4f50-b643-757c01458e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:35.241653 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 442/878] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:55:35.257618 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fba2d3-1c6e-4359-92a3-56ed79f0dd39 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:35.364257 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fba2d3-1c6e-4359-92a3-56ed79f0dd39 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:35.398754 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc7ae5-0d3a-47a9-960b-d7fb6215c67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:35.399493 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc7ae5-0d3a-47a9-960b-d7fb6215c67f None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:35.399772 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc7ae5-0d3a-47a9-960b-d7fb6215c67f None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:35.400035 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc7ae5-0d3a-47a9-960b-d7fb6215c67f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:35.409929 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc7ae5-0d3a-47a9-960b-d7fb6215c67f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:55:35.418352 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-a7cc7ae5-0d3a-47a9-960b-d7fb6215c67f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 18:55:35.418352 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:35.418352 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:35.418352 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:35.418352 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:35.418352 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:35.418352 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:35.418352 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:35.418352 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:35.418352 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:35.418352 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:35.418352 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:35.418352 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:55:35.418352 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:55:35.418352 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:55:35.418352 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:55:35.419362 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:55:35.419362 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:55:35.419362 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:55:35.419362 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:55:35.419362 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:35.419362 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:35.419362 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:35.419362 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:35.419362 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:35.419362 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:35.419362 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:35.419362 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:35.419362 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:35.419362 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:35.419362 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:35.419362 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:35.420250 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:35.420250 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:35.420250 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:35.420250 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:35.420250 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:55:35.420250 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:55:35.420250 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:55:35.420250 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:55:35.420250 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:55:35.420250 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:55:35.420250 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 18:55:35.420250 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:35.420250 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 437/879] 10.222.0.24 () {56 vars in 1120 bytes} [Mon May 16 18:55:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:35.427015 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b75e9b-a521-4f50-b643-757c01458e2a None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:35.522852 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9cb61-5adf-4bab-8cc6-2ad0efe9eaee None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:35.523560 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9cb61-5adf-4bab-8cc6-2ad0efe9eaee None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:35.523743 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b75e9b-a521-4f50-b643-757c01458e2a None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:35.524236 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9cb61-5adf-4bab-8cc6-2ad0efe9eaee None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:35.526122 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 438/880] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:35.531512 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34a720-de52-4d7c-9572-884772d73d9c None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:35.532083 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34a720-de52-4d7c-9572-884772d73d9c None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:35.532563 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34a720-de52-4d7c-9572-884772d73d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:35.549978 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-eb34a720-de52-4d7c-9572-884772d73d9c None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:35.551006 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-eb34a720-de52-4d7c-9572-884772d73d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:35.564927 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952f4ae-241b-43d0-90e8-823e8075f9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:35.565994 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952f4ae-241b-43d0-90e8-823e8075f9e8 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:35.566280 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952f4ae-241b-43d0-90e8-823e8075f9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:35.566555 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952f4ae-241b-43d0-90e8-823e8075f9e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:35.567576 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952f4ae-241b-43d0-90e8-823e8075f9e8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:35.567889 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952f4ae-241b-43d0-90e8-823e8075f9e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:35.569440 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952f4ae-241b-43d0-90e8-823e8075f9e8 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:35.581619 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 443/881] 10.222.0.24 () {56 vars in 1115 bytes} [Mon May 16 18:55:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:35.585782 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952f4ae-241b-43d0-90e8-823e8075f9e8 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:35.630266 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 439/882] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 18:55:35.647981 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34a720-de52-4d7c-9572-884772d73d9c None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:35.692209 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952f4ae-241b-43d0-90e8-823e8075f9e8 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:35.737609 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197fdb2-8e94-42c8-b257-eda1cecf6332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:35.738436 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197fdb2-8e94-42c8-b257-eda1cecf6332 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:35.738718 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197fdb2-8e94-42c8-b257-eda1cecf6332 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:35.738999 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197fdb2-8e94-42c8-b257-eda1cecf6332 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:35.752724 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0197fdb2-8e94-42c8-b257-eda1cecf6332 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:35.754692 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0197fdb2-8e94-42c8-b257-eda1cecf6332 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:35.762724 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34a720-de52-4d7c-9572-884772d73d9c None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:35.780164 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-0197fdb2-8e94-42c8-b257-eda1cecf6332 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:35.780164 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:35.780164 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:35.780164 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:35.780164 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:35.780164 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:35.780164 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:35.780164 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:35.780164 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:35.780164 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:35.780164 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:35.780164 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:35.780164 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:35.780164 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:35.780164 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:35.781122 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:35.781122 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:35.781122 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:35.781122 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:35.781122 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:35.781122 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:35.781122 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:35.781122 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:35.781122 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:35.781122 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:35.781122 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:35.781122 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:35.781122 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:35.781122 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:35.781122 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:35.781122 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:35.781122 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:35.782041 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:35.782041 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:35.782041 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:35.782041 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:35.785619 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 444/883] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:35.788612 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197fdb2-8e94-42c8-b257-eda1cecf6332 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:35.800733 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431cdb6-2b90-4702-b1dc-9f623a6668a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:35.802035 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431cdb6-2b90-4702-b1dc-9f623a6668a0 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:35.802730 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431cdb6-2b90-4702-b1dc-9f623a6668a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:35.803393 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431cdb6-2b90-4702-b1dc-9f623a6668a0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:35.804278 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431cdb6-2b90-4702-b1dc-9f623a6668a0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:35.805910 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431cdb6-2b90-4702-b1dc-9f623a6668a0 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:35.820964 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-f431cdb6-2b90-4702-b1dc-9f623a6668a0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 18:55:35.820964 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:35.820964 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:55:35.820964 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:55:35.820964 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:55:35.820964 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:55:35.820964 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:55:35.820964 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:35.820964 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 18:55:35.820964 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:35.820964 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:55:35.820964 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:35.820964 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:35.820964 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:35.820964 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:35.820964 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:35.821983 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:35.821983 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:35.821983 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:35.821983 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:35.821983 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:35.821983 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:35.821983 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:35.821983 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:55:35.821983 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:55:35.821983 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:55:35.821983 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:55:35.821983 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:35.821983 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:35.821983 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:35.821983 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:35.821983 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:35.822849 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:35.822849 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:35.822849 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:35.822849 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:35.822849 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:35.822849 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:35.822849 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:35.822849 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:35.822849 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:35.822849 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:35.822849 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:35.822849 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:55:35.822849 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:35.822849 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 18:55:35.822849 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:35.830584 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 440/884] 10.222.0.24 () {56 vars in 1132 bytes} [Mon May 16 18:55:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:35.831877 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431cdb6-2b90-4702-b1dc-9f623a6668a0 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:35.897949 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197fdb2-8e94-42c8-b257-eda1cecf6332 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:35.930609 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4b448-28c8-4733-9d9a-2817bd33de08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:35.931580 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4b448-28c8-4733-9d9a-2817bd33de08 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:35.932023 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4b448-28c8-4733-9d9a-2817bd33de08 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:35.932303 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4b448-28c8-4733-9d9a-2817bd33de08 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:35.933059 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d4b448-28c8-4733-9d9a-2817bd33de08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:35.933362 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d4b448-28c8-4733-9d9a-2817bd33de08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:35.934779 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d4b448-28c8-4733-9d9a-2817bd33de08 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:35.938605 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431cdb6-2b90-4702-b1dc-9f623a6668a0 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:35.946406 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 445/885] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:35.947629 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723ff1c-9671-49aa-bf4d-506939aa21df None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:35.947923 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723ff1c-9671-49aa-bf4d-506939aa21df None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:35.948188 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723ff1c-9671-49aa-bf4d-506939aa21df None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:35.951459 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 446/886] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:35.951666 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723ff1c-9671-49aa-bf4d-506939aa21df None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:35.978382 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78827798-6099-44f7-a287-d105518b6646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:35.979203 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78827798-6099-44f7-a287-d105518b6646 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:35.979804 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78827798-6099-44f7-a287-d105518b6646 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:35.980085 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78827798-6099-44f7-a287-d105518b6646 None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:35.980949 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78827798-6099-44f7-a287-d105518b6646 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:35.981259 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78827798-6099-44f7-a287-d105518b6646 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:35.982682 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78827798-6099-44f7-a287-d105518b6646 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:35.987228 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 441/887] 10.222.0.24 () {56 vars in 1126 bytes} [Mon May 16 18:55:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:35.988475 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19de916-06d2-427e-babe-38d3dcfe54d0 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:35.988763 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19de916-06d2-427e-babe-38d3dcfe54d0 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:35.989035 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19de916-06d2-427e-babe-38d3dcfe54d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:36.004899 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-c19de916-06d2-427e-babe-38d3dcfe54d0 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:36.006136 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-c19de916-06d2-427e-babe-38d3dcfe54d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:36.053946 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723ff1c-9671-49aa-bf4d-506939aa21df None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:36.074824 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 442/888] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:55:36.075675 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19de916-06d2-427e-babe-38d3dcfe54d0 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:36.098231 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bf552-a60f-4f4f-877b-9d4ec9c3bb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:36.099819 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bf552-a60f-4f4f-877b-9d4ec9c3bb4a None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:36.100520 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bf552-a60f-4f4f-877b-9d4ec9c3bb4a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:36.100939 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bf552-a60f-4f4f-877b-9d4ec9c3bb4a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:36.109795 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1bf552-a60f-4f4f-877b-9d4ec9c3bb4a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:36.111442 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1bf552-a60f-4f4f-877b-9d4ec9c3bb4a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:36.126860 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-1b1bf552-a60f-4f4f-877b-9d4ec9c3bb4a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 18:55:36.126860 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:36.126860 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:36.126860 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:36.126860 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:36.126860 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:36.126860 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:36.126860 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:36.126860 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:36.126860 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:36.126860 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:36.126860 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:36.126860 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:55:36.126860 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:55:36.126860 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:55:36.126860 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:55:36.128139 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:36.128139 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:36.128139 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:55:36.128139 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:36.128139 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:55:36.128139 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:36.128139 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:36.128139 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:36.128139 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:36.128139 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:36.128139 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:36.128139 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:36.128139 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:36.128139 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:36.128139 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:36.128139 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:36.128139 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:36.128139 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:36.129314 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:36.129314 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:36.129314 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:55:36.129314 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:55:36.129314 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:55:36.129314 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:55:36.129314 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:55:36.129314 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:55:36.129314 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 18:55:36.129314 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:36.135582 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 447/889] 10.222.0.24 () {56 vars in 1117 bytes} [Mon May 16 18:55:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:36.135582 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bf552-a60f-4f4f-877b-9d4ec9c3bb4a None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:36.179228 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19de916-06d2-427e-babe-38d3dcfe54d0 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:36.211623 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01c68e-2ce6-43de-9544-986237f08da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:36.212224 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01c68e-2ce6-43de-9544-986237f08da0 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:36.212498 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01c68e-2ce6-43de-9544-986237f08da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:36.212767 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01c68e-2ce6-43de-9544-986237f08da0 None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:36.213473 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e01c68e-2ce6-43de-9544-986237f08da0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:36.213813 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e01c68e-2ce6-43de-9544-986237f08da0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:36.215193 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e01c68e-2ce6-43de-9544-986237f08da0 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:36.224719 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 443/890] 10.222.0.24 () {56 vars in 1126 bytes} [Mon May 16 18:55:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:36.224719 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01c68e-2ce6-43de-9544-986237f08da0 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:36.232007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bf552-a60f-4f4f-877b-9d4ec9c3bb4a None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:36.264701 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f505ef-e3af-45b0-8f24-789976280c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:36.265514 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f505ef-e3af-45b0-8f24-789976280c78 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:36.265852 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f505ef-e3af-45b0-8f24-789976280c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:36.266108 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f505ef-e3af-45b0-8f24-789976280c78 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:36.266757 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f505ef-e3af-45b0-8f24-789976280c78 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:36.268112 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f505ef-e3af-45b0-8f24-789976280c78 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:36.279902 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-a0f505ef-e3af-45b0-8f24-789976280c78 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 18:55:36.279902 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:36.279902 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:55:36.279902 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:55:36.279902 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:55:36.279902 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:55:36.279902 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:55:36.279902 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:36.279902 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 18:55:36.279902 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:36.279902 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:55:36.279902 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:36.279902 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:36.279902 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:36.279902 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:36.279902 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:36.279902 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:36.281119 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:36.281119 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:36.281119 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:36.281119 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:36.281119 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:36.281119 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:36.281119 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:55:36.281119 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:55:36.281119 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:55:36.281119 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:55:36.281119 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:36.281119 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:36.281119 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:36.281119 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:36.281119 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:36.281119 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:36.282482 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:36.282482 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:36.282482 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:36.282482 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:36.282482 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:36.282482 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:36.282482 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:36.282482 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:36.282482 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:36.282482 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:36.282482 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:55:36.282482 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:36.282482 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 18:55:36.282482 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:36.282482 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 448/891] 10.222.0.24 () {56 vars in 1126 bytes} [Mon May 16 18:55:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:36.283267 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f505ef-e3af-45b0-8f24-789976280c78 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:36.325226 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01c68e-2ce6-43de-9544-986237f08da0 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:36.357428 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62940d-4af0-4b5e-b961-848c39367996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:36.358135 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62940d-4af0-4b5e-b961-848c39367996 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:36.358415 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62940d-4af0-4b5e-b961-848c39367996 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:36.358686 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62940d-4af0-4b5e-b961-848c39367996 None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:36.359528 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d62940d-4af0-4b5e-b961-848c39367996 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:36.359828 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d62940d-4af0-4b5e-b961-848c39367996 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:36.361265 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d62940d-4af0-4b5e-b961-848c39367996 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:36.375625 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f505ef-e3af-45b0-8f24-789976280c78 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:36.378002 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 444/892] 10.222.0.24 () {56 vars in 1149 bytes} [Mon May 16 18:55:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:36.378861 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62940d-4af0-4b5e-b961-848c39367996 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:36.408689 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7b07f-92f9-4271-ba70-6a8d61c57855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:36.409419 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7b07f-92f9-4271-ba70-6a8d61c57855 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:36.409809 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7b07f-92f9-4271-ba70-6a8d61c57855 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:36.410089 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7b07f-92f9-4271-ba70-6a8d61c57855 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:36.410872 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7b07f-92f9-4271-ba70-6a8d61c57855 None admin] RBAC: Adding query filter params (interface=public, service_id=de689fc5681b464a8fab6f4dad697162, region_id=RegionOne) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:36.411182 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7b07f-92f9-4271-ba70-6a8d61c57855 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:36.412911 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7b07f-92f9-4271-ba70-6a8d61c57855 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:36.420506 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 449/893] 10.222.0.24 () {56 vars in 1251 bytes} [Mon May 16 18:55:36 2022] GET /identity/v3/endpoints?service_id=de689fc5681b464a8fab6f4dad697162&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:36.421721 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24610ada-5ed5-4e10-810f-dfa002e9138a None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:36.421973 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24610ada-5ed5-4e10-810f-dfa002e9138a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:36.422273 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24610ada-5ed5-4e10-810f-dfa002e9138a None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:36.425581 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 450/894] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:36.425581 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24610ada-5ed5-4e10-810f-dfa002e9138a None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:36.478868 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62940d-4af0-4b5e-b961-848c39367996 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:36.512315 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf986d-2a58-4d93-81a4-8ae1297e2e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:36.512987 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf986d-2a58-4d93-81a4-8ae1297e2e7d None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:36.513264 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf986d-2a58-4d93-81a4-8ae1297e2e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:36.513572 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf986d-2a58-4d93-81a4-8ae1297e2e7d None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:36.514269 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf986d-2a58-4d93-81a4-8ae1297e2e7d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:36.514574 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf986d-2a58-4d93-81a4-8ae1297e2e7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:36.515961 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf986d-2a58-4d93-81a4-8ae1297e2e7d None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:36.520681 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 445/895] 10.222.0.24 () {56 vars in 1122 bytes} [Mon May 16 18:55:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:36.521453 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf986d-2a58-4d93-81a4-8ae1297e2e7d None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:36.524435 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24610ada-5ed5-4e10-810f-dfa002e9138a None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:36.557513 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1f9b7-d70f-4f08-927a-2e24791d6ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:36.558154 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1f9b7-d70f-4f08-927a-2e24791d6ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:36.558433 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1f9b7-d70f-4f08-927a-2e24791d6ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:36.558704 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1f9b7-d70f-4f08-927a-2e24791d6ba6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:36.619378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf986d-2a58-4d93-81a4-8ae1297e2e7d None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:36.626379 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd1f9b7-d70f-4f08-927a-2e24791d6ba6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:36.627850 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd1f9b7-d70f-4f08-927a-2e24791d6ba6 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:36.654719 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063f198-a1f0-4de8-975a-994683afcc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:36.655694 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063f198-a1f0-4de8-975a-994683afcc59 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:36.655987 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063f198-a1f0-4de8-975a-994683afcc59 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:36.656260 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063f198-a1f0-4de8-975a-994683afcc59 None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:36.656944 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9063f198-a1f0-4de8-975a-994683afcc59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:36.658342 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9063f198-a1f0-4de8-975a-994683afcc59 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:36.664425 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 446/896] 10.222.0.24 () {56 vars in 1087 bytes} [Mon May 16 18:55:36 2022] GET /identity/v3/services => generated 1268 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:55:36.665631 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedffb91-6baa-4de3-bb43-f7e2c78f4538 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:36.665918 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedffb91-6baa-4de3-bb43-f7e2c78f4538 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:36.666192 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedffb91-6baa-4de3-bb43-f7e2c78f4538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:36.683304 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-dedffb91-6baa-4de3-bb43-f7e2c78f4538 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:36.684527 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-dedffb91-6baa-4de3-bb43-f7e2c78f4538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:36.735813 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 451/897] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:55:36 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 18:55:36.737217 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1f9b7-d70f-4f08-927a-2e24791d6ba6 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:36.760807 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 447/898] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:36 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:55:36.761510 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedffb91-6baa-4de3-bb43-f7e2c78f4538 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:36.849567 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1f9b7-d70f-4f08-927a-2e24791d6ba6 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:36.861390 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedffb91-6baa-4de3-bb43-f7e2c78f4538 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:36.886336 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3ff10-194d-49f3-99b3-9154e049f3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:36.887014 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3ff10-194d-49f3-99b3-9154e049f3ff None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:36.887298 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3ff10-194d-49f3-99b3-9154e049f3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:36.887561 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3ff10-194d-49f3-99b3-9154e049f3ff None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:36.888271 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3ff10-194d-49f3-99b3-9154e049f3ff None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:36.888577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3ff10-194d-49f3-99b3-9154e049f3ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:36.889996 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3ff10-194d-49f3-99b3-9154e049f3ff None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:36.894514 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 452/899] 10.222.0.24 () {56 vars in 1122 bytes} [Mon May 16 18:55:36 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:36.895544 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3ff10-194d-49f3-99b3-9154e049f3ff None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:36.906904 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ddd1b4-7855-4057-88d3-7f3d6be97c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:36.908561 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ddd1b4-7855-4057-88d3-7f3d6be97c22 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:36.909407 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ddd1b4-7855-4057-88d3-7f3d6be97c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:36.909906 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ddd1b4-7855-4057-88d3-7f3d6be97c22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:36.925077 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ddd1b4-7855-4057-88d3-7f3d6be97c22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:36.927453 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ddd1b4-7855-4057-88d3-7f3d6be97c22 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:36.952345 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-99ddd1b4-7855-4057-88d3-7f3d6be97c22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:36.952345 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:36.952345 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:36.952345 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:36.952345 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:36.952345 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:36.952345 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:36.952345 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:36.952345 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:36.952345 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:36.952345 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:36.952345 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:36.952345 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:36.952345 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:36.952345 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:36.953335 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:36.953335 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:36.953335 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:36.953335 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:36.953335 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:36.953335 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:36.953335 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:36.953335 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:36.953335 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:36.953335 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:36.953335 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:36.953335 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:36.953335 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:36.953335 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:36.953335 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:36.953335 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:36.953335 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:36.954279 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:36.954279 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:36.954279 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:36.954279 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:36.957031 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 448/900] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:36.963179 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ddd1b4-7855-4057-88d3-7f3d6be97c22 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:37.012393 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3ff10-194d-49f3-99b3-9154e049f3ff None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:37.050229 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f8ad1-e1c6-4e81-aa57-1ab66e90bdad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:37.051012 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f8ad1-e1c6-4e81-aa57-1ab66e90bdad None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:37.051294 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f8ad1-e1c6-4e81-aa57-1ab66e90bdad None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:37.051569 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f8ad1-e1c6-4e81-aa57-1ab66e90bdad None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:37.052243 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f8ad1-e1c6-4e81-aa57-1ab66e90bdad None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:37.053733 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f8ad1-e1c6-4e81-aa57-1ab66e90bdad None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:37.066814 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-8f6f8ad1-e1c6-4e81-aa57-1ab66e90bdad None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 18:55:37.066814 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:37.066814 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:55:37.066814 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:55:37.066814 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:55:37.066814 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:55:37.066814 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:55:37.066814 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:37.066814 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 18:55:37.066814 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:37.066814 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:55:37.066814 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:37.066814 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:37.066814 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:37.066814 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:37.066814 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:37.066814 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:37.067928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:37.067928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:37.067928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:37.067928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:37.067928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:37.067928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:37.067928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:55:37.067928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:55:37.067928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:55:37.067928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:55:37.067928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:37.067928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:37.067928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:37.067928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:37.067928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:37.067928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:37.068753 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:37.068753 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:37.068753 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:37.068753 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:37.068753 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:37.068753 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:37.068753 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:37.068753 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:37.068753 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:37.068753 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:37.068753 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:55:37.068753 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:37.068753 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 18:55:37.068753 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:37.068753 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 453/901] 10.222.0.24 () {56 vars in 1114 bytes} [Mon May 16 18:55:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:37.074253 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f8ad1-e1c6-4e81-aa57-1ab66e90bdad None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:37.084221 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ddd1b4-7855-4057-88d3-7f3d6be97c22 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:37.137162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdab98b-7c0b-4ee3-82e5-0ca406043c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:37.138050 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdab98b-7c0b-4ee3-82e5-0ca406043c38 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:37.138431 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdab98b-7c0b-4ee3-82e5-0ca406043c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:37.138853 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdab98b-7c0b-4ee3-82e5-0ca406043c38 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:37.139700 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdab98b-7c0b-4ee3-82e5-0ca406043c38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:37.140136 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdab98b-7c0b-4ee3-82e5-0ca406043c38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:37.141656 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdab98b-7c0b-4ee3-82e5-0ca406043c38 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:37.162094 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 449/902] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:55:37.162094 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdab98b-7c0b-4ee3-82e5-0ca406043c38 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:37.184463 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f8ad1-e1c6-4e81-aa57-1ab66e90bdad None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:37.218347 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fbf7ab-aa43-4c81-b42a-96211fe20319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:37.219024 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbf7ab-aa43-4c81-b42a-96211fe20319 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:37.219305 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbf7ab-aa43-4c81-b42a-96211fe20319 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:37.219586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbf7ab-aa43-4c81-b42a-96211fe20319 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:37.220314 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fbf7ab-aa43-4c81-b42a-96211fe20319 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:37.220624 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fbf7ab-aa43-4c81-b42a-96211fe20319 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:37.222123 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fbf7ab-aa43-4c81-b42a-96211fe20319 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:37.227493 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 454/903] 10.222.0.24 () {56 vars in 1114 bytes} [Mon May 16 18:55:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:55:37.232856 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fbf7ab-aa43-4c81-b42a-96211fe20319 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:37.259927 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdab98b-7c0b-4ee3-82e5-0ca406043c38 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:37.293901 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75b387-25ca-41c7-88f0-b44cf2345819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:37.294770 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75b387-25ca-41c7-88f0-b44cf2345819 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:37.295122 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75b387-25ca-41c7-88f0-b44cf2345819 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:37.295500 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75b387-25ca-41c7-88f0-b44cf2345819 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:37.302505 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75b387-25ca-41c7-88f0-b44cf2345819 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:37.304631 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75b387-25ca-41c7-88f0-b44cf2345819 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:37.320552 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-8b75b387-25ca-41c7-88f0-b44cf2345819 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:37.320552 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:37.320552 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:37.320552 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:37.320552 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:37.320552 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:37.320552 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:37.320552 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:37.320552 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:37.320552 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:37.320552 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:37.320552 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:37.320552 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:55:37.320552 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:55:37.320552 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:55:37.321490 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:55:37.321490 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:37.321490 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:37.321490 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:37.321490 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:37.321490 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:37.321490 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:37.321490 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:37.321490 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:37.321490 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:37.321490 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:37.321490 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:37.321490 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:37.321490 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:37.321490 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:37.321490 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:37.321490 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:37.322428 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:55:37.322428 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:55:37.322428 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:55:37.322428 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:55:37.322428 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:55:37.322428 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:55:37.322428 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:37.322428 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:37.326887 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 450/904] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:55:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:37.327835 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75b387-25ca-41c7-88f0-b44cf2345819 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:37.337101 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fbf7ab-aa43-4c81-b42a-96211fe20319 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:37.370958 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a85bc-df0e-4f1c-ac5e-eec742d0f7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:37.372008 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a85bc-df0e-4f1c-ac5e-eec742d0f7f9 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:37.372536 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a85bc-df0e-4f1c-ac5e-eec742d0f7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:37.372988 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a85bc-df0e-4f1c-ac5e-eec742d0f7f9 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:37.373926 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a85bc-df0e-4f1c-ac5e-eec742d0f7f9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:37.374428 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a85bc-df0e-4f1c-ac5e-eec742d0f7f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:37.376022 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a85bc-df0e-4f1c-ac5e-eec742d0f7f9 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:37.386442 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 455/905] 10.222.0.24 () {56 vars in 1114 bytes} [Mon May 16 18:55:37 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:37.387600 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a85bc-df0e-4f1c-ac5e-eec742d0f7f9 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:37.430738 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75b387-25ca-41c7-88f0-b44cf2345819 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:37.464197 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1b828-4219-46d5-9a4a-0d34cbf4c68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:37.464926 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1b828-4219-46d5-9a4a-0d34cbf4c68f None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:37.465198 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1b828-4219-46d5-9a4a-0d34cbf4c68f None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:37.465518 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1b828-4219-46d5-9a4a-0d34cbf4c68f None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:37.466345 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1b828-4219-46d5-9a4a-0d34cbf4c68f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:37.466658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1b828-4219-46d5-9a4a-0d34cbf4c68f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:37.468184 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1b828-4219-46d5-9a4a-0d34cbf4c68f None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:37.480306 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 451/906] 10.222.0.24 () {56 vars in 1148 bytes} [Mon May 16 18:55:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:37.486255 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1b828-4219-46d5-9a4a-0d34cbf4c68f None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:37.490419 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a85bc-df0e-4f1c-ac5e-eec742d0f7f9 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:37.524146 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9730824-21a5-457d-be2a-3201c926b053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:37.525302 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9730824-21a5-457d-be2a-3201c926b053 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:37.525924 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9730824-21a5-457d-be2a-3201c926b053 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:37.526432 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9730824-21a5-457d-be2a-3201c926b053 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:37.527436 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9730824-21a5-457d-be2a-3201c926b053 None admin] RBAC: Adding query filter params (interface=public, service_id=98b4b9c07c4741919003dfd01ce2dc41, region_id=RegionOne) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:37.527946 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9730824-21a5-457d-be2a-3201c926b053 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:37.529599 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9730824-21a5-457d-be2a-3201c926b053 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:37.539988 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 456/907] 10.222.0.24 () {56 vars in 1251 bytes} [Mon May 16 18:55:37 2022] GET /identity/v3/endpoints?service_id=98b4b9c07c4741919003dfd01ce2dc41&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:37.541106 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9730824-21a5-457d-be2a-3201c926b053 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:37.587510 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1b828-4219-46d5-9a4a-0d34cbf4c68f None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:37.628610 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36ffc0-f748-4909-bd18-cc24ff0d053f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:37.629971 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36ffc0-f748-4909-bd18-cc24ff0d053f None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:37.630653 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36ffc0-f748-4909-bd18-cc24ff0d053f None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:37.631439 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36ffc0-f748-4909-bd18-cc24ff0d053f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:37.632830 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff36ffc0-f748-4909-bd18-cc24ff0d053f None admin] RBAC: Adding query filter params (role.id=1abd30a5bbfb45a1ab6de390e19a6c70, scope.project.id=084e70bbad784892b195bb11a68bf857, user.id=4775e9dd7aea448d95ec7378b4ff3124) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:37.633507 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff36ffc0-f748-4909-bd18-cc24ff0d053f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:37.635878 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff36ffc0-f748-4909-bd18-cc24ff0d053f None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:37.639173 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9730824-21a5-457d-be2a-3201c926b053 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:37.643809 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 452/908] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:55:37 2022] GET /identity/v3/role_assignments?user.id=4775e9dd7aea448d95ec7378b4ff3124&scope.project.id=084e70bbad784892b195bb11a68bf857&role.id=1abd30a5bbfb45a1ab6de390e19a6c70 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:55:37.686440 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174e47e-1a79-45ef-9a94-1e215a1362c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:37.687644 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174e47e-1a79-45ef-9a94-1e215a1362c9 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:37.688269 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174e47e-1a79-45ef-9a94-1e215a1362c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:37.688742 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174e47e-1a79-45ef-9a94-1e215a1362c9 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:37.689685 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0174e47e-1a79-45ef-9a94-1e215a1362c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:37.691374 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0174e47e-1a79-45ef-9a94-1e215a1362c9 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:37.698740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 457/909] 10.222.0.24 () {56 vars in 1087 bytes} [Mon May 16 18:55:37 2022] GET /identity/v3/services => generated 1268 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:55:38.902712 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943051e1-d469-45c3-add6-31b818f75e7e None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:38.904221 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943051e1-d469-45c3-add6-31b818f75e7e None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:38.904956 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943051e1-d469-45c3-add6-31b818f75e7e None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:38.908082 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 453/910] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:38.913967 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3e76f-ecfa-44cf-874a-34a6b4f39bd4 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:38.914721 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3e76f-ecfa-44cf-874a-34a6b4f39bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:38.914721 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3e76f-ecfa-44cf-874a-34a6b4f39bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:38.932388 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-0ce3e76f-ecfa-44cf-874a-34a6b4f39bd4 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:38.933634 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0ce3e76f-ecfa-44cf-874a-34a6b4f39bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:39.005650 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 458/911] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 18:55:39.023566 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943051e1-d469-45c3-add6-31b818f75e7e None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:39.123242 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943051e1-d469-45c3-add6-31b818f75e7e None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:39.157020 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf7cc0-3a0d-4fc1-bbdb-7f48e6ff6b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:39.158187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf7cc0-3a0d-4fc1-bbdb-7f48e6ff6b62 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:39.158662 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf7cc0-3a0d-4fc1-bbdb-7f48e6ff6b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:39.159111 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf7cc0-3a0d-4fc1-bbdb-7f48e6ff6b62 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:39.159930 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf7cc0-3a0d-4fc1-bbdb-7f48e6ff6b62 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:39.161863 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf7cc0-3a0d-4fc1-bbdb-7f48e6ff6b62 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:39.174632 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-4fbf7cc0-3a0d-4fc1-bbdb-7f48e6ff6b62 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 18:55:39.174632 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:39.174632 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:55:39.174632 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:55:39.174632 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:55:39.174632 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:55:39.174632 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:55:39.174632 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:39.174632 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 18:55:39.174632 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:39.174632 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:55:39.174632 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:39.174632 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:39.174632 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:39.174632 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:39.174632 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:39.176310 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:39.176310 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:39.176310 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:39.176310 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:39.176310 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:39.176310 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:39.176310 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:39.176310 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:55:39.176310 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:55:39.176310 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:55:39.176310 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:55:39.176310 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:39.176310 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:39.176310 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:39.176310 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:39.176310 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:39.177934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:39.177934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:39.177934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:39.177934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:39.177934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:39.177934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:39.177934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:39.177934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:39.177934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:39.177934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:39.177934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:39.177934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:55:39.177934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:39.177934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 18:55:39.177934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:39.181570 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 454/912] 10.222.0.24 () {56 vars in 1132 bytes} [Mon May 16 18:55:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:39.183042 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3e76f-ecfa-44cf-874a-34a6b4f39bd4 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:39.287886 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3e76f-ecfa-44cf-874a-34a6b4f39bd4 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:39.324129 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b974ed-3832-4b7d-9758-62e5daf1fd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:39.325197 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b974ed-3832-4b7d-9758-62e5daf1fd58 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:39.325712 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b974ed-3832-4b7d-9758-62e5daf1fd58 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:39.326181 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b974ed-3832-4b7d-9758-62e5daf1fd58 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:39.327122 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b974ed-3832-4b7d-9758-62e5daf1fd58 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:39.327623 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b974ed-3832-4b7d-9758-62e5daf1fd58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:39.329236 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b974ed-3832-4b7d-9758-62e5daf1fd58 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:39.339799 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 459/913] 10.222.0.24 () {56 vars in 1126 bytes} [Mon May 16 18:55:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:55:39.341644 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf7cc0-3a0d-4fc1-bbdb-7f48e6ff6b62 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:39.441946 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf7cc0-3a0d-4fc1-bbdb-7f48e6ff6b62 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:39.475437 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276ab45-7479-433b-9711-1e80612411c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:39.476569 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276ab45-7479-433b-9711-1e80612411c3 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:39.477069 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276ab45-7479-433b-9711-1e80612411c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:39.477728 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276ab45-7479-433b-9711-1e80612411c3 None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:39.478654 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276ab45-7479-433b-9711-1e80612411c3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:39.479215 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276ab45-7479-433b-9711-1e80612411c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:39.480796 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276ab45-7479-433b-9711-1e80612411c3 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:39.489641 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 455/914] 10.222.0.24 () {56 vars in 1126 bytes} [Mon May 16 18:55:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:39.492285 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b974ed-3832-4b7d-9758-62e5daf1fd58 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:39.591739 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b974ed-3832-4b7d-9758-62e5daf1fd58 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:39.615117 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f4c18-1950-45dd-8576-b0f338abcd05 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:39.615503 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f4c18-1950-45dd-8576-b0f338abcd05 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:39.616014 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f4c18-1950-45dd-8576-b0f338abcd05 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:39.618973 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 456/915] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:55:39.626702 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079f007-d43f-406c-9abd-c915ba655196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:39.626854 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c303c-92b7-4f18-88c6-f50f51325955 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:39.627313 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c303c-92b7-4f18-88c6-f50f51325955 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:39.627752 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c303c-92b7-4f18-88c6-f50f51325955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:39.628167 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079f007-d43f-406c-9abd-c915ba655196 None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:39.628649 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079f007-d43f-406c-9abd-c915ba655196 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:39.629121 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079f007-d43f-406c-9abd-c915ba655196 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:39.630088 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079f007-d43f-406c-9abd-c915ba655196 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:39.631656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079f007-d43f-406c-9abd-c915ba655196 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:39.655140 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-df0c303c-92b7-4f18-88c6-f50f51325955 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:39.657178 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-df0c303c-92b7-4f18-88c6-f50f51325955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:39.662023 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 460/916] 10.222.0.24 () {60 vars in 1144 bytes} [Mon May 16 18:55:39 2022] POST /identity/v3/endpoints => generated 347 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:55:39.801038 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 457/917] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:39 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:55:39.841194 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079f007-d43f-406c-9abd-c915ba655196 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:39.947912 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412aabd-0399-4edb-993b-a24572f43af1 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:39.948459 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412aabd-0399-4edb-993b-a24572f43af1 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:39.948890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412aabd-0399-4edb-993b-a24572f43af1 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:39.951797 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 458/918] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:39.959937 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc4377-35c4-4826-802a-efc61781509c None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:39.960503 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc4377-35c4-4826-802a-efc61781509c None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:39.961041 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc4377-35c4-4826-802a-efc61781509c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:39.988212 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-29cc4377-35c4-4826-802a-efc61781509c None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:39.989973 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079f007-d43f-406c-9abd-c915ba655196 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:39.990411 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-29cc4377-35c4-4826-802a-efc61781509c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:40.023674 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be106b-9a82-4c5e-b65c-267b64327917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:40.024754 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be106b-9a82-4c5e-b65c-267b64327917 None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:40.025232 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be106b-9a82-4c5e-b65c-267b64327917 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:40.025746 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be106b-9a82-4c5e-b65c-267b64327917 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:40.026674 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77be106b-9a82-4c5e-b65c-267b64327917 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:40.028274 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77be106b-9a82-4c5e-b65c-267b64327917 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:40.046519 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 461/919] 10.222.0.24 () {60 vars in 1141 bytes} [Mon May 16 18:55:39 2022] POST /identity/v3/services => generated 241 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:55:40.092484 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 459/920] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:55:40.134958 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be106b-9a82-4c5e-b65c-267b64327917 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:40.248075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be106b-9a82-4c5e-b65c-267b64327917 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:40.283985 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a611b2-e81b-41a1-840c-167ababe1deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:40.284706 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a611b2-e81b-41a1-840c-167ababe1deb None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:40.284984 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a611b2-e81b-41a1-840c-167ababe1deb None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:40.285259 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a611b2-e81b-41a1-840c-167ababe1deb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:40.285953 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a611b2-e81b-41a1-840c-167ababe1deb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:40.287727 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a611b2-e81b-41a1-840c-167ababe1deb None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:40.300249 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-02a611b2-e81b-41a1-840c-167ababe1deb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 18:55:40.300249 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:40.300249 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:55:40.300249 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:55:40.300249 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:55:40.300249 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:55:40.300249 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:55:40.300249 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:40.300249 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 18:55:40.300249 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:40.300249 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:55:40.300249 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:40.300249 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:40.300249 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:40.300249 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:40.300249 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:40.300249 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:40.301882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:40.301882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:40.301882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:40.301882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:40.301882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:40.301882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:40.301882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:55:40.301882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:55:40.301882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:55:40.301882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:55:40.301882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:40.301882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:40.301882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:40.301882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:40.301882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:40.301882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:40.303497 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:40.303497 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:40.303497 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:40.303497 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:40.303497 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:40.303497 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:40.303497 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:40.303497 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:40.303497 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:40.303497 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:40.303497 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:55:40.303497 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:40.303497 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 18:55:40.303497 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:40.303497 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 462/921] 10.222.0.24 () {56 vars in 1114 bytes} [Mon May 16 18:55:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:40.310388 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc4377-35c4-4826-802a-efc61781509c None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:40.412718 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc4377-35c4-4826-802a-efc61781509c None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:40.448257 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093d0e4-6094-4e38-a422-d1c75dc5c6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:40.448956 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093d0e4-6094-4e38-a422-d1c75dc5c6b9 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:40.449237 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093d0e4-6094-4e38-a422-d1c75dc5c6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:40.449509 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093d0e4-6094-4e38-a422-d1c75dc5c6b9 None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:40.450280 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4093d0e4-6094-4e38-a422-d1c75dc5c6b9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:40.450587 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4093d0e4-6094-4e38-a422-d1c75dc5c6b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:40.452046 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4093d0e4-6094-4e38-a422-d1c75dc5c6b9 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:40.458020 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 460/922] 10.222.0.24 () {56 vars in 1114 bytes} [Mon May 16 18:55:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:40.463715 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a611b2-e81b-41a1-840c-167ababe1deb None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:40.564747 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a611b2-e81b-41a1-840c-167ababe1deb None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:40.604032 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aadf6d5-b783-40c4-9b22-f0019c2308ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:40.604710 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aadf6d5-b783-40c4-9b22-f0019c2308ef None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:40.604991 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aadf6d5-b783-40c4-9b22-f0019c2308ef None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:40.605265 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aadf6d5-b783-40c4-9b22-f0019c2308ef None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:40.606027 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aadf6d5-b783-40c4-9b22-f0019c2308ef None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:40.606336 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aadf6d5-b783-40c4-9b22-f0019c2308ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:40.607724 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aadf6d5-b783-40c4-9b22-f0019c2308ef None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:40.613387 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 463/923] 10.222.0.24 () {56 vars in 1114 bytes} [Mon May 16 18:55:40 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:40.618903 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093d0e4-6094-4e38-a422-d1c75dc5c6b9 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:40.646586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8a309-cd3d-42f3-b2c3-2d8220294f5c None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:40.646586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8a309-cd3d-42f3-b2c3-2d8220294f5c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:40.646586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8a309-cd3d-42f3-b2c3-2d8220294f5c None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:40.647370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 464/924] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:55:40.652467 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e77ca3-1a69-4409-a2a3-a2222e07b783 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:40.652896 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e77ca3-1a69-4409-a2a3-a2222e07b783 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:40.653306 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e77ca3-1a69-4409-a2a3-a2222e07b783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:40.670408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-65e77ca3-1a69-4409-a2a3-a2222e07b783 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:40.671514 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-65e77ca3-1a69-4409-a2a3-a2222e07b783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:40.723035 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093d0e4-6094-4e38-a422-d1c75dc5c6b9 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:40.753790 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 465/925] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 18:55:40.762165 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855400a-d685-4045-a857-6d6f272e20c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:40.763095 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855400a-d685-4045-a857-6d6f272e20c3 None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:40.763733 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855400a-d685-4045-a857-6d6f272e20c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:40.764215 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855400a-d685-4045-a857-6d6f272e20c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:40.765269 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7855400a-d685-4045-a857-6d6f272e20c3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:40.766887 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7855400a-d685-4045-a857-6d6f272e20c3 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:40.775607 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e77ca3-1a69-4409-a2a3-a2222e07b783 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:40.791757 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 461/926] 10.222.0.24 () {60 vars in 1144 bytes} [Mon May 16 18:55:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:55:40.888496 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e77ca3-1a69-4409-a2a3-a2222e07b783 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:40.934242 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7121c15-3752-453b-807d-2690b9baefce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:40.935164 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7121c15-3752-453b-807d-2690b9baefce None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:40.935447 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7121c15-3752-453b-807d-2690b9baefce None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:40.935716 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7121c15-3752-453b-807d-2690b9baefce None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:40.948755 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7121c15-3752-453b-807d-2690b9baefce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:55:40.957511 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-a7121c15-3752-453b-807d-2690b9baefce None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 18:55:40.957511 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:40.957511 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:40.957511 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:40.957511 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:40.957511 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:40.957511 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:40.957511 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:40.957511 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:40.957511 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:40.957511 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:40.957511 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:40.957511 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:55:40.957511 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:55:40.957511 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:55:40.957511 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:55:40.958534 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:55:40.958534 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:55:40.958534 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:55:40.958534 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:55:40.958534 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:40.958534 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:40.958534 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:40.958534 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:40.958534 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:40.958534 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:40.958534 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:40.958534 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:40.958534 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:40.958534 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:40.958534 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:40.958534 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:40.959370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:40.959370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:40.959370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:40.959370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:40.959370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:55:40.959370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:55:40.959370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:55:40.959370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:55:40.959370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:55:40.959370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:55:40.959370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 18:55:40.959370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:40.959370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 466/927] 10.222.0.24 () {56 vars in 1120 bytes} [Mon May 16 18:55:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:55:40.965484 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855400a-d685-4045-a857-6d6f272e20c3 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:41.068155 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855400a-d685-4045-a857-6d6f272e20c3 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:41.101186 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86009ada-04b1-448e-9a35-6d779cbbd601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:41.102267 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86009ada-04b1-448e-9a35-6d779cbbd601 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:41.102754 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86009ada-04b1-448e-9a35-6d779cbbd601 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:41.103256 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86009ada-04b1-448e-9a35-6d779cbbd601 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:41.104219 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86009ada-04b1-448e-9a35-6d779cbbd601 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:41.104746 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86009ada-04b1-448e-9a35-6d779cbbd601 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:41.106353 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86009ada-04b1-448e-9a35-6d779cbbd601 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:41.115087 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 462/928] 10.222.0.24 () {56 vars in 1115 bytes} [Mon May 16 18:55:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:41.123734 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7121c15-3752-453b-807d-2690b9baefce None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:41.226177 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7121c15-3752-453b-807d-2690b9baefce None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:41.262977 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f78cd4-80bf-4ea3-9fd2-7f2c025827c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:41.263782 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f78cd4-80bf-4ea3-9fd2-7f2c025827c7 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:41.264062 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f78cd4-80bf-4ea3-9fd2-7f2c025827c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:41.264335 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f78cd4-80bf-4ea3-9fd2-7f2c025827c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:41.275134 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f78cd4-80bf-4ea3-9fd2-7f2c025827c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:41.276602 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f78cd4-80bf-4ea3-9fd2-7f2c025827c7 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:41.294204 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-76f78cd4-80bf-4ea3-9fd2-7f2c025827c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:41.294204 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:41.294204 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:41.294204 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:41.294204 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:41.294204 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:41.294204 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:41.294204 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:41.294204 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:41.294204 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:41.294204 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:41.294204 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:41.294204 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:41.294204 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:41.294204 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:41.295189 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:41.295189 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:41.295189 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:41.295189 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:41.295189 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:41.295189 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:41.295189 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:41.295189 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:41.295189 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:41.295189 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:41.295189 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:41.295189 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:41.295189 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:41.295189 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:41.295189 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:41.295189 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:41.295189 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:41.296083 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:41.296083 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:41.296083 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:41.296083 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:41.296083 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 467/929] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:41.303191 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86009ada-04b1-448e-9a35-6d779cbbd601 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:41.401486 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86009ada-04b1-448e-9a35-6d779cbbd601 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:41.435180 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cf294-15d1-439a-8917-66d496fc92d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:41.436268 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cf294-15d1-439a-8917-66d496fc92d3 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:41.436742 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cf294-15d1-439a-8917-66d496fc92d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:41.437206 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cf294-15d1-439a-8917-66d496fc92d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:41.438159 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36cf294-15d1-439a-8917-66d496fc92d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:41.438675 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36cf294-15d1-439a-8917-66d496fc92d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:41.440242 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36cf294-15d1-439a-8917-66d496fc92d3 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:41.454002 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 463/930] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:41.459786 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f78cd4-80bf-4ea3-9fd2-7f2c025827c7 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:41.556081 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f78cd4-80bf-4ea3-9fd2-7f2c025827c7 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:41.588764 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31897f-3819-492e-b416-2e25b66ace85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:41.590007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31897f-3819-492e-b416-2e25b66ace85 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:41.590507 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31897f-3819-492e-b416-2e25b66ace85 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:41.591009 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31897f-3819-492e-b416-2e25b66ace85 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:41.599872 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf31897f-3819-492e-b416-2e25b66ace85 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:41.601730 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf31897f-3819-492e-b416-2e25b66ace85 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:41.616548 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-cf31897f-3819-492e-b416-2e25b66ace85 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 18:55:41.616548 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:41.616548 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:41.616548 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:41.616548 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:41.616548 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:41.616548 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:41.616548 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:41.616548 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:41.616548 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:41.616548 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:41.616548 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:41.616548 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:55:41.616548 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:55:41.616548 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:55:41.616548 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:55:41.617488 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:41.617488 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:41.617488 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:55:41.617488 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:41.617488 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:55:41.617488 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:41.617488 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:41.617488 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:41.617488 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:41.617488 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:41.617488 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:41.617488 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:41.617488 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:41.617488 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:41.617488 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:41.617488 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:41.617488 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:41.617488 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:41.618447 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:41.618447 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:41.618447 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:55:41.618447 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:55:41.618447 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:55:41.618447 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:55:41.618447 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:55:41.618447 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:55:41.618447 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 18:55:41.618447 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:41.621019 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 468/931] 10.222.0.24 () {56 vars in 1117 bytes} [Mon May 16 18:55:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:41.627086 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cf294-15d1-439a-8917-66d496fc92d3 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:41.725347 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cf294-15d1-439a-8917-66d496fc92d3 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:41.759563 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602895bf-0574-4fdc-83a3-d559a67e2462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:41.760263 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602895bf-0574-4fdc-83a3-d559a67e2462 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:41.760549 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602895bf-0574-4fdc-83a3-d559a67e2462 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:41.760822 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602895bf-0574-4fdc-83a3-d559a67e2462 None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:41.765725 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602895bf-0574-4fdc-83a3-d559a67e2462 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:41.765725 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602895bf-0574-4fdc-83a3-d559a67e2462 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:41.765725 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602895bf-0574-4fdc-83a3-d559a67e2462 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:41.782044 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 464/932] 10.222.0.24 () {56 vars in 1149 bytes} [Mon May 16 18:55:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:41.789648 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31897f-3819-492e-b416-2e25b66ace85 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:41.891157 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31897f-3819-492e-b416-2e25b66ace85 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:41.928093 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273f2c6-0f32-445c-aed8-c2db387b6472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:41.928909 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273f2c6-0f32-445c-aed8-c2db387b6472 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:41.929300 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273f2c6-0f32-445c-aed8-c2db387b6472 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:41.929598 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273f2c6-0f32-445c-aed8-c2db387b6472 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:41.940576 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b273f2c6-0f32-445c-aed8-c2db387b6472 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:41.942092 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b273f2c6-0f32-445c-aed8-c2db387b6472 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:41.959075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-b273f2c6-0f32-445c-aed8-c2db387b6472 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:41.959075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:41.959075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:41.959075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:41.959075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:41.959075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:41.959075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:41.959075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:41.959075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:41.959075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:41.959075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:41.959075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:41.959075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:41.959075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:41.959075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:41.959980 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:41.959980 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:41.959980 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:41.959980 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:41.959980 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:41.959980 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:41.959980 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:41.959980 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:41.959980 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:41.959980 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:41.959980 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:41.959980 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:41.959980 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:41.959980 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:41.959980 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:41.959980 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:41.959980 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:41.961035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:41.961035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:41.961035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:41.961035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:41.961035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 469/933] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:41.967525 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602895bf-0574-4fdc-83a3-d559a67e2462 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:42.071841 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602895bf-0574-4fdc-83a3-d559a67e2462 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:42.096595 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956264c9-e52d-4abc-a21d-715510378902 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:42.096895 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956264c9-e52d-4abc-a21d-715510378902 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:42.097163 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956264c9-e52d-4abc-a21d-715510378902 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:42.100135 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 470/934] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:42.104433 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4986c-b803-45bf-b4ea-5588bfd4891f None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:42.104724 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4986c-b803-45bf-b4ea-5588bfd4891f None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:42.105029 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4986c-b803-45bf-b4ea-5588bfd4891f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:42.108673 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4eb807-c206-48c6-ad2c-0ba2223c3b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:42.109823 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4eb807-c206-48c6-ad2c-0ba2223c3b02 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:42.110430 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4eb807-c206-48c6-ad2c-0ba2223c3b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:42.110892 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4eb807-c206-48c6-ad2c-0ba2223c3b02 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:42.111824 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4eb807-c206-48c6-ad2c-0ba2223c3b02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:42.112343 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4eb807-c206-48c6-ad2c-0ba2223c3b02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:42.113951 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4eb807-c206-48c6-ad2c-0ba2223c3b02 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:42.122073 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-b4f4986c-b803-45bf-b4ea-5588bfd4891f None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:42.123268 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b4f4986c-b803-45bf-b4ea-5588bfd4891f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:42.126772 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 465/935] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:42.132694 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4eb807-c206-48c6-ad2c-0ba2223c3b02 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:42.197704 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 471/936] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:55:42.215553 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4986c-b803-45bf-b4ea-5588bfd4891f None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:42.241463 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4eb807-c206-48c6-ad2c-0ba2223c3b02 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:42.274719 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c5e63-952a-470e-b481-4ad7a380980b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:42.275581 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c5e63-952a-470e-b481-4ad7a380980b None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:42.275857 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c5e63-952a-470e-b481-4ad7a380980b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:42.276124 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c5e63-952a-470e-b481-4ad7a380980b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:42.282953 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c5e63-952a-470e-b481-4ad7a380980b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:42.284405 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c5e63-952a-470e-b481-4ad7a380980b None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:42.299461 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-944c5e63-952a-470e-b481-4ad7a380980b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:42.299461 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:42.299461 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:42.299461 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:42.299461 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:42.299461 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:42.299461 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:42.299461 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:42.299461 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:42.299461 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:42.299461 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:42.299461 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:42.299461 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:55:42.299461 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:55:42.299461 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:55:42.300375 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:55:42.300375 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:42.300375 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:42.300375 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:42.300375 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:42.300375 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:42.300375 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:42.300375 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:42.300375 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:42.300375 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:42.300375 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:42.300375 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:42.300375 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:42.300375 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:42.300375 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:42.300375 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:42.300375 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:42.301266 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:55:42.301266 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:55:42.301266 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:55:42.301266 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:55:42.301266 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:55:42.301266 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:55:42.301266 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:42.301266 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:42.301266 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 466/937] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:55:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:42.306770 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c5e63-952a-470e-b481-4ad7a380980b None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:42.314277 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4986c-b803-45bf-b4ea-5588bfd4891f None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:42.347759 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f023bde-3860-4b45-a3f3-ac94e1c23466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:42.348567 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f023bde-3860-4b45-a3f3-ac94e1c23466 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:42.348849 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f023bde-3860-4b45-a3f3-ac94e1c23466 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:42.349124 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f023bde-3860-4b45-a3f3-ac94e1c23466 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:42.349813 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f023bde-3860-4b45-a3f3-ac94e1c23466 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:42.351261 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f023bde-3860-4b45-a3f3-ac94e1c23466 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:42.363112 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-4f023bde-3860-4b45-a3f3-ac94e1c23466 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 16 18:55:42.363112 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:42.363112 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:55:42.363112 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:55:42.363112 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:55:42.363112 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:55:42.363112 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:55:42.363112 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:42.363112 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 18:55:42.363112 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:42.363112 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:55:42.363112 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:42.363112 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:42.363112 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:42.363112 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:42.363112 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:42.363112 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:42.365367 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:42.365367 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:42.365367 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:42.365367 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:42.365367 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:42.365367 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:42.365367 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:55:42.365367 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:55:42.365367 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:55:42.365367 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:55:42.365367 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:42.365367 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:42.365367 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:42.365367 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:42.365367 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:42.365367 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:42.367415 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:42.367415 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:42.367415 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:42.367415 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:42.367415 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:42.367415 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:42.367415 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:42.367415 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:42.367415 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:42.367415 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:42.367415 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:55:42.367415 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:42.367415 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 18:55:42.367415 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:42.373812 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 472/938] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:55:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:42.373812 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f023bde-3860-4b45-a3f3-ac94e1c23466 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:42.406650 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c5e63-952a-470e-b481-4ad7a380980b None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:42.439326 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a70ea-b60c-4c7f-b03b-f0c615359d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:42.439918 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a70ea-b60c-4c7f-b03b-f0c615359d3e None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:42.440199 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a70ea-b60c-4c7f-b03b-f0c615359d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:42.440466 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a70ea-b60c-4c7f-b03b-f0c615359d3e None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:42.441248 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a70ea-b60c-4c7f-b03b-f0c615359d3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:42.441571 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a70ea-b60c-4c7f-b03b-f0c615359d3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:42.443008 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a70ea-b60c-4c7f-b03b-f0c615359d3e None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:42.459324 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 467/939] 10.222.0.24 () {56 vars in 1148 bytes} [Mon May 16 18:55:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:55:42.459324 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0b5c0-5c07-4f7b-99da-951ac23a7886 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:42.459324 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0b5c0-5c07-4f7b-99da-951ac23a7886 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:42.459324 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0b5c0-5c07-4f7b-99da-951ac23a7886 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:42.459324 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 468/940] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:42.459963 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0b5c0-5c07-4f7b-99da-951ac23a7886 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:42.471165 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f023bde-3860-4b45-a3f3-ac94e1c23466 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:42.504661 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c6e5c-03a7-48e2-82a1-78439f7d51d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:42.505420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c6e5c-03a7-48e2-82a1-78439f7d51d3 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:42.505742 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c6e5c-03a7-48e2-82a1-78439f7d51d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:42.506013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c6e5c-03a7-48e2-82a1-78439f7d51d3 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:42.506719 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c6e5c-03a7-48e2-82a1-78439f7d51d3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:42.507137 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c6e5c-03a7-48e2-82a1-78439f7d51d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:42.508527 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c6e5c-03a7-48e2-82a1-78439f7d51d3 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:42.518613 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 473/941] 10.222.0.24 () {56 vars in 1112 bytes} [Mon May 16 18:55:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:55:42.518613 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ab2bd-d5bc-4e5b-8002-43771bfd6865 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:42.518613 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ab2bd-d5bc-4e5b-8002-43771bfd6865 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:42.518613 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ab2bd-d5bc-4e5b-8002-43771bfd6865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:42.531194 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-595ab2bd-d5bc-4e5b-8002-43771bfd6865 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:42.532348 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-595ab2bd-d5bc-4e5b-8002-43771bfd6865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:42.565150 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0b5c0-5c07-4f7b-99da-951ac23a7886 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:42.601570 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 474/942] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:55:42.601570 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595ab2bd-d5bc-4e5b-8002-43771bfd6865 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:42.604622 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ecae2-1659-4c51-a94e-5c4b3e5892da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:42.604622 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ecae2-1659-4c51-a94e-5c4b3e5892da None admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:42.604622 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ecae2-1659-4c51-a94e-5c4b3e5892da None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:42.604622 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ecae2-1659-4c51-a94e-5c4b3e5892da None admin] PATH_INFO: `/v3/projects/084e70bbad784892b195bb11a68bf857/users/4775e9dd7aea448d95ec7378b4ff3124/roles/1abd30a5bbfb45a1ab6de390e19a6c70` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:42.611212 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ecae2-1659-4c51-a94e-5c4b3e5892da None admin] RBAC: Authorizing `identity:create_grant(project_id=084e70bbad784892b195bb11a68bf857, user_id=4775e9dd7aea448d95ec7378b4ff3124, role_id=1abd30a5bbfb45a1ab6de390e19a6c70)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:42.613386 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ecae2-1659-4c51-a94e-5c4b3e5892da None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:42.633668 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 469/943] 10.222.0.24 () {58 vars in 1439 bytes} [Mon May 16 18:55:42 2022] PUT /identity/v3/projects/084e70bbad784892b195bb11a68bf857/users/4775e9dd7aea448d95ec7378b4ff3124/roles/1abd30a5bbfb45a1ab6de390e19a6c70 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:55:42.634621 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ecae2-1659-4c51-a94e-5c4b3e5892da None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:42.711110 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595ab2bd-d5bc-4e5b-8002-43771bfd6865 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:42.746781 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed128440-8caf-49f4-8037-8c6dbe937f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:42.747620 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed128440-8caf-49f4-8037-8c6dbe937f27 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:42.748000 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed128440-8caf-49f4-8037-8c6dbe937f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:42.748368 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed128440-8caf-49f4-8037-8c6dbe937f27 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:42.749210 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed128440-8caf-49f4-8037-8c6dbe937f27 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:42.749670 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed128440-8caf-49f4-8037-8c6dbe937f27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:42.751206 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed128440-8caf-49f4-8037-8c6dbe937f27 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:42.765925 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 475/944] 10.222.0.24 () {56 vars in 1112 bytes} [Mon May 16 18:55:42 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:42.771784 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ecae2-1659-4c51-a94e-5c4b3e5892da None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:42.812019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ebad6-bae5-4136-9438-5e6fd9b8f0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:42.813188 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ebad6-bae5-4136-9438-5e6fd9b8f0c7 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:42.813680 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ebad6-bae5-4136-9438-5e6fd9b8f0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:42.814101 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ebad6-bae5-4136-9438-5e6fd9b8f0c7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:42.814938 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ebad6-bae5-4136-9438-5e6fd9b8f0c7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:42.816670 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ebad6-bae5-4136-9438-5e6fd9b8f0c7 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:42.830578 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-754ebad6-bae5-4136-9438-5e6fd9b8f0c7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 18:55:42.830578 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:42.830578 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:55:42.830578 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:55:42.830578 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:55:42.830578 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:55:42.830578 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:55:42.830578 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:42.830578 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 18:55:42.830578 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:42.830578 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:55:42.830578 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:42.830578 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:42.830578 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:42.830578 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:42.830578 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:42.830578 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:42.831957 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:42.831957 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:42.831957 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:42.831957 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:42.831957 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:42.831957 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:42.831957 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:55:42.831957 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:55:42.831957 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:55:42.831957 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:55:42.831957 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:42.831957 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:42.831957 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:42.831957 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:42.831957 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:42.831957 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:42.832992 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:42.832992 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:42.832992 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:42.832992 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:42.832992 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:42.832992 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:42.832992 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:42.832992 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:42.832992 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:42.832992 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:42.832992 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:55:42.832992 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:42.832992 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 18:55:42.832992 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:42.835979 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 470/945] 10.222.0.24 () {56 vars in 1126 bytes} [Mon May 16 18:55:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:42.842634 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed128440-8caf-49f4-8037-8c6dbe937f27 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:42.953394 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed128440-8caf-49f4-8037-8c6dbe937f27 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:42.987523 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba22a9a-4dab-4972-9730-9572c9015d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:42.988123 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba22a9a-4dab-4972-9730-9572c9015d5a None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:42.988405 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba22a9a-4dab-4972-9730-9572c9015d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:42.988677 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba22a9a-4dab-4972-9730-9572c9015d5a None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:42.989394 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba22a9a-4dab-4972-9730-9572c9015d5a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:42.989728 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba22a9a-4dab-4972-9730-9572c9015d5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:42.991138 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba22a9a-4dab-4972-9730-9572c9015d5a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:42.996728 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 476/946] 10.222.0.24 () {56 vars in 1122 bytes} [Mon May 16 18:55:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:43.002657 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ebad6-bae5-4136-9438-5e6fd9b8f0c7 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:43.103498 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ebad6-bae5-4136-9438-5e6fd9b8f0c7 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:43.145102 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db9dcb-16b4-4b03-bcc3-b90c555cd57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:43.145824 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db9dcb-16b4-4b03-bcc3-b90c555cd57d None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:43.146106 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db9dcb-16b4-4b03-bcc3-b90c555cd57d None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:43.146379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db9dcb-16b4-4b03-bcc3-b90c555cd57d None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:43.147095 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db9dcb-16b4-4b03-bcc3-b90c555cd57d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:43.147400 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db9dcb-16b4-4b03-bcc3-b90c555cd57d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:43.148841 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db9dcb-16b4-4b03-bcc3-b90c555cd57d None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:43.154402 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 471/947] 10.222.0.24 () {56 vars in 1122 bytes} [Mon May 16 18:55:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:43.160391 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba22a9a-4dab-4972-9730-9572c9015d5a None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:43.208555 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa6594-b035-412d-9a2b-5a0e3801f3e5 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:43.208996 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa6594-b035-412d-9a2b-5a0e3801f3e5 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:43.209403 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa6594-b035-412d-9a2b-5a0e3801f3e5 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:43.211447 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 472/948] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:43.217099 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94596bc0-d4a4-4ea1-bc1c-9457a1e9d8bb None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:43.217486 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94596bc0-d4a4-4ea1-bc1c-9457a1e9d8bb None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:43.217887 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94596bc0-d4a4-4ea1-bc1c-9457a1e9d8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:43.234650 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-94596bc0-d4a4-4ea1-bc1c-9457a1e9d8bb None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:43.235830 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-94596bc0-d4a4-4ea1-bc1c-9457a1e9d8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:43.262453 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba22a9a-4dab-4972-9730-9572c9015d5a None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:43.302342 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 473/949] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:55:43.306570 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b287db-128c-41b5-9e2f-7039d6a67f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:43.307246 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b287db-128c-41b5-9e2f-7039d6a67f87 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:43.307529 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b287db-128c-41b5-9e2f-7039d6a67f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:43.307798 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b287db-128c-41b5-9e2f-7039d6a67f87 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:43.308605 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b287db-128c-41b5-9e2f-7039d6a67f87 None admin] RBAC: Adding query filter params (interface=public, service_id=e3dd555ccd4f4b6c8dca40a2887c2113, region_id=RegionOne) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:43.308916 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b287db-128c-41b5-9e2f-7039d6a67f87 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:43.310327 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b287db-128c-41b5-9e2f-7039d6a67f87 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:43.316187 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 477/950] 10.222.0.24 () {56 vars in 1251 bytes} [Mon May 16 18:55:43 2022] GET /identity/v3/endpoints?service_id=e3dd555ccd4f4b6c8dca40a2887c2113&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:43.322657 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94596bc0-d4a4-4ea1-bc1c-9457a1e9d8bb None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:43.329071 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b287db-128c-41b5-9e2f-7039d6a67f87 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:43.425451 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94596bc0-d4a4-4ea1-bc1c-9457a1e9d8bb None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:43.426177 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b287db-128c-41b5-9e2f-7039d6a67f87 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:43.458936 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa16a34-7458-48be-9114-b6cdde71774a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:43.459828 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa16a34-7458-48be-9114-b6cdde71774a None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:43.460172 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa16a34-7458-48be-9114-b6cdde71774a None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:43.460460 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa16a34-7458-48be-9114-b6cdde71774a None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:43.461006 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd9ca1-8714-47a2-ac1e-54344610b7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:43.461198 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa16a34-7458-48be-9114-b6cdde71774a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:43.461704 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd9ca1-8714-47a2-ac1e-54344610b7ea None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:43.461992 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd9ca1-8714-47a2-ac1e-54344610b7ea None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:43.462265 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd9ca1-8714-47a2-ac1e-54344610b7ea None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:43.462566 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa16a34-7458-48be-9114-b6cdde71774a None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:43.462972 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd9ca1-8714-47a2-ac1e-54344610b7ea None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:43.464465 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd9ca1-8714-47a2-ac1e-54344610b7ea None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:43.465930 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.common [None req-30fd9ca1-8714-47a2-ac1e-54344610b7ea None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 16 18:55:43.477876 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 474/951] 10.222.0.24 () {56 vars in 1087 bytes} [Mon May 16 18:55:43 2022] GET /identity/v3/services => generated 1497 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:55:43.485058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.sql.core [None req-30fd9ca1-8714-47a2-ac1e-54344610b7ea None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 16 18:55:43.485058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 16 18:55:43.485058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [parameters: {'id': '90d208b9db7f492594ce932f3f142ba7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 16 18:55:43.485058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80021) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 16 18:55:43.493192 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-30fd9ca1-8714-47a2-ac1e-54344610b7ea None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 90d208b9db7f492594ce932f3f142ba7.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 90d208b9db7f492594ce932f3f142ba7. May 16 18:55:43.493192 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:43.493192 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 18:55:43.493192 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 18:55:43.493192 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 18:55:43.493192 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 18:55:43.493192 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 18:55:43.493192 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application result = self._query(query) May 16 18:55:43.493192 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 18:55:43.493192 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application conn.query(q) May 16 18:55:43.493192 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 18:55:43.493192 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 18:55:43.493192 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 18:55:43.495161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application result.read() May 16 18:55:43.495161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 18:55:43.495161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 18:55:43.495161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 18:55:43.495161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 18:55:43.495161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 18:55:43.495161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 18:55:43.495161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 18:55:43.495161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 18:55:43.495161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 16 18:55:43.495161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:43.495161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 16 18:55:43.495161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:43.495161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:43.495161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 16 18:55:43.495161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 16 18:55:43.495161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 16 18:55:43.495161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return project_ref.to_dict() May 16 18:55:43.497401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 18:55:43.497401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application next(self.gen) May 16 18:55:43.497401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 16 18:55:43.497401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application yield resource May 16 18:55:43.497401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 18:55:43.497401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application next(self.gen) May 16 18:55:43.497401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 16 18:55:43.497401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self.session.rollback() May 16 18:55:43.497401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 16 18:55:43.497401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self.force_reraise() May 16 18:55:43.497401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 16 18:55:43.497401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise self.value May 16 18:55:43.497401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 16 18:55:43.497401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 16 18:55:43.497401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 16 18:55:43.497401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application session.commit() May 16 18:55:43.497401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 16 18:55:43.499551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 16 18:55:43.499551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 16 18:55:43.499551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._prepare_impl() May 16 18:55:43.499551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 16 18:55:43.499551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self.session.flush() May 16 18:55:43.499551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 16 18:55:43.499551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._flush(objects) May 16 18:55:43.499551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 16 18:55:43.499551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 16 18:55:43.499551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 16 18:55:43.499551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application compat.raise_( May 16 18:55:43.499551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 18:55:43.499551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception May 16 18:55:43.499551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 16 18:55:43.499551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application flush_context.execute() May 16 18:55:43.499551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 16 18:55:43.499551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rec.execute(self) May 16 18:55:43.501088 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 16 18:55:43.501088 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 16 18:55:43.501088 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 16 18:55:43.501088 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application _emit_insert_statements( May 16 18:55:43.501088 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 16 18:55:43.501088 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application c = connection._execute_20( May 16 18:55:43.501088 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 16 18:55:43.501088 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 16 18:55:43.501088 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 16 18:55:43.501088 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 16 18:55:43.501088 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 16 18:55:43.501088 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ret = self._execute_context( May 16 18:55:43.501088 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 16 18:55:43.501088 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 16 18:55:43.501088 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 16 18:55:43.506000 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 16 18:55:43.506000 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 18:55:43.506000 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception May 16 18:55:43.506000 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 18:55:43.506000 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 18:55:43.506000 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 18:55:43.506000 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 18:55:43.506000 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 18:55:43.506000 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application result = self._query(query) May 16 18:55:43.506000 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 18:55:43.506000 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application conn.query(q) May 16 18:55:43.506000 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 18:55:43.506000 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 18:55:43.506000 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 18:55:43.506000 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application result.read() May 16 18:55:43.506000 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 18:55:43.506000 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 18:55:43.506984 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 18:55:43.506984 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 18:55:43.506984 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 18:55:43.506984 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 18:55:43.506984 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 18:55:43.506984 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 18:55:43.506984 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 16 18:55:43.506984 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 16 18:55:43.506984 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [parameters: {'id': '90d208b9db7f492594ce932f3f142ba7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 16 18:55:43.506984 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 16 18:55:43.506984 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:43.506984 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:55:43.506984 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:43.506984 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:43.506984 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 16 18:55:43.507817 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 16 18:55:43.507817 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 16 18:55:43.507817 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 16 18:55:43.507817 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 16 18:55:43.507817 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:43.507817 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:55:43.507817 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:43.507817 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:43.507817 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:43.507817 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:43.507817 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:43.507817 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:43.507817 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:43.507817 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:43.507817 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:43.507817 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:43.507817 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:43.508761 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:43.508761 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 16 18:55:43.508761 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 16 18:55:43.508761 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:43.508761 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:43.508761 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 16 18:55:43.508761 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.Conflict( May 16 18:55:43.508761 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 90d208b9db7f492594ce932f3f142ba7. May 16 18:55:43.508761 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:43.508761 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 478/952] 10.222.0.24 () {60 vars in 1140 bytes} [Mon May 16 18:55:43 2022] POST /identity/v3/projects => generated 262 bytes in 166 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 16 18:55:43.509317 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa16a34-7458-48be-9114-b6cdde71774a None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:43.626029 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa16a34-7458-48be-9114-b6cdde71774a None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:43.662015 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b311c9-00f1-4cdf-b3b5-e54867b2d282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:43.662842 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b311c9-00f1-4cdf-b3b5-e54867b2d282 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:43.663115 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b311c9-00f1-4cdf-b3b5-e54867b2d282 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:43.663422 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b311c9-00f1-4cdf-b3b5-e54867b2d282 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:43.671008 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b311c9-00f1-4cdf-b3b5-e54867b2d282 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:43.672508 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b311c9-00f1-4cdf-b3b5-e54867b2d282 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:43.687331 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-e3b311c9-00f1-4cdf-b3b5-e54867b2d282 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:43.687331 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:43.687331 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:43.687331 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:43.687331 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:43.687331 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:43.687331 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:43.687331 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:43.687331 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:43.687331 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:43.687331 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:43.687331 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:43.687331 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:55:43.687331 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:55:43.687331 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:55:43.688249 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:55:43.688249 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:43.688249 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:43.688249 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:43.688249 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:43.688249 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:43.688249 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:43.688249 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:43.688249 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:43.688249 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:43.688249 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:43.688249 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:43.688249 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:43.688249 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:43.688249 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:43.688249 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:43.688249 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:43.689188 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:55:43.689188 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:55:43.689188 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:55:43.689188 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:55:43.689188 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:55:43.689188 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:55:43.689188 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:43.689188 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:43.689188 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 475/953] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:55:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:43.695967 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd9ca1-8714-47a2-ac1e-54344610b7ea None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:43.798004 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd9ca1-8714-47a2-ac1e-54344610b7ea None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:43.831530 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea488e4-dc59-48db-af65-fccaa5d16b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:43.832205 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea488e4-dc59-48db-af65-fccaa5d16b6e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:43.832481 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea488e4-dc59-48db-af65-fccaa5d16b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:43.832794 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea488e4-dc59-48db-af65-fccaa5d16b6e None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:43.833569 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea488e4-dc59-48db-af65-fccaa5d16b6e None admin] RBAC: Adding query filter params (name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:43.833882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea488e4-dc59-48db-af65-fccaa5d16b6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:43.835560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea488e4-dc59-48db-af65-fccaa5d16b6e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:43.855984 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 479/954] 10.222.0.24 () {56 vars in 1112 bytes} [Mon May 16 18:55:43 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:44.996295 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ca6a5-77ae-47e1-be38-99e8688d5796 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:44.996854 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ca6a5-77ae-47e1-be38-99e8688d5796 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:44.996854 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ca6a5-77ae-47e1-be38-99e8688d5796 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:44.998527 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 476/955] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:45.004025 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3eb01-11b9-4a3e-bbc3-e3f2ee857fcd None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:45.004439 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3eb01-11b9-4a3e-bbc3-e3f2ee857fcd None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:45.004612 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3eb01-11b9-4a3e-bbc3-e3f2ee857fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:45.022537 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-16b3eb01-11b9-4a3e-bbc3-e3f2ee857fcd None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:45.024078 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-16b3eb01-11b9-4a3e-bbc3-e3f2ee857fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:45.078969 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98aa910-71e9-4e6f-baaf-2854db102986 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:45.079598 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98aa910-71e9-4e6f-baaf-2854db102986 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:45.080069 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98aa910-71e9-4e6f-baaf-2854db102986 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:45.081938 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 477/956] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:45.087169 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf1283-7d94-4874-9fdf-3498b980e651 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:45.087702 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf1283-7d94-4874-9fdf-3498b980e651 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:45.088185 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf1283-7d94-4874-9fdf-3498b980e651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:45.094312 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 480/957] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:55:45.106699 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-c3cf1283-7d94-4874-9fdf-3498b980e651 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:45.108163 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-c3cf1283-7d94-4874-9fdf-3498b980e651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:45.116929 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3eb01-11b9-4a3e-bbc3-e3f2ee857fcd None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:45.194340 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 478/958] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 18:55:45.216717 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf1283-7d94-4874-9fdf-3498b980e651 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:45.219680 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3eb01-11b9-4a3e-bbc3-e3f2ee857fcd None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:45.253226 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61caa56a-e304-4813-8aab-15c45293aba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:45.254017 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61caa56a-e304-4813-8aab-15c45293aba6 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:45.254296 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61caa56a-e304-4813-8aab-15c45293aba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:45.254564 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61caa56a-e304-4813-8aab-15c45293aba6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:45.264981 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61caa56a-e304-4813-8aab-15c45293aba6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:55:45.273321 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-61caa56a-e304-4813-8aab-15c45293aba6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 18:55:45.273321 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:45.273321 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:45.273321 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:45.273321 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:45.273321 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:45.273321 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:45.273321 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:45.273321 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:45.273321 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:45.273321 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:45.273321 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:45.273321 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:55:45.273321 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:55:45.273321 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:55:45.273321 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:55:45.274284 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:55:45.274284 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:55:45.274284 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:55:45.274284 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:55:45.274284 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:45.274284 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:45.274284 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:45.274284 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:45.274284 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:45.274284 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:45.274284 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:45.274284 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:45.274284 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:45.274284 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:45.274284 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:45.274284 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:45.275116 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:45.275116 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:45.275116 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:45.275116 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:45.275116 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:55:45.275116 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:55:45.275116 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:55:45.275116 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:55:45.275116 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:55:45.275116 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:55:45.275116 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 18:55:45.275116 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:45.275116 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 481/959] 10.222.0.24 () {56 vars in 1120 bytes} [Mon May 16 18:55:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:55:45.281927 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61caa56a-e304-4813-8aab-15c45293aba6 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:45.315197 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf1283-7d94-4874-9fdf-3498b980e651 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:45.348561 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126f346-2d64-4e89-b05b-d26c48a72c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:45.349382 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126f346-2d64-4e89-b05b-d26c48a72c4c None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:45.349857 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126f346-2d64-4e89-b05b-d26c48a72c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:45.350196 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126f346-2d64-4e89-b05b-d26c48a72c4c None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:45.351033 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3126f346-2d64-4e89-b05b-d26c48a72c4c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:45.353069 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3126f346-2d64-4e89-b05b-d26c48a72c4c None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:45.373571 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 479/960] 10.222.0.24 () {60 vars in 1141 bytes} [Mon May 16 18:55:45 2022] POST /identity/v3/services => generated 242 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:55:45.391463 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61caa56a-e304-4813-8aab-15c45293aba6 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:45.436947 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41219f-676a-4225-a5af-29b022d6ef1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:45.437668 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41219f-676a-4225-a5af-29b022d6ef1d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:45.437956 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41219f-676a-4225-a5af-29b022d6ef1d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:45.438218 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41219f-676a-4225-a5af-29b022d6ef1d None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:45.438975 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41219f-676a-4225-a5af-29b022d6ef1d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:45.439279 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41219f-676a-4225-a5af-29b022d6ef1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:45.440681 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41219f-676a-4225-a5af-29b022d6ef1d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:45.452853 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 482/961] 10.222.0.24 () {56 vars in 1115 bytes} [Mon May 16 18:55:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:45.458615 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126f346-2d64-4e89-b05b-d26c48a72c4c None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:45.573870 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126f346-2d64-4e89-b05b-d26c48a72c4c None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:45.611151 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a8694-e9fe-46eb-9fc8-c5609d2e3242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:45.611975 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a8694-e9fe-46eb-9fc8-c5609d2e3242 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:45.612255 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a8694-e9fe-46eb-9fc8-c5609d2e3242 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:45.612527 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a8694-e9fe-46eb-9fc8-c5609d2e3242 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:45.623851 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a8694-e9fe-46eb-9fc8-c5609d2e3242 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:45.625321 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a8694-e9fe-46eb-9fc8-c5609d2e3242 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:45.643161 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-ca7a8694-e9fe-46eb-9fc8-c5609d2e3242 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:45.643161 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:45.643161 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:45.643161 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:45.643161 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:45.643161 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:45.643161 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:45.643161 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:45.643161 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:45.643161 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:45.643161 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:45.643161 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:45.643161 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:45.643161 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:45.643161 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:45.644106 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:45.644106 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:45.644106 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:45.644106 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:45.644106 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:45.644106 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:45.644106 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:45.644106 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:45.644106 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:45.644106 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:45.644106 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:45.644106 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:45.644106 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:45.644106 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:45.644106 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:45.644106 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:45.644106 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:45.644999 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:45.644999 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:45.644999 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:45.644999 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:45.644999 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 480/962] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:45.651323 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41219f-676a-4225-a5af-29b022d6ef1d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:45.737918 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f23e2-5157-4d62-89cb-034bcf947823 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:45.738219 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f23e2-5157-4d62-89cb-034bcf947823 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:45.738508 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f23e2-5157-4d62-89cb-034bcf947823 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:45.739998 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 481/963] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:55:45.745336 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251da778-2f1c-45a2-bab7-8b308b267c9d None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:45.745656 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251da778-2f1c-45a2-bab7-8b308b267c9d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:45.745928 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251da778-2f1c-45a2-bab7-8b308b267c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:45.752466 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41219f-676a-4225-a5af-29b022d6ef1d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:45.762439 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-251da778-2f1c-45a2-bab7-8b308b267c9d None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:45.763607 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-251da778-2f1c-45a2-bab7-8b308b267c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:45.799582 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6eb70-506d-478a-9ce3-83f976b7130e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:45.800674 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6eb70-506d-478a-9ce3-83f976b7130e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:45.801130 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6eb70-506d-478a-9ce3-83f976b7130e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:45.801768 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6eb70-506d-478a-9ce3-83f976b7130e None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:45.803509 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b6eb70-506d-478a-9ce3-83f976b7130e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:45.804080 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b6eb70-506d-478a-9ce3-83f976b7130e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:45.805732 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b6eb70-506d-478a-9ce3-83f976b7130e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:45.825367 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 483/964] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:45.826588 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6eb70-506d-478a-9ce3-83f976b7130e None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:45.845653 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 482/965] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:45 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 18:55:45.865844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251da778-2f1c-45a2-bab7-8b308b267c9d None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:45.944753 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6eb70-506d-478a-9ce3-83f976b7130e None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:45.968567 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251da778-2f1c-45a2-bab7-8b308b267c9d None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:45.985122 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde2eca-e692-4d92-b6e8-fdd7b95ce89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:45.986395 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde2eca-e692-4d92-b6e8-fdd7b95ce89e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:45.986900 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde2eca-e692-4d92-b6e8-fdd7b95ce89e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:45.987372 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde2eca-e692-4d92-b6e8-fdd7b95ce89e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:45.995997 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde2eca-e692-4d92-b6e8-fdd7b95ce89e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:45.997927 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde2eca-e692-4d92-b6e8-fdd7b95ce89e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:46.007731 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7a862-de23-440f-9b25-2c2059b66f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:46.008659 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7a862-de23-440f-9b25-2c2059b66f07 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:46.008936 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7a862-de23-440f-9b25-2c2059b66f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:46.009247 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7a862-de23-440f-9b25-2c2059b66f07 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:46.010087 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a7a862-de23-440f-9b25-2c2059b66f07 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:46.011534 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a7a862-de23-440f-9b25-2c2059b66f07 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:46.018150 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-5cde2eca-e692-4d92-b6e8-fdd7b95ce89e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 18:55:46.018150 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:46.018150 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:46.018150 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:46.018150 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:46.018150 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:46.018150 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:46.018150 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:46.018150 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:46.018150 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:46.018150 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:46.018150 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:46.018150 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:55:46.018150 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:55:46.018150 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:55:46.018150 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:55:46.019458 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:46.019458 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:46.019458 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:55:46.019458 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:46.019458 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:55:46.019458 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:46.019458 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:46.019458 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:46.019458 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:46.019458 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:46.019458 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:46.019458 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:46.019458 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:46.019458 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:46.019458 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:46.019458 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:46.019458 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:46.019458 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:46.020402 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:46.020402 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:46.020402 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:55:46.020402 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:55:46.020402 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:55:46.020402 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:55:46.020402 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:55:46.020402 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:55:46.020402 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 18:55:46.020402 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:46.027871 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-95a7a862-de23-440f-9b25-2c2059b66f07 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 18:55:46.027871 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:46.027871 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:55:46.027871 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:55:46.027871 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:55:46.027871 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:55:46.027871 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:55:46.027871 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:46.027871 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 18:55:46.027871 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:46.027871 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:55:46.027871 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:46.027871 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:46.027871 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:46.027871 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:46.027871 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:46.027871 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:46.028890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:46.028890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:46.028890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:46.028890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:46.028890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:46.028890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:46.028890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:55:46.028890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:55:46.028890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:55:46.028890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:55:46.028890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:46.028890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:46.028890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:46.028890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:46.028890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:46.028890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:46.029743 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:46.029743 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:46.029743 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:46.029743 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:46.029743 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:46.029743 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:46.029743 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:46.029743 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:46.029743 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:46.029743 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:46.029743 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:55:46.029743 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:46.029743 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 18:55:46.029743 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:46.031030 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 484/967] 10.222.0.24 () {56 vars in 1117 bytes} [Mon May 16 18:55:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:46.031434 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 483/967] 10.222.0.24 () {56 vars in 1126 bytes} [Mon May 16 18:55:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:55:46.032423 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde2eca-e692-4d92-b6e8-fdd7b95ce89e None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:46.032630 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7a862-de23-440f-9b25-2c2059b66f07 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:46.130700 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7a862-de23-440f-9b25-2c2059b66f07 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:46.133781 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde2eca-e692-4d92-b6e8-fdd7b95ce89e None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:46.168900 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29edcf2-0c3e-4476-8846-f3afe939062c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:46.169603 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29edcf2-0c3e-4476-8846-f3afe939062c None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:46.169936 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29edcf2-0c3e-4476-8846-f3afe939062c None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:46.170213 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29edcf2-0c3e-4476-8846-f3afe939062c None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:46.170927 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29edcf2-0c3e-4476-8846-f3afe939062c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:46.171233 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29edcf2-0c3e-4476-8846-f3afe939062c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:46.172626 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29edcf2-0c3e-4476-8846-f3afe939062c None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:46.177023 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cca189-c8d3-4d0b-bc1c-adaf919cc1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:46.177999 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cca189-c8d3-4d0b-bc1c-adaf919cc1b2 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:46.178492 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cca189-c8d3-4d0b-bc1c-adaf919cc1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:46.178986 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cca189-c8d3-4d0b-bc1c-adaf919cc1b2 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:46.180037 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cca189-c8d3-4d0b-bc1c-adaf919cc1b2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:46.180556 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cca189-c8d3-4d0b-bc1c-adaf919cc1b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:46.182242 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cca189-c8d3-4d0b-bc1c-adaf919cc1b2 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:46.182350 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 484/968] 10.222.0.24 () {56 vars in 1122 bytes} [Mon May 16 18:55:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:46.183560 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29edcf2-0c3e-4476-8846-f3afe939062c None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:46.201000 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 485/969] 10.222.0.24 () {56 vars in 1149 bytes} [Mon May 16 18:55:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:46.202452 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81daf31-b9b8-4495-95fe-9350e2d01539 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:46.202739 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81daf31-b9b8-4495-95fe-9350e2d01539 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:46.203008 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81daf31-b9b8-4495-95fe-9350e2d01539 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:46.204379 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 486/970] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:46.209041 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81daf31-b9b8-4495-95fe-9350e2d01539 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:46.293382 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29edcf2-0c3e-4476-8846-f3afe939062c None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:46.310533 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81daf31-b9b8-4495-95fe-9350e2d01539 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:46.328088 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb5e884-8a0b-42a1-aa6f-5bd8f78b061f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:46.328757 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5e884-8a0b-42a1-aa6f-5bd8f78b061f None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:46.329044 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5e884-8a0b-42a1-aa6f-5bd8f78b061f None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:46.329327 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5e884-8a0b-42a1-aa6f-5bd8f78b061f None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:46.330056 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb5e884-8a0b-42a1-aa6f-5bd8f78b061f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:46.330361 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb5e884-8a0b-42a1-aa6f-5bd8f78b061f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:46.331741 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb5e884-8a0b-42a1-aa6f-5bd8f78b061f None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:46.341132 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 485/971] 10.222.0.24 () {56 vars in 1122 bytes} [Mon May 16 18:55:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:55:46.341132 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b5f84-0723-4b4a-a32b-a4ace79db88d None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:46.341132 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b5f84-0723-4b4a-a32b-a4ace79db88d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:46.341132 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b5f84-0723-4b4a-a32b-a4ace79db88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:46.349117 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab38b6-c910-4fb3-943e-8e6a26b704ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:46.349805 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab38b6-c910-4fb3-943e-8e6a26b704ec None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:46.350088 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab38b6-c910-4fb3-943e-8e6a26b704ec None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:46.350355 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab38b6-c910-4fb3-943e-8e6a26b704ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:46.355667 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-bc7b5f84-0723-4b4a-a32b-a4ace79db88d None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:46.356823 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-bc7b5f84-0723-4b4a-a32b-a4ace79db88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:46.414624 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab38b6-c910-4fb3-943e-8e6a26b704ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:46.416815 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab38b6-c910-4fb3-943e-8e6a26b704ec None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:46.425678 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 486/972] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:46 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:55:46.425678 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b5f84-0723-4b4a-a32b-a4ace79db88d None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:46.514973 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b5f84-0723-4b4a-a32b-a4ace79db88d None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:46.518435 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 487/973] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:55:46 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 18:55:46.524330 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab38b6-c910-4fb3-943e-8e6a26b704ec None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:46.549456 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56d337-7159-4aa7-8340-74fc27568aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:46.550143 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56d337-7159-4aa7-8340-74fc27568aa4 None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:46.550420 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56d337-7159-4aa7-8340-74fc27568aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:46.550690 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56d337-7159-4aa7-8340-74fc27568aa4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:46.551425 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56d337-7159-4aa7-8340-74fc27568aa4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:46.552789 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56d337-7159-4aa7-8340-74fc27568aa4 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:46.581936 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 487/974] 10.222.0.24 () {60 vars in 1144 bytes} [Mon May 16 18:55:46 2022] POST /identity/v3/endpoints => generated 349 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:55:46.582868 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56d337-7159-4aa7-8340-74fc27568aa4 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:46.634922 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab38b6-c910-4fb3-943e-8e6a26b704ec None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:46.702923 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7a8d7-ee4c-4615-b821-7a02d0ac038a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:46.704003 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7a8d7-ee4c-4615-b821-7a02d0ac038a None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:46.704482 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7a8d7-ee4c-4615-b821-7a02d0ac038a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:46.704952 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7a8d7-ee4c-4615-b821-7a02d0ac038a None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:46.706223 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b7a8d7-ee4c-4615-b821-7a02d0ac038a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:46.708862 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b7a8d7-ee4c-4615-b821-7a02d0ac038a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:46.730623 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56d337-7159-4aa7-8340-74fc27568aa4 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:46.732710 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.sql.core [None req-25b7a8d7-ee4c-4615-b821-7a02d0ac038a None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 16 18:55:46.732710 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 16 18:55:46.732710 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [parameters: {'user_id': '2212a3ff309d4581ac777416739a9b41', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 16 18:55:46.732710 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80021) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 16 18:55:46.748566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-25b7a8d7-ee4c-4615-b821-7a02d0ac038a None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 16 18:55:46.748566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:46.748566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 18:55:46.748566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 18:55:46.748566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 18:55:46.748566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 18:55:46.748566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 18:55:46.748566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application result = self._query(query) May 16 18:55:46.748566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 18:55:46.748566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application conn.query(q) May 16 18:55:46.748566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 18:55:46.748566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 18:55:46.748566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 18:55:46.748566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application result.read() May 16 18:55:46.748566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 18:55:46.753573 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 18:55:46.753573 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 18:55:46.753573 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 18:55:46.753573 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 18:55:46.753573 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 18:55:46.753573 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 18:55:46.753573 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 18:55:46.753573 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 16 18:55:46.753573 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:46.753573 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 16 18:55:46.753573 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:46.753573 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:46.753573 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 16 18:55:46.753573 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 16 18:55:46.753573 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 16 18:55:46.753573 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 16 18:55:46.753573 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 18:55:46.753573 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application next(self.gen) May 16 18:55:46.755498 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 16 18:55:46.755498 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application yield resource May 16 18:55:46.755498 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 18:55:46.755498 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application next(self.gen) May 16 18:55:46.755498 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 16 18:55:46.755498 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self.session.rollback() May 16 18:55:46.755498 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 16 18:55:46.755498 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self.force_reraise() May 16 18:55:46.755498 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 16 18:55:46.755498 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise self.value May 16 18:55:46.755498 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 16 18:55:46.755498 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 16 18:55:46.755498 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 16 18:55:46.755498 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application session.commit() May 16 18:55:46.755498 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 16 18:55:46.755498 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 16 18:55:46.755498 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 16 18:55:46.757319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._prepare_impl() May 16 18:55:46.757319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 16 18:55:46.757319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self.session.flush() May 16 18:55:46.757319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 16 18:55:46.757319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._flush(objects) May 16 18:55:46.757319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 16 18:55:46.757319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 16 18:55:46.757319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 16 18:55:46.757319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application compat.raise_( May 16 18:55:46.757319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 18:55:46.757319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception May 16 18:55:46.757319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 16 18:55:46.757319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application flush_context.execute() May 16 18:55:46.757319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 16 18:55:46.757319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rec.execute(self) May 16 18:55:46.757319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 16 18:55:46.757319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 16 18:55:46.760408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 16 18:55:46.760408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application _emit_insert_statements( May 16 18:55:46.760408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 16 18:55:46.760408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application result = connection._execute_20( May 16 18:55:46.760408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 16 18:55:46.760408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 16 18:55:46.760408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 16 18:55:46.760408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 16 18:55:46.760408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 16 18:55:46.760408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ret = self._execute_context( May 16 18:55:46.760408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 16 18:55:46.760408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 16 18:55:46.760408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 16 18:55:46.760408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 16 18:55:46.760408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 18:55:46.760408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception May 16 18:55:46.762417 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 18:55:46.762417 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 18:55:46.762417 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 18:55:46.762417 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 18:55:46.762417 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 18:55:46.762417 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application result = self._query(query) May 16 18:55:46.762417 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 18:55:46.762417 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application conn.query(q) May 16 18:55:46.762417 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 18:55:46.762417 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 18:55:46.762417 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 18:55:46.762417 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application result.read() May 16 18:55:46.762417 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 18:55:46.762417 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 18:55:46.762417 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 18:55:46.762417 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 18:55:46.764343 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 18:55:46.764343 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 18:55:46.764343 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 18:55:46.764343 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 18:55:46.764343 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 16 18:55:46.764343 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 16 18:55:46.764343 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [parameters: {'user_id': '2212a3ff309d4581ac777416739a9b41', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 16 18:55:46.764343 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 16 18:55:46.764343 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:46.764343 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:55:46.764343 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:46.764343 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:46.764343 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:46.764343 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:46.764343 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:46.768161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:46.768161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:46.768161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:46.768161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:46.768161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:46.768161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:46.768161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:46.768161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 16 18:55:46.768161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 16 18:55:46.768161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:46.768161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:46.768161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:55:46.768161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:46.768161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:55:46.768161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:46.768161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 16 18:55:46.768161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 16 18:55:46.770293 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 16 18:55:46.770293 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 16 18:55:46.770293 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 16 18:55:46.770293 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 16 18:55:46.770293 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 16 18:55:46.770293 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:46.770293 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 488/975] 10.222.0.24 () {60 vars in 1131 bytes} [Mon May 16 18:55:46 2022] POST /identity/v3/users => generated 160 bytes in 234 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:46.770293 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7a8d7-ee4c-4615-b821-7a02d0ac038a None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:46.810689 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0cf4d-5cd0-4d6b-9ccc-5ada2cd9be3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:46.811948 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0cf4d-5cd0-4d6b-9ccc-5ada2cd9be3f None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:46.812719 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0cf4d-5cd0-4d6b-9ccc-5ada2cd9be3f None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:46.813390 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0cf4d-5cd0-4d6b-9ccc-5ada2cd9be3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:46.828306 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0cf4d-5cd0-4d6b-9ccc-5ada2cd9be3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:46.830055 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0cf4d-5cd0-4d6b-9ccc-5ada2cd9be3f None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:46.848126 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-38c0cf4d-5cd0-4d6b-9ccc-5ada2cd9be3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:46.848126 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:46.848126 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:46.848126 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:46.848126 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:46.848126 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:46.848126 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:46.848126 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:46.848126 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:46.848126 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:46.848126 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:46.848126 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:46.848126 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:46.848126 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:46.848126 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:46.849074 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:46.849074 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:46.849074 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:46.849074 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:46.849074 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:46.849074 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:46.849074 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:46.849074 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:46.849074 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:46.849074 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:46.849074 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:46.849074 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:46.849074 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:46.849074 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:46.849074 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:46.849074 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:46.849074 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:46.850059 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:46.850059 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:46.850059 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:46.850059 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:46.851956 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 488/976] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:46.858579 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0cf4d-5cd0-4d6b-9ccc-5ada2cd9be3f None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:46.891367 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7a8d7-ee4c-4615-b821-7a02d0ac038a None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:46.926904 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2254a-9f6b-41c4-ad74-164ba005b8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:46.927751 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2254a-9f6b-41c4-ad74-164ba005b8c8 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:46.928030 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2254a-9f6b-41c4-ad74-164ba005b8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:46.928302 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2254a-9f6b-41c4-ad74-164ba005b8c8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:46.937118 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde2254a-9f6b-41c4-ad74-164ba005b8c8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:46.939018 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde2254a-9f6b-41c4-ad74-164ba005b8c8 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:46.954101 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-bde2254a-9f6b-41c4-ad74-164ba005b8c8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 16 18:55:46.954101 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:46.954101 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:46.954101 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:46.954101 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:46.954101 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:46.954101 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:46.954101 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:46.954101 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:46.954101 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:46.954101 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:46.954101 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:46.954101 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:55:46.954101 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:55:46.954101 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:55:46.954101 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:55:46.955058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:46.955058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:46.955058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:55:46.955058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:46.955058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:55:46.955058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:46.955058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:46.955058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:46.955058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:46.955058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:46.955058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:46.955058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:46.955058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:46.955058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:46.955058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:46.955058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:46.955058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:46.955058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:46.956003 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:46.956003 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:46.956003 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:55:46.956003 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:55:46.956003 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:55:46.956003 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:55:46.956003 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:55:46.956003 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:55:46.956003 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 16 18:55:46.956003 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:46.960144 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 489/977] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:55:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:55:46.961180 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2254a-9f6b-41c4-ad74-164ba005b8c8 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:46.982731 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0cf4d-5cd0-4d6b-9ccc-5ada2cd9be3f None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:47.024717 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717512c-a9dc-4e0c-893c-94612df0ea57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:47.026345 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717512c-a9dc-4e0c-893c-94612df0ea57 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:47.026806 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717512c-a9dc-4e0c-893c-94612df0ea57 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:47.027228 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717512c-a9dc-4e0c-893c-94612df0ea57 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:47.028098 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9717512c-a9dc-4e0c-893c-94612df0ea57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:47.028720 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9717512c-a9dc-4e0c-893c-94612df0ea57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:47.030932 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9717512c-a9dc-4e0c-893c-94612df0ea57 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:47.050232 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 489/978] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:47.055781 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717512c-a9dc-4e0c-893c-94612df0ea57 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:47.071644 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2254a-9f6b-41c4-ad74-164ba005b8c8 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:47.107007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa7757-d15c-4db7-91d1-c1974ab80b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:47.108086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa7757-d15c-4db7-91d1-c1974ab80b46 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:47.108583 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa7757-d15c-4db7-91d1-c1974ab80b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:47.109054 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa7757-d15c-4db7-91d1-c1974ab80b46 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:47.110273 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa7757-d15c-4db7-91d1-c1974ab80b46 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:47.110797 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa7757-d15c-4db7-91d1-c1974ab80b46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:47.112450 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa7757-d15c-4db7-91d1-c1974ab80b46 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:47.157599 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717512c-a9dc-4e0c-893c-94612df0ea57 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:47.162062 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 490/979] 10.222.0.24 () {56 vars in 1101 bytes} [Mon May 16 18:55:46 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:55:47.195055 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6251fc-6135-467a-99d4-eb3e7c61a163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:47.195897 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6251fc-6135-467a-99d4-eb3e7c61a163 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:47.196170 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6251fc-6135-467a-99d4-eb3e7c61a163 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:47.196446 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6251fc-6135-467a-99d4-eb3e7c61a163 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:47.204561 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6251fc-6135-467a-99d4-eb3e7c61a163 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:47.206008 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6251fc-6135-467a-99d4-eb3e7c61a163 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:47.221024 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-4a6251fc-6135-467a-99d4-eb3e7c61a163 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:47.221024 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:47.221024 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:47.221024 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:47.221024 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:47.221024 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:47.221024 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:47.221024 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:47.221024 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:47.221024 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:47.221024 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:47.221024 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:47.221024 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:55:47.221024 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:55:47.221024 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:55:47.222114 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:55:47.222114 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:47.222114 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:47.222114 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:47.222114 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:47.222114 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:47.222114 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:47.222114 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:47.222114 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:47.222114 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:47.222114 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:47.222114 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:47.222114 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:47.222114 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:47.222114 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:47.222114 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:47.222114 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:47.223005 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:55:47.223005 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:55:47.223005 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:55:47.223005 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:55:47.223005 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:55:47.223005 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:55:47.223005 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:47.223005 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:47.223005 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 490/980] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:55:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:47.228442 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa7757-d15c-4db7-91d1-c1974ab80b46 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:47.341223 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa7757-d15c-4db7-91d1-c1974ab80b46 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:47.376803 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1c9a4-6a36-4ed1-ba4d-898f85d300c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:47.377490 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1c9a4-6a36-4ed1-ba4d-898f85d300c1 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:47.377803 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1c9a4-6a36-4ed1-ba4d-898f85d300c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:47.378080 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1c9a4-6a36-4ed1-ba4d-898f85d300c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:47.378879 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1c9a4-6a36-4ed1-ba4d-898f85d300c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:47.379190 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1c9a4-6a36-4ed1-ba4d-898f85d300c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:47.380652 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1c9a4-6a36-4ed1-ba4d-898f85d300c1 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:47.393021 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 491/981] 10.222.0.24 () {56 vars in 1148 bytes} [Mon May 16 18:55:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:47.399183 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6251fc-6135-467a-99d4-eb3e7c61a163 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:47.503170 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6251fc-6135-467a-99d4-eb3e7c61a163 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:47.538693 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145df1b-8c38-4e03-80d1-7b6462e363d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:47.539794 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145df1b-8c38-4e03-80d1-7b6462e363d9 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:47.540350 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145df1b-8c38-4e03-80d1-7b6462e363d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:47.540825 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145df1b-8c38-4e03-80d1-7b6462e363d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:47.541937 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145df1b-8c38-4e03-80d1-7b6462e363d9 None admin] RBAC: Adding query filter params (role.id=1abd30a5bbfb45a1ab6de390e19a6c70, scope.project.id=084e70bbad784892b195bb11a68bf857, user.id=4775e9dd7aea448d95ec7378b4ff3124) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:47.542514 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145df1b-8c38-4e03-80d1-7b6462e363d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:47.544208 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145df1b-8c38-4e03-80d1-7b6462e363d9 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:47.551244 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 491/982] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:55:47 2022] GET /identity/v3/role_assignments?user.id=4775e9dd7aea448d95ec7378b4ff3124&scope.project.id=084e70bbad784892b195bb11a68bf857&role.id=1abd30a5bbfb45a1ab6de390e19a6c70 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:47.712893 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9e0b4-febf-4d8a-a63b-948e400ed5ec None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:47.713356 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9e0b4-febf-4d8a-a63b-948e400ed5ec None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:47.713667 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9e0b4-febf-4d8a-a63b-948e400ed5ec None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:47.715114 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 492/983] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:47.721037 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a17505-836c-4591-b593-ac2a05aac3e9 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:47.721381 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a17505-836c-4591-b593-ac2a05aac3e9 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:47.721648 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a17505-836c-4591-b593-ac2a05aac3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:47.739617 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-47a17505-836c-4591-b593-ac2a05aac3e9 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:47.740825 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-47a17505-836c-4591-b593-ac2a05aac3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:47.811194 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 492/984] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:47 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:55:47.833213 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9e0b4-febf-4d8a-a63b-948e400ed5ec None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:47.938523 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9e0b4-febf-4d8a-a63b-948e400ed5ec None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:47.972285 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3ca80-c236-4430-ad7a-fe9099a7725c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:47.973077 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3ca80-c236-4430-ad7a-fe9099a7725c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:47.973353 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3ca80-c236-4430-ad7a-fe9099a7725c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:47.973661 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3ca80-c236-4430-ad7a-fe9099a7725c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:47.974311 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3ca80-c236-4430-ad7a-fe9099a7725c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:47.975762 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3ca80-c236-4430-ad7a-fe9099a7725c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:47.987268 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-b5b3ca80-c236-4430-ad7a-fe9099a7725c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 16 18:55:47.987268 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:47.987268 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:55:47.987268 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:55:47.987268 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:55:47.987268 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:55:47.987268 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:55:47.987268 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:47.987268 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 18:55:47.987268 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:47.987268 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:55:47.987268 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:47.987268 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:47.987268 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:47.987268 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:47.987268 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:47.987268 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:47.988293 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:47.988293 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:47.988293 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:47.988293 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:47.988293 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:47.988293 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:47.988293 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:55:47.988293 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:55:47.988293 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:55:47.988293 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:55:47.988293 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:47.988293 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:47.988293 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:47.988293 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:47.988293 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:47.988293 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:47.989148 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:47.989148 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:47.989148 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:47.989148 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:47.989148 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:47.989148 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:47.989148 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:47.989148 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:47.989148 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:47.989148 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:47.989148 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:55:47.989148 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:47.989148 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 18:55:47.989148 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:47.990867 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 493/985] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:55:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:47.994913 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a17505-836c-4591-b593-ac2a05aac3e9 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:48.091429 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a17505-836c-4591-b593-ac2a05aac3e9 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:48.127548 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b15ab-37b4-404b-8632-86b6cd5a8910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:48.128231 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b15ab-37b4-404b-8632-86b6cd5a8910 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:48.128514 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b15ab-37b4-404b-8632-86b6cd5a8910 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:48.128786 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b15ab-37b4-404b-8632-86b6cd5a8910 None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:48.129508 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b15ab-37b4-404b-8632-86b6cd5a8910 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:48.129839 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b15ab-37b4-404b-8632-86b6cd5a8910 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:48.131218 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b15ab-37b4-404b-8632-86b6cd5a8910 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:48.136104 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 493/986] 10.222.0.24 () {56 vars in 1112 bytes} [Mon May 16 18:55:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:48.141609 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3ca80-c236-4430-ad7a-fe9099a7725c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:48.239775 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3ca80-c236-4430-ad7a-fe9099a7725c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:48.272651 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06e60a-5c84-4ee1-98a7-12c54c9afbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:48.273339 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06e60a-5c84-4ee1-98a7-12c54c9afbf9 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:48.273649 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06e60a-5c84-4ee1-98a7-12c54c9afbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:48.273946 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06e60a-5c84-4ee1-98a7-12c54c9afbf9 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:48.274656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06e60a-5c84-4ee1-98a7-12c54c9afbf9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:48.274958 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06e60a-5c84-4ee1-98a7-12c54c9afbf9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:48.276345 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06e60a-5c84-4ee1-98a7-12c54c9afbf9 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:48.281485 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 494/987] 10.222.0.24 () {56 vars in 1112 bytes} [Mon May 16 18:55:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:48.287593 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b15ab-37b4-404b-8632-86b6cd5a8910 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:48.385367 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b15ab-37b4-404b-8632-86b6cd5a8910 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:48.420401 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77f58e-d98e-458a-ab08-f9406a6d0a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:48.421059 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77f58e-d98e-458a-ab08-f9406a6d0a3a None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:48.421331 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77f58e-d98e-458a-ab08-f9406a6d0a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:48.421628 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77f58e-d98e-458a-ab08-f9406a6d0a3a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:48.422413 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc77f58e-d98e-458a-ab08-f9406a6d0a3a None admin] RBAC: Adding query filter params (interface=public, service_id=1efdbecbeec74d29aa5f729ff96fb4c3, region_id=RegionOne) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:48.422720 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc77f58e-d98e-458a-ab08-f9406a6d0a3a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:48.424099 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc77f58e-d98e-458a-ab08-f9406a6d0a3a None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:48.429313 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 494/988] 10.222.0.24 () {56 vars in 1251 bytes} [Mon May 16 18:55:48 2022] GET /identity/v3/endpoints?service_id=1efdbecbeec74d29aa5f729ff96fb4c3&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:48.434767 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06e60a-5c84-4ee1-98a7-12c54c9afbf9 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:48.532182 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06e60a-5c84-4ee1-98a7-12c54c9afbf9 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:48.567975 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a2aa2-c0d6-4e66-b9b2-76a5cfe095c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:48.568640 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a2aa2-c0d6-4e66-b9b2-76a5cfe095c9 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:48.568897 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a2aa2-c0d6-4e66-b9b2-76a5cfe095c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:48.569169 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a2aa2-c0d6-4e66-b9b2-76a5cfe095c9 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:48.569927 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a2aa2-c0d6-4e66-b9b2-76a5cfe095c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:48.571299 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a2aa2-c0d6-4e66-b9b2-76a5cfe095c9 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:48.577987 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 495/989] 10.222.0.24 () {56 vars in 1087 bytes} [Mon May 16 18:55:48 2022] GET /identity/v3/services => generated 1727 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 18:55:48.853830 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc28daa-f263-4cfb-9876-735fe58d83e8 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:48.854114 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc28daa-f263-4cfb-9876-735fe58d83e8 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:48.854386 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc28daa-f263-4cfb-9876-735fe58d83e8 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:48.855761 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 495/990] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:48.861216 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8042a-5697-42bf-a8ad-9dcb53e2da26 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:48.861501 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8042a-5697-42bf-a8ad-9dcb53e2da26 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:48.861801 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8042a-5697-42bf-a8ad-9dcb53e2da26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:48.878811 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-93d8042a-5697-42bf-a8ad-9dcb53e2da26 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:48.880320 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-93d8042a-5697-42bf-a8ad-9dcb53e2da26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:48.947598 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 496/991] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:55:48.969523 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc28daa-f263-4cfb-9876-735fe58d83e8 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:49.068323 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc28daa-f263-4cfb-9876-735fe58d83e8 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:49.101349 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016187f-e367-4f8b-89c8-ace46206d606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:49.102207 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016187f-e367-4f8b-89c8-ace46206d606 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:49.102482 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016187f-e367-4f8b-89c8-ace46206d606 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:49.102746 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016187f-e367-4f8b-89c8-ace46206d606 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:49.103389 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a016187f-e367-4f8b-89c8-ace46206d606 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:49.104817 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a016187f-e367-4f8b-89c8-ace46206d606 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:49.121583 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-a016187f-e367-4f8b-89c8-ace46206d606 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 18:55:49.121583 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:49.121583 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:55:49.121583 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:55:49.121583 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:55:49.121583 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:55:49.121583 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:55:49.121583 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:49.121583 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 18:55:49.121583 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:49.121583 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:55:49.121583 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:49.121583 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:49.121583 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:49.121583 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:49.121583 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:49.121583 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:49.122635 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:49.122635 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:49.122635 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:49.122635 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:49.122635 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:49.122635 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:49.122635 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:55:49.122635 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:55:49.122635 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:55:49.122635 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:55:49.122635 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:49.122635 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:49.122635 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:49.122635 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:49.122635 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:49.122635 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:49.124686 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:49.124686 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:49.124686 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:49.124686 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:49.124686 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:49.124686 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:49.124686 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:49.124686 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:49.124686 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:49.124686 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:49.124686 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:55:49.124686 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:49.124686 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 18:55:49.124686 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:49.124686 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 496/992] 10.222.0.24 () {56 vars in 1126 bytes} [Mon May 16 18:55:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:49.126253 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8042a-5697-42bf-a8ad-9dcb53e2da26 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:49.219779 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8042a-5697-42bf-a8ad-9dcb53e2da26 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:49.253051 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1bb060-ec86-45f3-9494-3fe0863c1cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:49.253743 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1bb060-ec86-45f3-9494-3fe0863c1cca None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:49.254020 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1bb060-ec86-45f3-9494-3fe0863c1cca None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:49.254288 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1bb060-ec86-45f3-9494-3fe0863c1cca None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:49.254989 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1bb060-ec86-45f3-9494-3fe0863c1cca None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:49.255287 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1bb060-ec86-45f3-9494-3fe0863c1cca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:49.256714 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1bb060-ec86-45f3-9494-3fe0863c1cca None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:49.261749 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 497/993] 10.222.0.24 () {56 vars in 1122 bytes} [Mon May 16 18:55:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:49.267307 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016187f-e367-4f8b-89c8-ace46206d606 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:49.363591 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016187f-e367-4f8b-89c8-ace46206d606 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:49.395417 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70af32-7517-4ab1-bd6d-98f90f356917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:49.396090 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70af32-7517-4ab1-bd6d-98f90f356917 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:49.396363 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70af32-7517-4ab1-bd6d-98f90f356917 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:49.396628 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70af32-7517-4ab1-bd6d-98f90f356917 None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:49.397357 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70af32-7517-4ab1-bd6d-98f90f356917 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:49.397691 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70af32-7517-4ab1-bd6d-98f90f356917 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:49.399064 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70af32-7517-4ab1-bd6d-98f90f356917 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:49.404013 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 497/994] 10.222.0.24 () {56 vars in 1122 bytes} [Mon May 16 18:55:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:49.409689 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1bb060-ec86-45f3-9494-3fe0863c1cca None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:49.503253 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1bb060-ec86-45f3-9494-3fe0863c1cca None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:49.536503 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab0c0a9-fb15-4b8b-baf9-114be626b249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:49.537956 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0c0a9-fb15-4b8b-baf9-114be626b249 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:49.538243 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0c0a9-fb15-4b8b-baf9-114be626b249 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:49.538568 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0c0a9-fb15-4b8b-baf9-114be626b249 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:49.539367 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab0c0a9-fb15-4b8b-baf9-114be626b249 None admin] RBAC: Adding query filter params (interface=admin, service_id=e3dd555ccd4f4b6c8dca40a2887c2113, region_id=RegionOne) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:49.539729 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab0c0a9-fb15-4b8b-baf9-114be626b249 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:49.541152 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab0c0a9-fb15-4b8b-baf9-114be626b249 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:49.546399 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 498/995] 10.222.0.24 () {56 vars in 1249 bytes} [Mon May 16 18:55:49 2022] GET /identity/v3/endpoints?service_id=e3dd555ccd4f4b6c8dca40a2887c2113&interface=admin®ion_id=RegionOne => generated 193 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:49.551834 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70af32-7517-4ab1-bd6d-98f90f356917 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:49.657345 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70af32-7517-4ab1-bd6d-98f90f356917 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:49.694425 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c243457-10ce-480f-9c2e-d4a5352546dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:49.695275 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c243457-10ce-480f-9c2e-d4a5352546dc None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:49.695650 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c243457-10ce-480f-9c2e-d4a5352546dc None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:49.696009 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c243457-10ce-480f-9c2e-d4a5352546dc None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:49.696814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c243457-10ce-480f-9c2e-d4a5352546dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:49.698406 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c243457-10ce-480f-9c2e-d4a5352546dc None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:49.705766 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 498/996] 10.222.0.24 () {56 vars in 1087 bytes} [Mon May 16 18:55:49 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:55:49.843213 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5baaf0-69e3-4cc3-8bee-bd81b1184d7a None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:49.843471 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5baaf0-69e3-4cc3-8bee-bd81b1184d7a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:49.843764 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5baaf0-69e3-4cc3-8bee-bd81b1184d7a None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:49.845408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 499/997] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:49.851282 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f839f-537b-491c-8d18-d63d0232bd2c None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:49.851599 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f839f-537b-491c-8d18-d63d0232bd2c None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:49.851841 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f839f-537b-491c-8d18-d63d0232bd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:49.869746 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-fe2f839f-537b-491c-8d18-d63d0232bd2c None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:49.870968 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-fe2f839f-537b-491c-8d18-d63d0232bd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:49.940514 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 499/998] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:49 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:55:49.980587 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5baaf0-69e3-4cc3-8bee-bd81b1184d7a None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:50.080723 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5baaf0-69e3-4cc3-8bee-bd81b1184d7a None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:50.114591 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10add5d-7b49-4721-ac40-0e9689f73082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:50.115452 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10add5d-7b49-4721-ac40-0e9689f73082 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:50.119149 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10add5d-7b49-4721-ac40-0e9689f73082 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:50.119149 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10add5d-7b49-4721-ac40-0e9689f73082 None admin] PATH_INFO: `/v3/services/image` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:50.119149 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10add5d-7b49-4721-ac40-0e9689f73082 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:50.119149 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10add5d-7b49-4721-ac40-0e9689f73082 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:50.132861 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-f10add5d-7b49-4721-ac40-0e9689f73082 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 16 18:55:50.132861 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:50.132861 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:55:50.132861 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:55:50.132861 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:55:50.132861 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:55:50.132861 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:55:50.132861 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:50.132861 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 18:55:50.132861 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:50.132861 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:55:50.132861 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:50.132861 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:50.132861 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:50.132861 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:50.132861 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:50.132861 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:50.134129 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:50.134129 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:50.134129 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:50.134129 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:50.134129 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:50.134129 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:50.134129 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:55:50.134129 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:55:50.134129 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:55:50.134129 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:55:50.134129 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:50.134129 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:50.134129 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:50.134129 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:50.134129 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:50.134129 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:50.135075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:50.135075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:50.135075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:50.135075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:50.135075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:50.135075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:50.135075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:50.135075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:50.135075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:50.135075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:50.135075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:55:50.135075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:50.135075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 18:55:50.135075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:50.137649 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 500/999] 10.222.0.24 () {56 vars in 1105 bytes} [Mon May 16 18:55:49 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:50.140341 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f839f-537b-491c-8d18-d63d0232bd2c None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:50.240183 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f839f-537b-491c-8d18-d63d0232bd2c None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:50.272027 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d79ed-cda3-404c-974a-50b6b1a3d6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:50.272835 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d79ed-cda3-404c-974a-50b6b1a3d6dd None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:50.273112 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d79ed-cda3-404c-974a-50b6b1a3d6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:50.273380 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d79ed-cda3-404c-974a-50b6b1a3d6dd None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:50.274118 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d79ed-cda3-404c-974a-50b6b1a3d6dd None admin] RBAC: Adding query filter params (name=image) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:50.274422 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d79ed-cda3-404c-974a-50b6b1a3d6dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:50.275800 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d79ed-cda3-404c-974a-50b6b1a3d6dd None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:50.285082 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 500/1000] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:50.286682 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10add5d-7b49-4721-ac40-0e9689f73082 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:50.387663 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10add5d-7b49-4721-ac40-0e9689f73082 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:50.421545 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4437a-bd92-4ea1-a6a4-6d84d3836a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:50.422371 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4437a-bd92-4ea1-a6a4-6d84d3836a46 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:50.422744 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4437a-bd92-4ea1-a6a4-6d84d3836a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:50.423100 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4437a-bd92-4ea1-a6a4-6d84d3836a46 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:50.423896 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4437a-bd92-4ea1-a6a4-6d84d3836a46 None admin] RBAC: Adding query filter params (type=image) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:50.424292 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4437a-bd92-4ea1-a6a4-6d84d3836a46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:50.425794 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4437a-bd92-4ea1-a6a4-6d84d3836a46 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:50.430633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 501/1001] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:50 2022] GET /identity/v3/services?type=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:50.809954 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a5236-20e7-481d-842f-8151d09c52ec None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:50.810214 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a5236-20e7-481d-842f-8151d09c52ec None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:50.810507 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a5236-20e7-481d-842f-8151d09c52ec None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:50.811888 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 501/1002] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:50.818228 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79961a1-421d-455d-a1af-d3ae452e86fb None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:50.818664 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79961a1-421d-455d-a1af-d3ae452e86fb None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:50.819043 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79961a1-421d-455d-a1af-d3ae452e86fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:50.836558 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-b79961a1-421d-455d-a1af-d3ae452e86fb None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:50.837918 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b79961a1-421d-455d-a1af-d3ae452e86fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:50.902437 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 502/1003] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:50 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:55:50.925493 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a5236-20e7-481d-842f-8151d09c52ec None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:51.026313 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a5236-20e7-481d-842f-8151d09c52ec None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:51.060763 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4d15a-469c-4867-9689-e29289145a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:51.061497 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4d15a-469c-4867-9689-e29289145a68 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:51.061804 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4d15a-469c-4867-9689-e29289145a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:51.062078 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4d15a-469c-4867-9689-e29289145a68 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:51.062732 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4d15a-469c-4867-9689-e29289145a68 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:51.064171 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4d15a-469c-4867-9689-e29289145a68 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:51.075674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-f0c4d15a-469c-4867-9689-e29289145a68 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 16 18:55:51.075674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:51.075674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:55:51.075674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:55:51.075674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:55:51.075674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:55:51.075674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:55:51.075674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:51.075674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 18:55:51.075674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:51.075674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:55:51.075674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:51.075674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:51.075674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:51.075674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:51.075674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:51.075674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:51.076674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:51.076674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:51.076674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:51.076674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:51.076674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:51.076674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:51.076674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:55:51.076674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:55:51.076674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:55:51.076674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:55:51.076674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:51.076674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:51.076674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:51.076674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:51.076674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:51.076674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:51.077499 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:51.077499 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:51.077499 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:51.077499 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:51.077499 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:51.077499 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:51.077499 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:51.077499 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:51.077499 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:51.077499 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:51.077499 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:55:51.077499 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:51.077499 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 18:55:51.077499 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:51.085151 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 502/1004] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:55:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:51.085301 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79961a1-421d-455d-a1af-d3ae452e86fb None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:51.184476 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79961a1-421d-455d-a1af-d3ae452e86fb None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:51.216293 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931effb2-c69c-478d-a4de-e0e315af6f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:51.216964 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931effb2-c69c-478d-a4de-e0e315af6f73 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:51.217245 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931effb2-c69c-478d-a4de-e0e315af6f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:51.217490 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931effb2-c69c-478d-a4de-e0e315af6f73 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:51.218261 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931effb2-c69c-478d-a4de-e0e315af6f73 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:51.218569 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931effb2-c69c-478d-a4de-e0e315af6f73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:51.219969 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931effb2-c69c-478d-a4de-e0e315af6f73 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:51.225733 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 503/1005] 10.222.0.24 () {56 vars in 1112 bytes} [Mon May 16 18:55:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:51.231640 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4d15a-469c-4867-9689-e29289145a68 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:51.331140 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4d15a-469c-4867-9689-e29289145a68 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:51.364466 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118a013-3ba5-4fff-a109-e3c98ad8e6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:51.365136 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118a013-3ba5-4fff-a109-e3c98ad8e6e4 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:51.365417 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118a013-3ba5-4fff-a109-e3c98ad8e6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:51.365719 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118a013-3ba5-4fff-a109-e3c98ad8e6e4 None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:51.366477 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118a013-3ba5-4fff-a109-e3c98ad8e6e4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:51.366787 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118a013-3ba5-4fff-a109-e3c98ad8e6e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:51.368169 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118a013-3ba5-4fff-a109-e3c98ad8e6e4 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:51.373189 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 503/1006] 10.222.0.24 () {56 vars in 1112 bytes} [Mon May 16 18:55:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:51.378730 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931effb2-c69c-478d-a4de-e0e315af6f73 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:51.476787 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931effb2-c69c-478d-a4de-e0e315af6f73 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:51.510805 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738a1c1-2424-4652-8c84-2dbdcfb922a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:51.511468 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738a1c1-2424-4652-8c84-2dbdcfb922a5 None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:51.511739 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738a1c1-2424-4652-8c84-2dbdcfb922a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:51.512023 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738a1c1-2424-4652-8c84-2dbdcfb922a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:51.512779 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8738a1c1-2424-4652-8c84-2dbdcfb922a5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:51.514196 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8738a1c1-2424-4652-8c84-2dbdcfb922a5 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:51.534834 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 504/1007] 10.222.0.24 () {60 vars in 1144 bytes} [Mon May 16 18:55:51 2022] POST /identity/v3/endpoints => generated 334 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:55:51.927075 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7bbd8-fa38-469b-bd41-787e5283201e None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:51.927493 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7bbd8-fa38-469b-bd41-787e5283201e None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:51.927597 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7bbd8-fa38-469b-bd41-787e5283201e None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:51.929056 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 504/1008] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:51.934614 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4792ef-fb98-46d8-a137-0978cc1a387c None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:51.934906 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4792ef-fb98-46d8-a137-0978cc1a387c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:51.935179 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4792ef-fb98-46d8-a137-0978cc1a387c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:51.952287 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-2b4792ef-fb98-46d8-a137-0978cc1a387c None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:51.953474 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2b4792ef-fb98-46d8-a137-0978cc1a387c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:52.026471 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 505/1009] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:51 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:55:52.049023 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7bbd8-fa38-469b-bd41-787e5283201e None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:52.149093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7bbd8-fa38-469b-bd41-787e5283201e None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:52.186814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657f13d-6ea9-4418-9b5c-19f5ab6d57be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:52.187552 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657f13d-6ea9-4418-9b5c-19f5ab6d57be None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:52.187885 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657f13d-6ea9-4418-9b5c-19f5ab6d57be None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:52.188153 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657f13d-6ea9-4418-9b5c-19f5ab6d57be None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:52.188801 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657f13d-6ea9-4418-9b5c-19f5ab6d57be None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:52.190209 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657f13d-6ea9-4418-9b5c-19f5ab6d57be None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:52.202093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-a657f13d-6ea9-4418-9b5c-19f5ab6d57be None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 18:55:52.202093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:52.202093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:55:52.202093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:55:52.202093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:55:52.202093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:55:52.202093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:55:52.202093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:52.202093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 18:55:52.202093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:52.202093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:55:52.202093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:52.202093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:52.202093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:52.202093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:52.202093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:52.202093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:52.203053 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:52.203053 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:52.203053 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:52.203053 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:52.203053 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:52.203053 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:52.203053 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:55:52.203053 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:55:52.203053 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:55:52.203053 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:55:52.203053 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:52.203053 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:52.203053 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:52.203053 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:52.203053 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:52.203053 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:52.203899 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:52.203899 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:52.203899 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:52.203899 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:52.203899 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:52.203899 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:52.203899 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:52.203899 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:52.203899 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:52.203899 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:52.203899 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:55:52.203899 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:52.203899 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 18:55:52.203899 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:52.205858 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 505/1010] 10.222.0.24 () {56 vars in 1126 bytes} [Mon May 16 18:55:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:52.209481 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4792ef-fb98-46d8-a137-0978cc1a387c None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:52.306591 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4792ef-fb98-46d8-a137-0978cc1a387c None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:52.340257 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ebba58-0d1b-4449-b8d7-c25f1375b1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:52.340930 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebba58-0d1b-4449-b8d7-c25f1375b1c2 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:52.341208 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebba58-0d1b-4449-b8d7-c25f1375b1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:52.341474 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebba58-0d1b-4449-b8d7-c25f1375b1c2 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:52.342230 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ebba58-0d1b-4449-b8d7-c25f1375b1c2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:52.342517 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ebba58-0d1b-4449-b8d7-c25f1375b1c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:52.343937 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ebba58-0d1b-4449-b8d7-c25f1375b1c2 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:52.348802 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 506/1011] 10.222.0.24 () {56 vars in 1122 bytes} [Mon May 16 18:55:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:52.354798 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657f13d-6ea9-4418-9b5c-19f5ab6d57be None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:52.456162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657f13d-6ea9-4418-9b5c-19f5ab6d57be None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:52.490973 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91355b36-0510-4470-a904-70f12a64f478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:52.491626 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91355b36-0510-4470-a904-70f12a64f478 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:52.491907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91355b36-0510-4470-a904-70f12a64f478 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:52.492167 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91355b36-0510-4470-a904-70f12a64f478 None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:52.492883 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91355b36-0510-4470-a904-70f12a64f478 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:52.493186 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91355b36-0510-4470-a904-70f12a64f478 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:52.494587 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91355b36-0510-4470-a904-70f12a64f478 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:52.499484 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 506/1012] 10.222.0.24 () {56 vars in 1122 bytes} [Mon May 16 18:55:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:52.505205 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ebba58-0d1b-4449-b8d7-c25f1375b1c2 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:52.600114 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ebba58-0d1b-4449-b8d7-c25f1375b1c2 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:52.623399 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42082849-3bed-43f9-b874-ce656d3ac5cd None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:52.623725 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42082849-3bed-43f9-b874-ce656d3ac5cd None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:52.623952 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42082849-3bed-43f9-b874-ce656d3ac5cd None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:52.625471 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 507/1013] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:52.632701 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd192c4-b206-42e0-8eb5-9d11d42354f5 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:52.632701 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd192c4-b206-42e0-8eb5-9d11d42354f5 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:52.632701 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd192c4-b206-42e0-8eb5-9d11d42354f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:52.636732 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d89cab-f187-463a-b4b1-69cc7ad07f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:52.638077 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d89cab-f187-463a-b4b1-69cc7ad07f8e None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:52.638077 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d89cab-f187-463a-b4b1-69cc7ad07f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:52.638077 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d89cab-f187-463a-b4b1-69cc7ad07f8e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:52.638709 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d89cab-f187-463a-b4b1-69cc7ad07f8e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:52.640096 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d89cab-f187-463a-b4b1-69cc7ad07f8e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:52.648400 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-0bd192c4-b206-42e0-8eb5-9d11d42354f5 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:52.649616 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-0bd192c4-b206-42e0-8eb5-9d11d42354f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:52.655505 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 507/1014] 10.222.0.24 () {60 vars in 1144 bytes} [Mon May 16 18:55:52 2022] POST /identity/v3/endpoints => generated 325 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:55:52.730698 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 508/1015] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:52 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 18:55:52.753481 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d89cab-f187-463a-b4b1-69cc7ad07f8e None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:52.856978 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d89cab-f187-463a-b4b1-69cc7ad07f8e None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:52.890168 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2539b-7bc5-4d70-85ea-f305f859141a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:52.890840 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2539b-7bc5-4d70-85ea-f305f859141a None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:52.891120 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2539b-7bc5-4d70-85ea-f305f859141a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:52.891382 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2539b-7bc5-4d70-85ea-f305f859141a None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:52.892117 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c2539b-7bc5-4d70-85ea-f305f859141a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:52.893498 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c2539b-7bc5-4d70-85ea-f305f859141a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:52.913580 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 508/1016] 10.222.0.24 () {60 vars in 1141 bytes} [Mon May 16 18:55:52 2022] POST /identity/v3/services => generated 242 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:55:53.836490 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa93b4-d317-4013-a231-5a797f821c88 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:53.837043 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa93b4-d317-4013-a231-5a797f821c88 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:53.837043 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa93b4-d317-4013-a231-5a797f821c88 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:53.838399 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 509/1017] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:53.843922 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c691be7-a3d3-4c38-87d7-85a51c280388 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:53.844330 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c691be7-a3d3-4c38-87d7-85a51c280388 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:53.844500 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c691be7-a3d3-4c38-87d7-85a51c280388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:53.861388 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-7c691be7-a3d3-4c38-87d7-85a51c280388 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:53.862606 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7c691be7-a3d3-4c38-87d7-85a51c280388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:53.933589 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 509/1018] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:53 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:55:53.953283 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa93b4-d317-4013-a231-5a797f821c88 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:54.052831 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa93b4-d317-4013-a231-5a797f821c88 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:54.086055 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35ccbd-c932-4fb7-9154-8d37eacd8fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:54.086938 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35ccbd-c932-4fb7-9154-8d37eacd8fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:54.087163 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35ccbd-c932-4fb7-9154-8d37eacd8fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:54.087425 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35ccbd-c932-4fb7-9154-8d37eacd8fe0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:54.097262 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df35ccbd-c932-4fb7-9154-8d37eacd8fe0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:55:54.105462 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-df35ccbd-c932-4fb7-9154-8d37eacd8fe0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 18:55:54.105462 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:54.105462 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:54.105462 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:54.105462 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:54.105462 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:54.105462 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:54.105462 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:54.105462 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:54.105462 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:54.105462 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:54.105462 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:54.105462 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:55:54.105462 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:55:54.105462 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:55:54.105462 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:55:54.106534 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:55:54.106534 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:55:54.106534 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:55:54.106534 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:55:54.106534 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:54.106534 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:54.106534 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:54.106534 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:54.106534 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:54.106534 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:54.106534 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:54.106534 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:54.106534 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:54.106534 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:54.106534 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:54.106534 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:54.107379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:54.107379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:54.107379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:54.107379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:54.107379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:55:54.107379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:55:54.107379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:55:54.107379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:55:54.107379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:55:54.107379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:55:54.107379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 18:55:54.107379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:54.109895 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 510/1019] 10.222.0.24 () {56 vars in 1120 bytes} [Mon May 16 18:55:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:54.112638 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c691be7-a3d3-4c38-87d7-85a51c280388 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:54.210950 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c691be7-a3d3-4c38-87d7-85a51c280388 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:54.244494 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc482d2-62ba-493e-80ec-08308e2fb724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:54.245297 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc482d2-62ba-493e-80ec-08308e2fb724 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:54.245705 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc482d2-62ba-493e-80ec-08308e2fb724 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:54.246076 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc482d2-62ba-493e-80ec-08308e2fb724 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:54.246940 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc482d2-62ba-493e-80ec-08308e2fb724 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:54.247337 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc482d2-62ba-493e-80ec-08308e2fb724 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:54.248797 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc482d2-62ba-493e-80ec-08308e2fb724 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:54.257073 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 510/1020] 10.222.0.24 () {56 vars in 1115 bytes} [Mon May 16 18:55:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:54.262680 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35ccbd-c932-4fb7-9154-8d37eacd8fe0 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:54.362459 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35ccbd-c932-4fb7-9154-8d37eacd8fe0 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:54.398072 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d369f3-767a-4617-8754-95475488cde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:54.398881 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d369f3-767a-4617-8754-95475488cde0 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:54.399164 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d369f3-767a-4617-8754-95475488cde0 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:54.399435 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d369f3-767a-4617-8754-95475488cde0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:54.410254 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d369f3-767a-4617-8754-95475488cde0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:54.412087 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d369f3-767a-4617-8754-95475488cde0 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:54.429160 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-a1d369f3-767a-4617-8754-95475488cde0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:54.429160 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:54.429160 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:54.429160 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:54.429160 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:54.429160 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:54.429160 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:54.429160 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:54.429160 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:54.429160 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:54.429160 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:54.429160 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:54.429160 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:54.429160 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:54.429160 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:54.430319 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:54.430319 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:54.430319 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:54.430319 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:54.430319 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:54.430319 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:54.430319 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:54.430319 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:54.430319 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:54.430319 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:54.430319 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:54.430319 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:54.430319 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:54.430319 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:54.430319 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:54.430319 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:54.430319 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:54.431223 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:54.431223 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:54.431223 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:54.431223 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:54.433893 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 511/1021] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:55:54.436101 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc482d2-62ba-493e-80ec-08308e2fb724 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:54.533629 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc482d2-62ba-493e-80ec-08308e2fb724 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:54.565543 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a81a7-b942-42fd-9d0e-95ea9e8cc56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:54.566358 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a81a7-b942-42fd-9d0e-95ea9e8cc56c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:54.566733 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a81a7-b942-42fd-9d0e-95ea9e8cc56c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:54.567102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a81a7-b942-42fd-9d0e-95ea9e8cc56c None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:54.567918 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a81a7-b942-42fd-9d0e-95ea9e8cc56c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:54.568354 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a81a7-b942-42fd-9d0e-95ea9e8cc56c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:54.569964 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a81a7-b942-42fd-9d0e-95ea9e8cc56c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:54.586429 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 511/1022] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:54.587999 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d369f3-767a-4617-8754-95475488cde0 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:54.692100 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d369f3-767a-4617-8754-95475488cde0 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:54.731133 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e722b5-4b90-4629-ae65-19c78a094a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:54.731980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e722b5-4b90-4629-ae65-19c78a094a91 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:54.732257 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e722b5-4b90-4629-ae65-19c78a094a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:54.732530 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e722b5-4b90-4629-ae65-19c78a094a91 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:54.741307 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e722b5-4b90-4629-ae65-19c78a094a91 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:54.742835 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e722b5-4b90-4629-ae65-19c78a094a91 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:54.757759 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-65e722b5-4b90-4629-ae65-19c78a094a91 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 18:55:54.757759 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:54.757759 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:54.757759 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:54.757759 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:54.757759 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:54.757759 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:54.757759 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:54.757759 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:54.757759 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:54.757759 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:54.757759 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:54.757759 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:55:54.757759 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:55:54.757759 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:55:54.757759 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:55:54.758765 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:54.758765 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:54.758765 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:55:54.758765 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:54.758765 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:55:54.758765 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:54.758765 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:54.758765 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:54.758765 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:54.758765 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:54.758765 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:54.758765 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:54.758765 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:54.758765 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:54.758765 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:54.758765 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:54.758765 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:54.758765 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:54.759716 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:54.759716 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:54.759716 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:55:54.759716 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:55:54.759716 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:55:54.759716 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:55:54.759716 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:55:54.759716 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:55:54.759716 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 18:55:54.759716 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:54.761914 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 512/1023] 10.222.0.24 () {56 vars in 1093 bytes} [Mon May 16 18:55:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:54.764805 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a81a7-b942-42fd-9d0e-95ea9e8cc56c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:54.863398 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a81a7-b942-42fd-9d0e-95ea9e8cc56c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:54.898040 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f1a27-934b-4e32-98ea-51063c78e303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:54.898705 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f1a27-934b-4e32-98ea-51063c78e303 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:54.898983 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f1a27-934b-4e32-98ea-51063c78e303 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:54.899256 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f1a27-934b-4e32-98ea-51063c78e303 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:54.900082 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f1a27-934b-4e32-98ea-51063c78e303 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:54.900384 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f1a27-934b-4e32-98ea-51063c78e303 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:54.901865 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f1a27-934b-4e32-98ea-51063c78e303 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:54.904359 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877b9f2-cce7-4032-bc18-5d9765dcb24f None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:54.904823 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877b9f2-cce7-4032-bc18-5d9765dcb24f None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:54.904903 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877b9f2-cce7-4032-bc18-5d9765dcb24f None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:54.906450 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 513/1024] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:55:54.911862 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21bbe7-bee5-42d6-9b1e-b8169194b4c1 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:54.912143 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21bbe7-bee5-42d6-9b1e-b8169194b4c1 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:54.912415 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21bbe7-bee5-42d6-9b1e-b8169194b4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:54.921257 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 512/1025] 10.222.0.24 () {56 vars in 1133 bytes} [Mon May 16 18:55:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:54.927411 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f1a27-934b-4e32-98ea-51063c78e303 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:54.930887 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-dd21bbe7-bee5-42d6-9b1e-b8169194b4c1 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:54.932123 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-dd21bbe7-bee5-42d6-9b1e-b8169194b4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:54.998776 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 514/1026] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 18:55:55.021676 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21bbe7-bee5-42d6-9b1e-b8169194b4c1 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:55.032419 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f1a27-934b-4e32-98ea-51063c78e303 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:55.065602 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55373ec-4928-4aa1-a723-9ca02bd2cff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:55.066285 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55373ec-4928-4aa1-a723-9ca02bd2cff4 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:55.066576 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55373ec-4928-4aa1-a723-9ca02bd2cff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:55.066841 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55373ec-4928-4aa1-a723-9ca02bd2cff4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:55.115957 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21bbe7-bee5-42d6-9b1e-b8169194b4c1 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:55.133186 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55373ec-4928-4aa1-a723-9ca02bd2cff4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:55.134698 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55373ec-4928-4aa1-a723-9ca02bd2cff4 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:55.147605 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343ad54-b873-4d97-8d49-c9ef298dcd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:55.148402 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343ad54-b873-4d97-8d49-c9ef298dcd81 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:55.148677 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343ad54-b873-4d97-8d49-c9ef298dcd81 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:55.148938 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343ad54-b873-4d97-8d49-c9ef298dcd81 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:55.150123 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343ad54-b873-4d97-8d49-c9ef298dcd81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:55.151542 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343ad54-b873-4d97-8d49-c9ef298dcd81 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:55.153136 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 515/1027] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:55:55.154392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15b025-1d38-49f9-8fe6-4062dde95bce None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:55.154674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15b025-1d38-49f9-8fe6-4062dde95bce None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:55.154943 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15b025-1d38-49f9-8fe6-4062dde95bce None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:55.156306 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 516/1028] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:55.159262 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15b025-1d38-49f9-8fe6-4062dde95bce None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:55.230418 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 513/1029] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:55:54 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 16 18:55:55.231726 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22bcd4-42cd-44c6-a128-e6ee648e74fb None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:55.231986 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22bcd4-42cd-44c6-a128-e6ee648e74fb None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:55.232286 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22bcd4-42cd-44c6-a128-e6ee648e74fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:55.248427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-2b22bcd4-42cd-44c6-a128-e6ee648e74fb None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:55.249666 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2b22bcd4-42cd-44c6-a128-e6ee648e74fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:55.258359 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15b025-1d38-49f9-8fe6-4062dde95bce None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:55.291191 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c480e-831f-4238-9338-11e1d8d9c004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:55.291817 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c480e-831f-4238-9338-11e1d8d9c004 None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:55.292099 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c480e-831f-4238-9338-11e1d8d9c004 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:55.292370 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c480e-831f-4238-9338-11e1d8d9c004 None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:55.293073 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c480e-831f-4238-9338-11e1d8d9c004 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:55.294528 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c480e-831f-4238-9338-11e1d8d9c004 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:55.317406 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 514/1030] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:55:55.318289 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22bcd4-42cd-44c6-a128-e6ee648e74fb None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:55.321730 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 517/1031] 10.222.0.24 () {60 vars in 1141 bytes} [Mon May 16 18:55:55 2022] POST /identity/v3/projects => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:55:55.341076 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c480e-831f-4238-9338-11e1d8d9c004 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:55.426965 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22bcd4-42cd-44c6-a128-e6ee648e74fb None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:55.447693 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c480e-831f-4238-9338-11e1d8d9c004 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:55.464154 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5a2a1-1898-47e9-b5fb-e17ab4004311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:55.464977 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5a2a1-1898-47e9-b5fb-e17ab4004311 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:55.465259 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5a2a1-1898-47e9-b5fb-e17ab4004311 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:55.465556 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5a2a1-1898-47e9-b5fb-e17ab4004311 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:55.476932 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5a2a1-1898-47e9-b5fb-e17ab4004311 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:55.478486 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5a2a1-1898-47e9-b5fb-e17ab4004311 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:55.485381 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7e30c4-35bb-4bfe-97d1-c41e9029b27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:55.486253 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e30c4-35bb-4bfe-97d1-c41e9029b27a None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:55.486537 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e30c4-35bb-4bfe-97d1-c41e9029b27a None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:55.487247 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e30c4-35bb-4bfe-97d1-c41e9029b27a None admin] PATH_INFO: `/v3/services/image` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:55.487478 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7e30c4-35bb-4bfe-97d1-c41e9029b27a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:55.488889 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7e30c4-35bb-4bfe-97d1-c41e9029b27a None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:55.499126 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-8fd5a2a1-1898-47e9-b5fb-e17ab4004311 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:55.499126 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:55.499126 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:55.499126 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:55.499126 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:55.499126 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:55.499126 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:55.499126 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:55.499126 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:55.499126 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:55.499126 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:55.499126 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:55.499126 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:55.499126 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:55.499126 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:55.500239 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:55.500239 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:55.500239 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:55.500239 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:55.500239 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:55.500239 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:55.500239 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:55.500239 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:55.500239 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:55.500239 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:55.500239 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:55.500239 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:55.500239 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:55.500239 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:55.500239 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:55.500239 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:55.500239 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:55.501171 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:55.501171 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:55.501171 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:55.501171 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:55.501405 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-2a7e30c4-35bb-4bfe-97d1-c41e9029b27a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 16 18:55:55.501405 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:55.501405 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:55:55.501405 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:55:55.501405 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:55:55.501405 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:55:55.501405 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:55:55.501405 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:55.501405 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 18:55:55.501405 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:55.501405 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:55:55.501405 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:55.501405 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:55.501405 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:55.501405 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:55.501405 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:55.501405 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:55.502345 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:55.502345 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:55.502345 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:55.502345 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:55.502345 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:55.502345 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:55.502345 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:55:55.502345 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:55:55.502345 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:55:55.502345 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:55:55.502345 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:55.502345 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:55.502345 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:55.502345 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:55.502345 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:55.502345 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:55.504093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:55.504093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:55.504093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:55.504093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:55.504093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:55.504093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:55.504093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:55.504093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:55.504093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:55.504093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:55.504093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:55:55.504093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:55.504093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 18:55:55.504093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:55.504093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 518/1032] 10.222.0.24 () {56 vars in 1105 bytes} [Mon May 16 18:55:55 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:55.506677 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 515/1033] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:55.508926 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7e30c4-35bb-4bfe-97d1-c41e9029b27a None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:55.510624 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5a2a1-1898-47e9-b5fb-e17ab4004311 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:55.608575 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5a2a1-1898-47e9-b5fb-e17ab4004311 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:55.610720 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7e30c4-35bb-4bfe-97d1-c41e9029b27a None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:55.641070 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeedace-2aac-4c7e-8605-2d9ccab6af00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:55.641319 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f6573-6326-4ce9-8a23-3cec4e527096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:55.641953 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeedace-2aac-4c7e-8605-2d9ccab6af00 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:55.642066 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeedace-2aac-4c7e-8605-2d9ccab6af00 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:55.643205 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f6573-6326-4ce9-8a23-3cec4e527096 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:55.643315 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeedace-2aac-4c7e-8605-2d9ccab6af00 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:55.643420 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f6573-6326-4ce9-8a23-3cec4e527096 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:55.643420 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f6573-6326-4ce9-8a23-3cec4e527096 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:55.643572 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeedace-2aac-4c7e-8605-2d9ccab6af00 None admin] RBAC: Adding query filter params (name=image) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:55.643572 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeedace-2aac-4c7e-8605-2d9ccab6af00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:55.644024 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f6573-6326-4ce9-8a23-3cec4e527096 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:55.644421 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f6573-6326-4ce9-8a23-3cec4e527096 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:55.644900 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeedace-2aac-4c7e-8605-2d9ccab6af00 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:55.645995 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f6573-6326-4ce9-8a23-3cec4e527096 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:55.654335 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 516/1034] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:55.655390 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeedace-2aac-4c7e-8605-2d9ccab6af00 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:55.663181 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 519/1035] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:55.664458 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f6573-6326-4ce9-8a23-3cec4e527096 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:55.749209 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeedace-2aac-4c7e-8605-2d9ccab6af00 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:55.757249 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f6573-6326-4ce9-8a23-3cec4e527096 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:55.781336 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d65c75-c73e-4de0-a4c2-89f553973a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:55.782026 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d65c75-c73e-4de0-a4c2-89f553973a15 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:55.782547 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d65c75-c73e-4de0-a4c2-89f553973a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:55.782547 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d65c75-c73e-4de0-a4c2-89f553973a15 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:55.783247 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d65c75-c73e-4de0-a4c2-89f553973a15 None admin] RBAC: Adding query filter params (type=image) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:55.783552 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d65c75-c73e-4de0-a4c2-89f553973a15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:55.784926 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d65c75-c73e-4de0-a4c2-89f553973a15 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:55.789995 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 517/1036] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:55.795551 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dda927-ad67-4e2a-8048-1eb481c92cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:55.795728 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d65c75-c73e-4de0-a4c2-89f553973a15 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:55.796500 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dda927-ad67-4e2a-8048-1eb481c92cfb None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:55.796835 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dda927-ad67-4e2a-8048-1eb481c92cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:55.797169 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dda927-ad67-4e2a-8048-1eb481c92cfb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:55.804099 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dda927-ad67-4e2a-8048-1eb481c92cfb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:55.805657 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dda927-ad67-4e2a-8048-1eb481c92cfb None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:55.820156 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-57dda927-ad67-4e2a-8048-1eb481c92cfb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:55.820156 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:55.820156 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:55.820156 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:55.820156 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:55.820156 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:55.820156 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:55.820156 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:55.820156 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:55.820156 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:55.820156 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:55.820156 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:55.820156 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:55:55.820156 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:55:55.820156 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:55:55.821069 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:55:55.821069 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:55.821069 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:55.821069 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:55.821069 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:55.821069 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:55.821069 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:55.821069 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:55.821069 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:55.821069 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:55.821069 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:55.821069 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:55.821069 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:55.821069 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:55.821069 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:55.821069 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:55.821069 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:55.826816 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:55:55.826816 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:55:55.826816 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:55:55.826816 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:55:55.826816 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:55:55.826816 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:55:55.826816 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:55.826816 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:55.826816 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 520/1037] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:55:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:55:55.827317 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dda927-ad67-4e2a-8048-1eb481c92cfb None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:55.889235 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d65c75-c73e-4de0-a4c2-89f553973a15 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:55.921618 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dda927-ad67-4e2a-8048-1eb481c92cfb None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:55.922136 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b63760-3f9c-401c-b1b7-9fe5d36f5862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:55.922458 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b63760-3f9c-401c-b1b7-9fe5d36f5862 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:55.922740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b63760-3f9c-401c-b1b7-9fe5d36f5862 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:55.923011 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b63760-3f9c-401c-b1b7-9fe5d36f5862 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:55.923806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b63760-3f9c-401c-b1b7-9fe5d36f5862 None admin] RBAC: Adding query filter params (interface=public, service_id=eeae6af9c0b146f3ac886689907d96d2, region_id=RegionOne) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:55.924118 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b63760-3f9c-401c-b1b7-9fe5d36f5862 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:55.925503 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b63760-3f9c-401c-b1b7-9fe5d36f5862 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:55.930843 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 518/1038] 10.222.0.24 () {56 vars in 1251 bytes} [Mon May 16 18:55:55 2022] GET /identity/v3/endpoints?service_id=eeae6af9c0b146f3ac886689907d96d2&interface=public®ion_id=RegionOne => generated 194 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:55:55.936059 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b63760-3f9c-401c-b1b7-9fe5d36f5862 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:55.954835 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9265020-4b47-4aa3-b4c2-05e02613e81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:55.955501 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9265020-4b47-4aa3-b4c2-05e02613e81f None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:55.955782 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9265020-4b47-4aa3-b4c2-05e02613e81f None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:55.956371 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9265020-4b47-4aa3-b4c2-05e02613e81f None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:55.956817 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9265020-4b47-4aa3-b4c2-05e02613e81f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:55.957122 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9265020-4b47-4aa3-b4c2-05e02613e81f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:55.958598 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9265020-4b47-4aa3-b4c2-05e02613e81f None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:55.975467 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 521/1039] 10.222.0.24 () {56 vars in 1148 bytes} [Mon May 16 18:55:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:55.976942 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9265020-4b47-4aa3-b4c2-05e02613e81f None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:56.031489 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b63760-3f9c-401c-b1b7-9fe5d36f5862 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:56.066305 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e9be4-952d-4fa2-948b-b030d21f28ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:56.067294 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e9be4-952d-4fa2-948b-b030d21f28ac None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:56.067817 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e9be4-952d-4fa2-948b-b030d21f28ac None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:56.068107 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e9be4-952d-4fa2-948b-b030d21f28ac None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:56.069078 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e9be4-952d-4fa2-948b-b030d21f28ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:56.071068 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e9be4-952d-4fa2-948b-b030d21f28ac None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:56.075032 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9265020-4b47-4aa3-b4c2-05e02613e81f None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:56.079054 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 519/1040] 10.222.0.24 () {56 vars in 1087 bytes} [Mon May 16 18:55:55 2022] GET /identity/v3/services => generated 1957 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 18:55:56.113457 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07740c92-f777-4231-89dd-a7a5a8081803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:56.114176 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07740c92-f777-4231-89dd-a7a5a8081803 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:56.114457 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07740c92-f777-4231-89dd-a7a5a8081803 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:56.114727 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07740c92-f777-4231-89dd-a7a5a8081803 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:56.115573 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07740c92-f777-4231-89dd-a7a5a8081803 None admin] RBAC: Adding query filter params (role.id=1abd30a5bbfb45a1ab6de390e19a6c70, scope.project.id=084e70bbad784892b195bb11a68bf857, user.id=1f03aa520ee14615b802cdbc3cd4f87d) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:56.115912 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07740c92-f777-4231-89dd-a7a5a8081803 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:56.117678 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07740c92-f777-4231-89dd-a7a5a8081803 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:56.125585 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 522/1041] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:55:55 2022] GET /identity/v3/role_assignments?user.id=1f03aa520ee14615b802cdbc3cd4f87d&scope.project.id=084e70bbad784892b195bb11a68bf857&role.id=1abd30a5bbfb45a1ab6de390e19a6c70 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:55:57.568222 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac28093-5522-47ba-89d1-eee23ff8fcee None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:57.568808 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac28093-5522-47ba-89d1-eee23ff8fcee None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:57.568808 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac28093-5522-47ba-89d1-eee23ff8fcee None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:57.570131 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 520/1042] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:57.575704 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546688fc-e420-4b27-8a91-739ced24606c None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:57.576133 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546688fc-e420-4b27-8a91-739ced24606c None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:57.576305 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546688fc-e420-4b27-8a91-739ced24606c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:57.594310 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-546688fc-e420-4b27-8a91-739ced24606c None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:57.595504 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-546688fc-e420-4b27-8a91-739ced24606c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:57.663277 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 523/1043] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:55:57.687584 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac28093-5522-47ba-89d1-eee23ff8fcee None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:57.788979 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac28093-5522-47ba-89d1-eee23ff8fcee None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:57.822870 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc28df3-9234-4015-afe9-0ccb72ea06fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:57.823579 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc28df3-9234-4015-afe9-0ccb72ea06fa None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:57.823855 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc28df3-9234-4015-afe9-0ccb72ea06fa None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:57.824119 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc28df3-9234-4015-afe9-0ccb72ea06fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:57.825397 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc28df3-9234-4015-afe9-0ccb72ea06fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:57.826877 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc28df3-9234-4015-afe9-0ccb72ea06fa None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:57.828663 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 521/1044] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:57.834246 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546688fc-e420-4b27-8a91-739ced24606c None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:57.932395 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546688fc-e420-4b27-8a91-739ced24606c None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:57.966824 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0815542-ad82-4a21-9e7f-e7b5b6f9a2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:57.967520 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0815542-ad82-4a21-9e7f-e7b5b6f9a2c2 None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:57.967795 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0815542-ad82-4a21-9e7f-e7b5b6f9a2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:57.968061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0815542-ad82-4a21-9e7f-e7b5b6f9a2c2 None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:57.968787 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0815542-ad82-4a21-9e7f-e7b5b6f9a2c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:57.970275 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0815542-ad82-4a21-9e7f-e7b5b6f9a2c2 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:57.994759 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 524/1045] 10.222.0.24 () {60 vars in 1132 bytes} [Mon May 16 18:55:57 2022] POST /identity/v3/users => generated 285 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:55:58.317244 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3e228-d743-42eb-8ee6-02a05bd695e5 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:58.317498 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3e228-d743-42eb-8ee6-02a05bd695e5 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:58.317829 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3e228-d743-42eb-8ee6-02a05bd695e5 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:58.318232 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281dbb22-6cfe-45ff-9ff2-eb4aaf8053d1 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:58.318516 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281dbb22-6cfe-45ff-9ff2-eb4aaf8053d1 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:58.318935 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281dbb22-6cfe-45ff-9ff2-eb4aaf8053d1 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:58.319453 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 522/1046] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:58.320473 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 525/1047] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:55:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:55:58.324281 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b655a-284d-41c3-bceb-841359a25dd8 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:58.324575 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b655a-284d-41c3-bceb-841359a25dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:58.324847 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b655a-284d-41c3-bceb-841359a25dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:58.325571 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb49991-c592-4914-a392-91303dc6f9ce None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:58.325840 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb49991-c592-4914-a392-91303dc6f9ce None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:58.326118 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb49991-c592-4914-a392-91303dc6f9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:58.341512 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-cf4b655a-284d-41c3-bceb-841359a25dd8 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:58.342657 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-1bb49991-c592-4914-a392-91303dc6f9ce None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:58.342766 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-cf4b655a-284d-41c3-bceb-841359a25dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:58.343809 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-1bb49991-c592-4914-a392-91303dc6f9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:58.409349 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 526/1048] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:55:58.417665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 523/1049] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:55:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 18:55:58.432394 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb49991-c592-4914-a392-91303dc6f9ce None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:58.434190 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b655a-284d-41c3-bceb-841359a25dd8 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:58.529334 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb49991-c592-4914-a392-91303dc6f9ce None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:58.531406 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b655a-284d-41c3-bceb-841359a25dd8 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:58.563030 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9a6aa-600a-434f-bc4d-d3b72532c936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:58.563862 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9a6aa-600a-434f-bc4d-d3b72532c936 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:58.564152 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9a6aa-600a-434f-bc4d-d3b72532c936 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:58.564416 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9a6aa-600a-434f-bc4d-d3b72532c936 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:58.565322 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497ca4c-d805-4ced-9bff-a227c257a9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:58.566250 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497ca4c-d805-4ced-9bff-a227c257a9b6 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:58.566417 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497ca4c-d805-4ced-9bff-a227c257a9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:58.566663 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497ca4c-d805-4ced-9bff-a227c257a9b6 None admin] PATH_INFO: `/v3/services/image` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:58.567301 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497ca4c-d805-4ced-9bff-a227c257a9b6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:58.568720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497ca4c-d805-4ced-9bff-a227c257a9b6 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:58.574610 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba9a6aa-600a-434f-bc4d-d3b72532c936 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:55:58.580641 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-a497ca4c-d805-4ced-9bff-a227c257a9b6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 16 18:55:58.580641 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:58.580641 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:55:58.580641 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:55:58.580641 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:55:58.580641 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:55:58.580641 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:55:58.580641 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:58.580641 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 18:55:58.580641 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:58.580641 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:55:58.580641 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:58.580641 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:58.580641 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:58.580641 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:58.580641 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:58.580641 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:58.581866 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:58.581866 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:58.581866 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:58.581866 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:58.581866 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:58.581866 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:58.581866 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:55:58.581866 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:55:58.581866 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:55:58.581866 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:55:58.581866 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:58.581866 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:58.581866 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:58.581866 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:58.581866 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:58.581866 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:58.582711 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:58.582711 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:58.582711 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:58.582711 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:58.582711 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:58.582711 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:58.582711 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:58.582711 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:58.582711 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:58.582711 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:58.582711 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:55:58.582711 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:55:58.582711 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 18:55:58.582711 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:58.589509 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-4ba9a6aa-600a-434f-bc4d-d3b72532c936 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 18:55:58.589509 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:58.589509 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:58.589509 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:58.589509 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:58.589509 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:58.589509 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:58.589509 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:58.589509 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:58.589509 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:58.589509 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:58.589509 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:58.589509 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:55:58.589509 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:55:58.589509 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:55:58.589509 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:55:58.591980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:55:58.591980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:55:58.591980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:55:58.591980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:55:58.591980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:58.591980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:58.591980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:58.591980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:58.591980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:58.591980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:58.591980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:58.591980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:58.591980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:58.591980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:58.591980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:58.591980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:58.593973 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:58.593973 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:58.593973 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:58.593973 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:58.593973 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:55:58.593973 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:55:58.593973 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:55:58.593973 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:55:58.593973 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:55:58.593973 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:55:58.593973 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 18:55:58.593973 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:58.593973 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 527/1050] 10.222.0.24 () {56 vars in 1120 bytes} [Mon May 16 18:55:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:58.595676 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 524/1051] 10.222.0.24 () {56 vars in 1105 bytes} [Mon May 16 18:55:58 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:55:58.595817 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9a6aa-600a-434f-bc4d-d3b72532c936 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:58.595978 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497ca4c-d805-4ced-9bff-a227c257a9b6 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:58.692877 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9a6aa-600a-434f-bc4d-d3b72532c936 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:58.695151 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497ca4c-d805-4ced-9bff-a227c257a9b6 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:58.724518 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce4334-79c3-4fc8-a7f2-67d404ab2f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:58.725210 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce4334-79c3-4fc8-a7f2-67d404ab2f7e None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:58.725502 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce4334-79c3-4fc8-a7f2-67d404ab2f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:58.725787 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce4334-79c3-4fc8-a7f2-67d404ab2f7e None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:58.726486 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce4334-79c3-4fc8-a7f2-67d404ab2f7e None admin] RBAC: Adding query filter params (name=image) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:58.726790 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce4334-79c3-4fc8-a7f2-67d404ab2f7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:58.728160 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce4334-79c3-4fc8-a7f2-67d404ab2f7e None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:58.729642 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5937a5d-eefa-48c6-a967-449d800c228b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:58.730326 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5937a5d-eefa-48c6-a967-449d800c228b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:58.730607 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5937a5d-eefa-48c6-a967-449d800c228b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:58.730880 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5937a5d-eefa-48c6-a967-449d800c228b None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:58.731699 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5937a5d-eefa-48c6-a967-449d800c228b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:58.732007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5937a5d-eefa-48c6-a967-449d800c228b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:58.733282 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 528/1052] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:58.733446 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5937a5d-eefa-48c6-a967-449d800c228b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:58.738590 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce4334-79c3-4fc8-a7f2-67d404ab2f7e None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:58.742945 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 525/1053] 10.222.0.24 () {56 vars in 1115 bytes} [Mon May 16 18:55:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:58.747643 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5937a5d-eefa-48c6-a967-449d800c228b None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:58.835452 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce4334-79c3-4fc8-a7f2-67d404ab2f7e None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:58.844405 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5937a5d-eefa-48c6-a967-449d800c228b None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:58.868484 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1e9eb-d34c-4c9a-bf5f-bc21f730f917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:58.869158 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1e9eb-d34c-4c9a-bf5f-bc21f730f917 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:58.869439 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1e9eb-d34c-4c9a-bf5f-bc21f730f917 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:58.869973 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1e9eb-d34c-4c9a-bf5f-bc21f730f917 None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:58.870449 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f1e9eb-d34c-4c9a-bf5f-bc21f730f917 None admin] RBAC: Adding query filter params (type=image) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:58.870756 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f1e9eb-d34c-4c9a-bf5f-bc21f730f917 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:58.872136 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f1e9eb-d34c-4c9a-bf5f-bc21f730f917 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:58.881960 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 529/1054] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:55:58.882118 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ef440-52de-483d-aaa5-9119892996d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:58.882118 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ef440-52de-483d-aaa5-9119892996d0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:58.882118 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ef440-52de-483d-aaa5-9119892996d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:58.882118 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ef440-52de-483d-aaa5-9119892996d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:58.883091 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1e9eb-d34c-4c9a-bf5f-bc21f730f917 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:58.891188 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ef440-52de-483d-aaa5-9119892996d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:58.893120 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ef440-52de-483d-aaa5-9119892996d0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:58.912650 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-266ef440-52de-483d-aaa5-9119892996d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:58.912650 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:58.912650 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:58.912650 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:58.912650 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:58.912650 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:58.912650 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:58.912650 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:58.912650 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:58.912650 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:58.912650 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:58.912650 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:58.912650 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:58.912650 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:58.912650 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:58.913615 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:58.913615 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:58.913615 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:58.913615 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:58.913615 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:58.913615 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:58.913615 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:58.913615 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:58.913615 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:55:58.913615 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:58.913615 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:58.913615 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:58.913615 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:58.913615 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:58.913615 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:58.913615 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:58.913615 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:58.914752 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:58.914752 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:58.914752 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:58.914752 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:55:58.914752 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 526/1055] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:55:58.919556 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ef440-52de-483d-aaa5-9119892996d0 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:58.984320 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1e9eb-d34c-4c9a-bf5f-bc21f730f917 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:59.015988 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480aa61-c778-4ab2-a863-f3a8883bc958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:59.016655 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480aa61-c778-4ab2-a863-f3a8883bc958 None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:59.016929 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480aa61-c778-4ab2-a863-f3a8883bc958 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:59.017199 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480aa61-c778-4ab2-a863-f3a8883bc958 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:59.017605 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ef440-52de-483d-aaa5-9119892996d0 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:59.017986 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480aa61-c778-4ab2-a863-f3a8883bc958 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:59.019375 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480aa61-c778-4ab2-a863-f3a8883bc958 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:59.037760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 530/1056] 10.222.0.24 () {60 vars in 1144 bytes} [Mon May 16 18:55:58 2022] POST /identity/v3/endpoints => generated 327 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:55:59.058839 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ce80c-942c-4dd0-af21-0e14ec78ff7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:59.059738 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ce80c-942c-4dd0-af21-0e14ec78ff7d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:59.060106 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ce80c-942c-4dd0-af21-0e14ec78ff7d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:59.060470 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ce80c-942c-4dd0-af21-0e14ec78ff7d None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:59.061305 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ce80c-942c-4dd0-af21-0e14ec78ff7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:59.061709 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ce80c-942c-4dd0-af21-0e14ec78ff7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:59.063213 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ce80c-942c-4dd0-af21-0e14ec78ff7d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:59.076730 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 527/1057] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:55:59.082262 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480aa61-c778-4ab2-a863-f3a8883bc958 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:59.197762 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480aa61-c778-4ab2-a863-f3a8883bc958 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:59.234538 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e481f876-9fb3-409b-bd6d-cb128894247b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:59.235766 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481f876-9fb3-409b-bd6d-cb128894247b None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:59.236286 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481f876-9fb3-409b-bd6d-cb128894247b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:59.236728 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481f876-9fb3-409b-bd6d-cb128894247b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:59.244930 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e481f876-9fb3-409b-bd6d-cb128894247b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:59.246426 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e481f876-9fb3-409b-bd6d-cb128894247b None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:59.261196 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-e481f876-9fb3-409b-bd6d-cb128894247b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 18:55:59.261196 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:59.261196 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:59.261196 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:59.261196 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:59.261196 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:59.261196 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:59.261196 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:59.261196 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:59.261196 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:59.261196 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:59.261196 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:59.261196 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:55:59.261196 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:55:59.261196 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:55:59.261196 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:55:59.262452 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:59.262452 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:59.262452 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:55:59.262452 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:59.262452 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:55:59.262452 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:55:59.262452 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:59.262452 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:59.262452 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:59.262452 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:59.262452 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:59.262452 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:59.262452 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:59.262452 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:59.262452 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:59.262452 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:59.262452 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:59.262452 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:59.263693 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:59.263693 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:59.263693 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:55:59.263693 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:55:59.263693 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:55:59.263693 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:55:59.263693 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:55:59.263693 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:55:59.263693 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 18:55:59.263693 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:59.263693 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 531/1058] 10.222.0.24 () {56 vars in 1093 bytes} [Mon May 16 18:55:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:59.269646 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ce80c-942c-4dd0-af21-0e14ec78ff7d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:59.367477 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ce80c-942c-4dd0-af21-0e14ec78ff7d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:59.401430 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405c2ef-84fd-4404-b995-52581e699f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:59.402128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405c2ef-84fd-4404-b995-52581e699f67 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:59.402409 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405c2ef-84fd-4404-b995-52581e699f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:59.402680 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405c2ef-84fd-4404-b995-52581e699f67 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:59.403519 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8405c2ef-84fd-4404-b995-52581e699f67 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:59.403826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8405c2ef-84fd-4404-b995-52581e699f67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:59.405292 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8405c2ef-84fd-4404-b995-52581e699f67 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:59.423468 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 528/1059] 10.222.0.24 () {56 vars in 1133 bytes} [Mon May 16 18:55:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:55:59.428961 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e481f876-9fb3-409b-bd6d-cb128894247b None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:59.535042 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e481f876-9fb3-409b-bd6d-cb128894247b None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:59.567633 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04d325-c2df-41a8-8bd4-c7cc672af1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:59.568436 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04d325-c2df-41a8-8bd4-c7cc672af1f0 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:59.569119 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04d325-c2df-41a8-8bd4-c7cc672af1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:59.569399 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04d325-c2df-41a8-8bd4-c7cc672af1f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:59.581586 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb04d325-c2df-41a8-8bd4-c7cc672af1f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:59.583064 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb04d325-c2df-41a8-8bd4-c7cc672af1f0 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:59.600580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-eb04d325-c2df-41a8-8bd4-c7cc672af1f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:59.600580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:59.600580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:59.600580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:59.600580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:59.600580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:59.600580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:59.600580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:59.600580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:59.600580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:59.600580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:59.600580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:59.600580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:55:59.600580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:55:59.600580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:55:59.602177 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:55:59.602177 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:59.602177 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:59.602177 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:59.602177 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:59.602177 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:59.602177 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:59.602177 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:59.602177 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:59.602177 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:59.602177 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:59.602177 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:59.602177 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:59.602177 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:59.602177 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:59.602177 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:59.602177 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:59.603087 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:55:59.603087 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:55:59.603087 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:55:59.603087 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:59.603087 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 532/1060] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:55:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:59.607487 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405c2ef-84fd-4404-b995-52581e699f67 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:59.707143 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405c2ef-84fd-4404-b995-52581e699f67 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:59.741021 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a52b6-d6b4-44c4-9eac-c1e89ed4634f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:59.741725 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a52b6-d6b4-44c4-9eac-c1e89ed4634f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:59.742004 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a52b6-d6b4-44c4-9eac-c1e89ed4634f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:59.742275 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a52b6-d6b4-44c4-9eac-c1e89ed4634f None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:59.743003 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a52b6-d6b4-44c4-9eac-c1e89ed4634f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:55:59.743307 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a52b6-d6b4-44c4-9eac-c1e89ed4634f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:59.744687 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a52b6-d6b4-44c4-9eac-c1e89ed4634f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:59.756301 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 529/1061] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:55:59.761766 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04d325-c2df-41a8-8bd4-c7cc672af1f0 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:59.864658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04d325-c2df-41a8-8bd4-c7cc672af1f0 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:59.902505 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a88dc-f283-49cc-b01d-5970f2b91912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:59.903310 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a88dc-f283-49cc-b01d-5970f2b91912 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:59.903585 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a88dc-f283-49cc-b01d-5970f2b91912 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:59.903853 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a88dc-f283-49cc-b01d-5970f2b91912 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:59.912785 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a88dc-f283-49cc-b01d-5970f2b91912 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:59.914274 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a88dc-f283-49cc-b01d-5970f2b91912 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:59.928766 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-e18a88dc-f283-49cc-b01d-5970f2b91912 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:59.928766 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:55:59.928766 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:55:59.928766 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:55:59.928766 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:55:59.928766 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:55:59.928766 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:55:59.928766 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:55:59.928766 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:55:59.928766 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:55:59.928766 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:55:59.928766 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:55:59.928766 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:55:59.928766 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:55:59.928766 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:55:59.930026 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:55:59.930026 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:55:59.930026 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:55:59.930026 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:55:59.930026 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:55:59.930026 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:55:59.930026 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:55:59.930026 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:55:59.930026 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:55:59.930026 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:55:59.930026 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:55:59.930026 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:55:59.930026 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:55:59.930026 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:55:59.930026 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:55:59.930026 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:55:59.930026 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:55:59.930923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:55:59.930923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:55:59.930923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:55:59.930923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:55:59.930923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:55:59.930923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:55:59.930923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:55:59.930923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:55:59.933924 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 533/1062] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:55:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:55:59.935931 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a52b6-d6b4-44c4-9eac-c1e89ed4634f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:00.035646 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a52b6-d6b4-44c4-9eac-c1e89ed4634f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:00.069015 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378dfbf3-d927-48d4-b052-a96fb45b73ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:00.069708 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378dfbf3-d927-48d4-b052-a96fb45b73ab None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:00.069990 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378dfbf3-d927-48d4-b052-a96fb45b73ab None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:00.070261 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378dfbf3-d927-48d4-b052-a96fb45b73ab None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:00.071101 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378dfbf3-d927-48d4-b052-a96fb45b73ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:56:00.071417 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378dfbf3-d927-48d4-b052-a96fb45b73ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:00.072856 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378dfbf3-d927-48d4-b052-a96fb45b73ab None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:00.090563 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 530/1063] 10.222.0.24 () {56 vars in 1148 bytes} [Mon May 16 18:55:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:00.092146 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a88dc-f283-49cc-b01d-5970f2b91912 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:00.195063 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a88dc-f283-49cc-b01d-5970f2b91912 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:00.230517 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1bb0d0-6047-4851-a3fe-4b2b5238cda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:00.231504 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bb0d0-6047-4851-a3fe-4b2b5238cda3 None admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:00.231786 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bb0d0-6047-4851-a3fe-4b2b5238cda3 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:00.232092 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bb0d0-6047-4851-a3fe-4b2b5238cda3 None admin] PATH_INFO: `/v3/projects/084e70bbad784892b195bb11a68bf857/users/1f03aa520ee14615b802cdbc3cd4f87d/roles/1abd30a5bbfb45a1ab6de390e19a6c70` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:00.235705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1bb0d0-6047-4851-a3fe-4b2b5238cda3 None admin] RBAC: Authorizing `identity:create_grant(project_id=084e70bbad784892b195bb11a68bf857, user_id=1f03aa520ee14615b802cdbc3cd4f87d, role_id=1abd30a5bbfb45a1ab6de390e19a6c70)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:00.237715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1bb0d0-6047-4851-a3fe-4b2b5238cda3 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:00.257071 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 534/1064] 10.222.0.24 () {58 vars in 1439 bytes} [Mon May 16 18:56:00 2022] PUT /identity/v3/projects/084e70bbad784892b195bb11a68bf857/users/1f03aa520ee14615b802cdbc3cd4f87d/roles/1abd30a5bbfb45a1ab6de390e19a6c70 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:00.277808 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6490b0-3b77-45fe-a106-e162cde09c30 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:00.278185 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6490b0-3b77-45fe-a106-e162cde09c30 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:00.278426 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6490b0-3b77-45fe-a106-e162cde09c30 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:00.280042 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 531/1065] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:56:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:56:00.286239 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97cef6-2e0d-4157-a7e3-69b9dfb932fe None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:00.286559 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97cef6-2e0d-4157-a7e3-69b9dfb932fe None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:00.286800 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97cef6-2e0d-4157-a7e3-69b9dfb932fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:00.304938 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-0d97cef6-2e0d-4157-a7e3-69b9dfb932fe None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:00.306163 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-0d97cef6-2e0d-4157-a7e3-69b9dfb932fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:00.377453 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 535/1066] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:56:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:56:00.401150 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6490b0-3b77-45fe-a106-e162cde09c30 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:00.507170 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6490b0-3b77-45fe-a106-e162cde09c30 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:00.540824 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79163086-1017-4c40-8dc3-e953cbf98ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:00.541647 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79163086-1017-4c40-8dc3-e953cbf98ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:00.541935 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79163086-1017-4c40-8dc3-e953cbf98ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:00.542208 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79163086-1017-4c40-8dc3-e953cbf98ce7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:00.551969 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79163086-1017-4c40-8dc3-e953cbf98ce7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:56:00.559669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-79163086-1017-4c40-8dc3-e953cbf98ce7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:56:00.559669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:56:00.559669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:56:00.559669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:56:00.559669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:56:00.559669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:56:00.559669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:56:00.559669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:56:00.559669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:56:00.559669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:56:00.559669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:56:00.559669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:56:00.559669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:56:00.559669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:56:00.559669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:56:00.559669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:56:00.560568 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:56:00.560568 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:56:00.560568 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:56:00.560568 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:56:00.560568 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:56:00.560568 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:56:00.560568 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:56:00.560568 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:56:00.560568 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:56:00.560568 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:56:00.560568 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:56:00.560568 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:56:00.560568 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:56:00.560568 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:56:00.560568 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:56:00.560568 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:56:00.561423 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:56:00.561423 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:56:00.561423 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:56:00.561423 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:56:00.561423 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:56:00.561423 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:56:00.561423 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:56:00.561423 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:56:00.561423 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:56:00.561423 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:56:00.561423 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:56:00.561423 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:56:00.561423 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 532/1067] 10.222.0.24 () {56 vars in 1096 bytes} [Mon May 16 18:56:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:56:00.568142 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97cef6-2e0d-4157-a7e3-69b9dfb932fe None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:00.668581 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97cef6-2e0d-4157-a7e3-69b9dfb932fe None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:00.702727 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5586b18-768e-44ed-b8bb-2eb241918684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:00.703397 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5586b18-768e-44ed-b8bb-2eb241918684 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:00.703632 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5586b18-768e-44ed-b8bb-2eb241918684 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:00.703930 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5586b18-768e-44ed-b8bb-2eb241918684 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:00.704670 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5586b18-768e-44ed-b8bb-2eb241918684 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:56:00.704975 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5586b18-768e-44ed-b8bb-2eb241918684 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:00.706363 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5586b18-768e-44ed-b8bb-2eb241918684 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:00.719430 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 536/1068] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:56:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:00.720749 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79163086-1017-4c40-8dc3-e953cbf98ce7 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:00.823289 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79163086-1017-4c40-8dc3-e953cbf98ce7 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:00.856799 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b609e-c1bb-4a30-8401-ece0b232d5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:00.857711 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b609e-c1bb-4a30-8401-ece0b232d5bb None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:00.858017 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b609e-c1bb-4a30-8401-ece0b232d5bb None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:00.858265 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b609e-c1bb-4a30-8401-ece0b232d5bb None admin] PATH_INFO: `/v3/users/5b3ff1f011974b8e92aa8f18c31667cd` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:00.871844 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b609e-c1bb-4a30-8401-ece0b232d5bb None admin] RBAC: Authorizing `identity:get_user(user_id=5b3ff1f011974b8e92aa8f18c31667cd)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:00.873311 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b609e-c1bb-4a30-8401-ece0b232d5bb None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:00.875250 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 533/1069] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:56:00 2022] GET /identity/v3/users/5b3ff1f011974b8e92aa8f18c31667cd => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:56:00.880925 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5586b18-768e-44ed-b8bb-2eb241918684 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:00.980215 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5586b18-768e-44ed-b8bb-2eb241918684 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:01.013835 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d02f60-1f38-4f11-8a34-22d53276211a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:01.014492 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d02f60-1f38-4f11-8a34-22d53276211a None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:01.014770 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d02f60-1f38-4f11-8a34-22d53276211a None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:01.015044 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d02f60-1f38-4f11-8a34-22d53276211a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:01.082233 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d02f60-1f38-4f11-8a34-22d53276211a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:01.083612 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d02f60-1f38-4f11-8a34-22d53276211a None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:01.187083 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 537/1070] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:56:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 18:56:01.192889 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b609e-c1bb-4a30-8401-ece0b232d5bb None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:01.288173 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b609e-c1bb-4a30-8401-ece0b232d5bb None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:01.296234 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f8c8e-f7e7-45ba-a870-2361ac3c56d4 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:01.296527 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f8c8e-f7e7-45ba-a870-2361ac3c56d4 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:01.296802 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f8c8e-f7e7-45ba-a870-2361ac3c56d4 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:01.298355 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 538/1071] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:56:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:56:01.303651 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd4437-1cd1-44f9-a895-14a377ef6f06 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:01.304012 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd4437-1cd1-44f9-a895-14a377ef6f06 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:01.304360 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd4437-1cd1-44f9-a895-14a377ef6f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:01.321352 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-57cd4437-1cd1-44f9-a895-14a377ef6f06 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:01.322733 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-57cd4437-1cd1-44f9-a895-14a377ef6f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:01.323339 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f8501-f3a2-4b42-95b6-38d939d9e5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:01.324229 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f8501-f3a2-4b42-95b6-38d939d9e5d5 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:01.324543 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f8501-f3a2-4b42-95b6-38d939d9e5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:01.324779 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f8501-f3a2-4b42-95b6-38d939d9e5d5 None admin] PATH_INFO: `/v3/projects/180cdaa50e2b46528552bac08f3a81a0` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:01.325966 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f8501-f3a2-4b42-95b6-38d939d9e5d5 None admin] RBAC: Authorizing `identity:get_project(project_id=180cdaa50e2b46528552bac08f3a81a0)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:01.327397 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f8501-f3a2-4b42-95b6-38d939d9e5d5 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:01.329256 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 534/1072] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:56:01 2022] GET /identity/v3/projects/180cdaa50e2b46528552bac08f3a81a0 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:01.335177 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f8501-f3a2-4b42-95b6-38d939d9e5d5 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:01.393711 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 539/1073] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:56:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:56:01.416356 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd4437-1cd1-44f9-a895-14a377ef6f06 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:01.434227 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f8501-f3a2-4b42-95b6-38d939d9e5d5 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:01.468534 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3c801-f4df-42b4-ac69-b8558e2eecce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:01.469192 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3c801-f4df-42b4-ac69-b8558e2eecce None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:01.469516 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3c801-f4df-42b4-ac69-b8558e2eecce None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:01.469815 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3c801-f4df-42b4-ac69-b8558e2eecce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:01.470689 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a3c801-f4df-42b4-ac69-b8558e2eecce None admin] RBAC: Adding query filter params (role.id=5a6e54e81bb24eceb618d9ffa67f488e, scope.project.id=180cdaa50e2b46528552bac08f3a81a0, user.id=5b3ff1f011974b8e92aa8f18c31667cd) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:56:01.470999 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a3c801-f4df-42b4-ac69-b8558e2eecce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:01.472479 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a3c801-f4df-42b4-ac69-b8558e2eecce None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:01.489586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 535/1074] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:56:01 2022] GET /identity/v3/role_assignments?user.id=5b3ff1f011974b8e92aa8f18c31667cd&scope.project.id=180cdaa50e2b46528552bac08f3a81a0&role.id=5a6e54e81bb24eceb618d9ffa67f488e => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:56:01.515842 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd4437-1cd1-44f9-a895-14a377ef6f06 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:01.553855 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a79b0-6e41-4d1b-9a9e-a31feb7aa9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:01.554516 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a79b0-6e41-4d1b-9a9e-a31feb7aa9be None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:01.554798 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a79b0-6e41-4d1b-9a9e-a31feb7aa9be None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:01.555040 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a79b0-6e41-4d1b-9a9e-a31feb7aa9be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:01.627441 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a79b0-6e41-4d1b-9a9e-a31feb7aa9be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:01.628835 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a79b0-6e41-4d1b-9a9e-a31feb7aa9be None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:01.728363 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 540/1075] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:56:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 16 18:56:01.734334 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3c801-f4df-42b4-ac69-b8558e2eecce None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:01.832923 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3c801-f4df-42b4-ac69-b8558e2eecce None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:01.868155 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b7c7f-f3bb-4b3a-aa5b-46f92ff4da71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:01.868967 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b7c7f-f3bb-4b3a-aa5b-46f92ff4da71 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:01.869224 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b7c7f-f3bb-4b3a-aa5b-46f92ff4da71 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:01.869513 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b7c7f-f3bb-4b3a-aa5b-46f92ff4da71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:01.881045 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b7c7f-f3bb-4b3a-aa5b-46f92ff4da71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:01.882444 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b7c7f-f3bb-4b3a-aa5b-46f92ff4da71 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:01.901408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-d90b7c7f-f3bb-4b3a-aa5b-46f92ff4da71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:56:01.901408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:56:01.901408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:56:01.901408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:56:01.901408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:56:01.901408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:56:01.901408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:56:01.901408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:56:01.901408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:56:01.901408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:56:01.901408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:56:01.901408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:56:01.901408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:56:01.901408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:56:01.901408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:56:01.902361 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:56:01.902361 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:56:01.902361 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:56:01.902361 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:56:01.902361 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:56:01.902361 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:56:01.902361 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:56:01.902361 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:56:01.902361 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:56:01.902361 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:56:01.902361 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:56:01.902361 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:56:01.902361 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:56:01.902361 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:56:01.902361 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:56:01.902361 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:56:01.902361 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:56:01.908379 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:56:01.908379 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:56:01.908379 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:56:01.908379 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:56:01.908379 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 536/1076] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:56:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:56:01.910577 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a79b0-6e41-4d1b-9a9e-a31feb7aa9be None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:02.014055 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a79b0-6e41-4d1b-9a9e-a31feb7aa9be None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:02.047589 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660cc7e3-1bcf-4bb8-8607-b187d4c384fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:02.048254 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660cc7e3-1bcf-4bb8-8607-b187d4c384fd None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:02.048495 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660cc7e3-1bcf-4bb8-8607-b187d4c384fd None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:02.048794 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660cc7e3-1bcf-4bb8-8607-b187d4c384fd None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:02.049497 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660cc7e3-1bcf-4bb8-8607-b187d4c384fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:56:02.049843 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660cc7e3-1bcf-4bb8-8607-b187d4c384fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:02.051223 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660cc7e3-1bcf-4bb8-8607-b187d4c384fd None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:02.062803 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 541/1077] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:56:02.503603 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a347e-996a-4bb1-9f65-01f9d1078ae4 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:02.503806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a347e-996a-4bb1-9f65-01f9d1078ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:02.504031 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a347e-996a-4bb1-9f65-01f9d1078ae4 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:02.505426 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 537/1078] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:56:02.511362 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ddc64-0991-41a1-92bf-14abb1415fea None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:02.511653 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ddc64-0991-41a1-92bf-14abb1415fea None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:02.511924 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ddc64-0991-41a1-92bf-14abb1415fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:02.529644 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-9a7ddc64-0991-41a1-92bf-14abb1415fea None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:02.530823 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-9a7ddc64-0991-41a1-92bf-14abb1415fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:02.600697 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 542/1079] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:56:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:56:02.624579 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a347e-996a-4bb1-9f65-01f9d1078ae4 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:02.728813 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a347e-996a-4bb1-9f65-01f9d1078ae4 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:02.763870 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36634cc9-5fb9-4780-b263-231e6e07ffe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:02.764780 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36634cc9-5fb9-4780-b263-231e6e07ffe6 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:02.765046 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36634cc9-5fb9-4780-b263-231e6e07ffe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:02.765317 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36634cc9-5fb9-4780-b263-231e6e07ffe6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:02.776945 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36634cc9-5fb9-4780-b263-231e6e07ffe6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:56:02.785113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-36634cc9-5fb9-4780-b263-231e6e07ffe6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 18:56:02.785113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:56:02.785113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:56:02.785113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:56:02.785113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:56:02.785113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:56:02.785113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:56:02.785113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:56:02.785113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:56:02.785113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:56:02.785113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:56:02.785113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:56:02.785113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:56:02.785113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:56:02.785113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:56:02.785113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:56:02.786674 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:56:02.786674 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:56:02.786674 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:56:02.786674 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:56:02.786674 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:56:02.786674 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:56:02.786674 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:56:02.786674 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:56:02.786674 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:56:02.786674 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:56:02.786674 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:56:02.786674 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:56:02.786674 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:56:02.786674 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:56:02.786674 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:56:02.786674 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:56:02.787586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:56:02.787586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:56:02.787586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:56:02.787586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:56:02.787586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:56:02.787586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:56:02.787586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:56:02.787586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:56:02.787586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:56:02.787586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:56:02.787586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 18:56:02.787586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:56:02.787586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 538/1080] 10.222.0.24 () {56 vars in 1120 bytes} [Mon May 16 18:56:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:56:02.793080 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ddc64-0991-41a1-92bf-14abb1415fea None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:02.886762 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ddc64-0991-41a1-92bf-14abb1415fea None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:02.919924 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b716f9a-1529-4c16-a397-8ccd3d0dac29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:02.920584 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b716f9a-1529-4c16-a397-8ccd3d0dac29 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:02.920855 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b716f9a-1529-4c16-a397-8ccd3d0dac29 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:02.921117 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b716f9a-1529-4c16-a397-8ccd3d0dac29 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:02.921889 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b716f9a-1529-4c16-a397-8ccd3d0dac29 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:56:02.922189 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b716f9a-1529-4c16-a397-8ccd3d0dac29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:02.923556 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b716f9a-1529-4c16-a397-8ccd3d0dac29 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:02.931495 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 543/1081] 10.222.0.24 () {56 vars in 1115 bytes} [Mon May 16 18:56:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:02.937479 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36634cc9-5fb9-4780-b263-231e6e07ffe6 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:03.034182 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36634cc9-5fb9-4780-b263-231e6e07ffe6 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:03.067447 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e365db-127e-4778-9ff5-dca23d01b218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:03.068240 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e365db-127e-4778-9ff5-dca23d01b218 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:03.068554 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e365db-127e-4778-9ff5-dca23d01b218 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:03.068825 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e365db-127e-4778-9ff5-dca23d01b218 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:03.079039 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e365db-127e-4778-9ff5-dca23d01b218 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:03.080502 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e365db-127e-4778-9ff5-dca23d01b218 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:03.097166 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-97e365db-127e-4778-9ff5-dca23d01b218 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:56:03.097166 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:56:03.097166 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:56:03.097166 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:56:03.097166 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:56:03.097166 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:56:03.097166 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:56:03.097166 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:56:03.097166 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:56:03.097166 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:56:03.097166 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:56:03.097166 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:56:03.097166 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:56:03.097166 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:56:03.097166 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:56:03.098208 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:56:03.098208 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:56:03.098208 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:56:03.098208 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:56:03.098208 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:56:03.098208 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:56:03.098208 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:56:03.098208 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:56:03.098208 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:56:03.098208 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:56:03.098208 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:56:03.098208 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:56:03.098208 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:56:03.098208 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:56:03.098208 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:56:03.098208 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:56:03.098208 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:56:03.104136 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:56:03.104136 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:56:03.104136 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:56:03.104136 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:56:03.104136 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 539/1082] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:56:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:56:03.104410 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b716f9a-1529-4c16-a397-8ccd3d0dac29 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:03.206586 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b716f9a-1529-4c16-a397-8ccd3d0dac29 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:03.240147 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd0efe-7368-402d-93ed-22250c289293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:03.240861 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd0efe-7368-402d-93ed-22250c289293 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:03.241145 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd0efe-7368-402d-93ed-22250c289293 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:03.241416 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd0efe-7368-402d-93ed-22250c289293 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:03.242153 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd0efe-7368-402d-93ed-22250c289293 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:56:03.242466 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd0efe-7368-402d-93ed-22250c289293 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:03.243851 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd0efe-7368-402d-93ed-22250c289293 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:03.255094 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 544/1083] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:03.260951 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e365db-127e-4778-9ff5-dca23d01b218 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:03.361258 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e365db-127e-4778-9ff5-dca23d01b218 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:03.394987 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a595f63-c457-458f-87da-890fc7b981e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:03.395783 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a595f63-c457-458f-87da-890fc7b981e6 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:03.396057 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a595f63-c457-458f-87da-890fc7b981e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:03.396322 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a595f63-c457-458f-87da-890fc7b981e6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:03.403766 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a595f63-c457-458f-87da-890fc7b981e6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:03.405221 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a595f63-c457-458f-87da-890fc7b981e6 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:03.419108 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-1a595f63-c457-458f-87da-890fc7b981e6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 18:56:03.419108 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:56:03.419108 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:56:03.419108 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:56:03.419108 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:56:03.419108 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:56:03.419108 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:56:03.419108 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:56:03.419108 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:56:03.419108 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:56:03.419108 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:56:03.419108 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:56:03.419108 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:56:03.419108 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:56:03.419108 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:56:03.419108 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:56:03.420058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:56:03.420058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:56:03.420058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:56:03.420058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:56:03.420058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:56:03.420058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:56:03.420058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:56:03.420058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:56:03.420058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:56:03.420058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:56:03.420058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:56:03.420058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:56:03.420058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:56:03.420058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:56:03.420058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:56:03.420058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:56:03.420058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:56:03.420058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:56:03.421023 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:56:03.421023 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:56:03.421023 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:56:03.421023 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:56:03.421023 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:56:03.421023 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:56:03.421023 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:56:03.421023 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:56:03.421023 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 18:56:03.421023 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:56:03.421023 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 540/1084] 10.222.0.24 () {56 vars in 1093 bytes} [Mon May 16 18:56:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:56:03.426238 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd0efe-7368-402d-93ed-22250c289293 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:03.527631 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd0efe-7368-402d-93ed-22250c289293 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:03.561947 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ddce7-1dab-47c7-94eb-91ff799f66d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:03.562640 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ddce7-1dab-47c7-94eb-91ff799f66d0 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:03.562927 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ddce7-1dab-47c7-94eb-91ff799f66d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:03.563210 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ddce7-1dab-47c7-94eb-91ff799f66d0 None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:03.564046 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0ddce7-1dab-47c7-94eb-91ff799f66d0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:56:03.564352 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0ddce7-1dab-47c7-94eb-91ff799f66d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:03.565826 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0ddce7-1dab-47c7-94eb-91ff799f66d0 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:03.583638 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 545/1085] 10.222.0.24 () {56 vars in 1133 bytes} [Mon May 16 18:56:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:03.590076 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a595f63-c457-458f-87da-890fc7b981e6 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:03.693151 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a595f63-c457-458f-87da-890fc7b981e6 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:03.693376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04dd275-b511-4e3f-a90a-f25f95c4f377 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:03.693823 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04dd275-b511-4e3f-a90a-f25f95c4f377 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:03.694399 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04dd275-b511-4e3f-a90a-f25f95c4f377 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:03.695766 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 546/1086] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:56:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:56:03.700807 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47774d37-c789-412a-8d74-42042cd6e948 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:03.701086 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47774d37-c789-412a-8d74-42042cd6e948 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:03.701361 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47774d37-c789-412a-8d74-42042cd6e948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:03.718095 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-47774d37-c789-412a-8d74-42042cd6e948 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:03.719283 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-47774d37-c789-412a-8d74-42042cd6e948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:03.729387 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22a14f-8cf9-43b6-8620-099799f3a0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:03.730072 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22a14f-8cf9-43b6-8620-099799f3a0a6 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:03.730357 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22a14f-8cf9-43b6-8620-099799f3a0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:03.730634 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22a14f-8cf9-43b6-8620-099799f3a0a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:03.784314 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 547/1087] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:56:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 18:56:03.793426 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e22a14f-8cf9-43b6-8620-099799f3a0a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:03.794916 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e22a14f-8cf9-43b6-8620-099799f3a0a6 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:03.807259 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47774d37-c789-412a-8d74-42042cd6e948 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:03.890668 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 541/1088] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:56:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 18:56:03.896723 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22a14f-8cf9-43b6-8620-099799f3a0a6 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:03.904718 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47774d37-c789-412a-8d74-42042cd6e948 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:03.944347 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c92e8-3b11-4572-b288-0bb4e046d04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:03.945063 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c92e8-3b11-4572-b288-0bb4e046d04f None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:03.945339 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c92e8-3b11-4572-b288-0bb4e046d04f None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:03.945605 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c92e8-3b11-4572-b288-0bb4e046d04f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:03.955654 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c92e8-3b11-4572-b288-0bb4e046d04f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:56:03.963392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-c19c92e8-3b11-4572-b288-0bb4e046d04f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:56:03.963392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:56:03.963392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:56:03.963392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:56:03.963392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:56:03.963392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:56:03.963392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:56:03.963392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:56:03.963392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:56:03.963392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:56:03.963392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:56:03.963392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:56:03.963392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:56:03.963392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:56:03.963392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:56:03.963392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:56:03.964376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:56:03.964376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:56:03.964376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:56:03.964376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:56:03.964376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:56:03.964376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:56:03.964376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:56:03.964376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:56:03.964376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:56:03.964376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:56:03.964376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:56:03.964376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:56:03.964376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:56:03.964376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:56:03.964376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:56:03.964376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:56:03.965225 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:56:03.965225 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:56:03.965225 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:56:03.965225 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:56:03.965225 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:56:03.965225 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:56:03.965225 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:56:03.965225 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:56:03.965225 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:56:03.965225 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:56:03.965225 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:56:03.965225 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:56:03.965225 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 548/1089] 10.222.0.24 () {56 vars in 1096 bytes} [Mon May 16 18:56:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:56:03.970795 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c92e8-3b11-4572-b288-0bb4e046d04f None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:04.003835 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22a14f-8cf9-43b6-8620-099799f3a0a6 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:04.037408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c673a-2197-4d4d-8be1-637b879095e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:04.038221 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c673a-2197-4d4d-8be1-637b879095e8 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:04.038495 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c673a-2197-4d4d-8be1-637b879095e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:04.038763 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c673a-2197-4d4d-8be1-637b879095e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:04.048285 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c673a-2197-4d4d-8be1-637b879095e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:04.049757 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c673a-2197-4d4d-8be1-637b879095e8 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:04.066376 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-0b3c673a-2197-4d4d-8be1-637b879095e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:56:04.066376 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:56:04.066376 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:56:04.066376 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:56:04.066376 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:56:04.066376 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:56:04.066376 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:56:04.066376 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:56:04.066376 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:56:04.066376 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:56:04.066376 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:56:04.066376 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:56:04.066376 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:56:04.066376 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:56:04.066376 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:56:04.067412 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:56:04.067412 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:56:04.067412 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:56:04.067412 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:56:04.067412 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:56:04.067412 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:56:04.067412 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:56:04.067412 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:56:04.067412 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:56:04.067412 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:56:04.067412 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:56:04.067412 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:56:04.067412 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:56:04.067412 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:56:04.067412 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:56:04.067412 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:56:04.067412 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:56:04.068363 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:56:04.068363 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:56:04.068363 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:56:04.068363 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:56:04.068603 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c92e8-3b11-4572-b288-0bb4e046d04f None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:04.068678 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 542/1090] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:56:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:56:04.073484 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c673a-2197-4d4d-8be1-637b879095e8 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:04.102068 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1971002-ed07-4a02-bd05-da5b3b3091a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:04.102738 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1971002-ed07-4a02-bd05-da5b3b3091a2 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:04.103022 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1971002-ed07-4a02-bd05-da5b3b3091a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:04.103263 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1971002-ed07-4a02-bd05-da5b3b3091a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:04.104027 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1971002-ed07-4a02-bd05-da5b3b3091a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:56:04.104327 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1971002-ed07-4a02-bd05-da5b3b3091a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:04.105721 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1971002-ed07-4a02-bd05-da5b3b3091a2 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:04.113415 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 549/1091] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:56:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:56:04.119452 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1971002-ed07-4a02-bd05-da5b3b3091a2 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:04.168861 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c673a-2197-4d4d-8be1-637b879095e8 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:04.200930 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ce210-069e-4e96-bf0b-825267856f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:04.201506 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ce210-069e-4e96-bf0b-825267856f9b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:04.201808 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ce210-069e-4e96-bf0b-825267856f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:04.202072 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ce210-069e-4e96-bf0b-825267856f9b None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:04.202778 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ce210-069e-4e96-bf0b-825267856f9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:56:04.203077 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ce210-069e-4e96-bf0b-825267856f9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:04.204462 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ce210-069e-4e96-bf0b-825267856f9b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:04.213079 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1971002-ed07-4a02-bd05-da5b3b3091a2 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:04.215089 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 543/1092] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:56:04.220591 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ce210-069e-4e96-bf0b-825267856f9b None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:04.245086 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc21d7-dad2-4b86-b857-61f54175c33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:04.246005 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc21d7-dad2-4b86-b857-61f54175c33a None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:04.246286 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc21d7-dad2-4b86-b857-61f54175c33a None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:04.246556 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc21d7-dad2-4b86-b857-61f54175c33a None admin] PATH_INFO: `/v3/users/5b3ff1f011974b8e92aa8f18c31667cd` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:04.247764 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc21d7-dad2-4b86-b857-61f54175c33a None admin] RBAC: Authorizing `identity:get_user(user_id=5b3ff1f011974b8e92aa8f18c31667cd)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:04.249211 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc21d7-dad2-4b86-b857-61f54175c33a None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:04.255576 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 550/1093] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:56:04 2022] GET /identity/v3/users/5b3ff1f011974b8e92aa8f18c31667cd => generated 285 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:04.256517 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc21d7-dad2-4b86-b857-61f54175c33a None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:04.316988 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ce210-069e-4e96-bf0b-825267856f9b None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:04.347946 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192af6a-6499-4de2-a5b5-5ac4de4208a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:04.348735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192af6a-6499-4de2-a5b5-5ac4de4208a3 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:04.349014 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192af6a-6499-4de2-a5b5-5ac4de4208a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:04.349279 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192af6a-6499-4de2-a5b5-5ac4de4208a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:04.355826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a192af6a-6499-4de2-a5b5-5ac4de4208a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:04.356486 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc21d7-dad2-4b86-b857-61f54175c33a None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:04.357256 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a192af6a-6499-4de2-a5b5-5ac4de4208a3 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:04.370928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-a192af6a-6499-4de2-a5b5-5ac4de4208a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:56:04.370928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:56:04.370928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:56:04.370928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:56:04.370928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:56:04.370928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:56:04.370928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:56:04.370928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:56:04.370928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:56:04.370928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:56:04.370928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:56:04.370928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:56:04.370928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:56:04.370928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:56:04.370928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:56:04.371969 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:56:04.371969 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:56:04.371969 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:56:04.371969 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:56:04.371969 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:56:04.371969 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:56:04.371969 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:56:04.371969 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:56:04.371969 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:56:04.371969 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:56:04.371969 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:56:04.371969 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:56:04.371969 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:56:04.371969 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:56:04.371969 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:56:04.371969 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:56:04.371969 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:56:04.372864 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:56:04.372864 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:56:04.372864 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:56:04.372864 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:56:04.372864 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:56:04.372864 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:56:04.372864 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:56:04.372864 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:56:04.372864 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 544/1094] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:56:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:56:04.377883 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192af6a-6499-4de2-a5b5-5ac4de4208a3 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:04.390930 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caffe3ce-d03e-426a-b656-5337605f156f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:04.391807 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffe3ce-d03e-426a-b656-5337605f156f None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:04.392091 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffe3ce-d03e-426a-b656-5337605f156f None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:04.392364 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffe3ce-d03e-426a-b656-5337605f156f None admin] PATH_INFO: `/v3/projects/180cdaa50e2b46528552bac08f3a81a0` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:04.393572 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caffe3ce-d03e-426a-b656-5337605f156f None admin] RBAC: Authorizing `identity:get_project(project_id=180cdaa50e2b46528552bac08f3a81a0)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:04.395064 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caffe3ce-d03e-426a-b656-5337605f156f None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:04.396772 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 551/1095] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:56:04 2022] GET /identity/v3/projects/180cdaa50e2b46528552bac08f3a81a0 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:04.402490 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caffe3ce-d03e-426a-b656-5337605f156f None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:04.472851 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192af6a-6499-4de2-a5b5-5ac4de4208a3 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:04.499682 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caffe3ce-d03e-426a-b656-5337605f156f None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:04.505141 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad201e-3126-4bfc-9190-92b3aaf39987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:04.505829 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad201e-3126-4bfc-9190-92b3aaf39987 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:04.506110 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad201e-3126-4bfc-9190-92b3aaf39987 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:04.506381 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad201e-3126-4bfc-9190-92b3aaf39987 None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:04.507141 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad201e-3126-4bfc-9190-92b3aaf39987 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:56:04.507424 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad201e-3126-4bfc-9190-92b3aaf39987 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:04.508862 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad201e-3126-4bfc-9190-92b3aaf39987 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:04.520092 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 545/1096] 10.222.0.24 () {56 vars in 1148 bytes} [Mon May 16 18:56:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:56:04.526198 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad201e-3126-4bfc-9190-92b3aaf39987 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:04.534064 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d1fd1-3bec-4c7c-9d98-264dc0a22148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:04.534962 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d1fd1-3bec-4c7c-9d98-264dc0a22148 None admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:04.535238 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d1fd1-3bec-4c7c-9d98-264dc0a22148 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:04.535867 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d1fd1-3bec-4c7c-9d98-264dc0a22148 None admin] PATH_INFO: `/v3/projects/180cdaa50e2b46528552bac08f3a81a0/users/5b3ff1f011974b8e92aa8f18c31667cd/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:04.537976 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d1fd1-3bec-4c7c-9d98-264dc0a22148 None admin] RBAC: Authorizing `identity:create_grant(project_id=180cdaa50e2b46528552bac08f3a81a0, user_id=5b3ff1f011974b8e92aa8f18c31667cd, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:04.539440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d1fd1-3bec-4c7c-9d98-264dc0a22148 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:04.552873 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 552/1097] 10.222.0.24 () {58 vars in 1439 bytes} [Mon May 16 18:56:04 2022] PUT /identity/v3/projects/180cdaa50e2b46528552bac08f3a81a0/users/5b3ff1f011974b8e92aa8f18c31667cd/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:56:04.631701 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad201e-3126-4bfc-9190-92b3aaf39987 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:04.668146 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00194ed7-205b-42f9-9483-137883a3912f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:04.668836 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00194ed7-205b-42f9-9483-137883a3912f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:04.669115 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00194ed7-205b-42f9-9483-137883a3912f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:04.669385 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00194ed7-205b-42f9-9483-137883a3912f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:04.670256 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00194ed7-205b-42f9-9483-137883a3912f None admin] RBAC: Adding query filter params (role.id=1abd30a5bbfb45a1ab6de390e19a6c70, scope.project.id=084e70bbad784892b195bb11a68bf857, user.id=1f03aa520ee14615b802cdbc3cd4f87d) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:56:04.670563 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00194ed7-205b-42f9-9483-137883a3912f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:04.672037 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00194ed7-205b-42f9-9483-137883a3912f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:04.678686 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 546/1098] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:56:04 2022] GET /identity/v3/role_assignments?user.id=1f03aa520ee14615b802cdbc3cd4f87d&scope.project.id=084e70bbad784892b195bb11a68bf857&role.id=1abd30a5bbfb45a1ab6de390e19a6c70 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:56:06.739792 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad0547-2bc4-40ab-92bc-5398296fa518 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:06.740849 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad0547-2bc4-40ab-92bc-5398296fa518 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:06.740849 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad0547-2bc4-40ab-92bc-5398296fa518 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:06.741923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 553/1099] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:56:06.750125 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c90f87-5106-47c9-8c65-6d79c66819bb None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:06.750875 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c90f87-5106-47c9-8c65-6d79c66819bb None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:06.751020 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c90f87-5106-47c9-8c65-6d79c66819bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:06.776754 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-65c90f87-5106-47c9-8c65-6d79c66819bb None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:06.777981 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-65c90f87-5106-47c9-8c65-6d79c66819bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:06.857545 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 547/1100] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:56:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:56:06.890808 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad0547-2bc4-40ab-92bc-5398296fa518 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:06.996441 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad0547-2bc4-40ab-92bc-5398296fa518 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:07.029080 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825c656-bf56-41a3-8e5c-db615b26e7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:07.029891 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825c656-bf56-41a3-8e5c-db615b26e7e2 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:07.030165 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825c656-bf56-41a3-8e5c-db615b26e7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:07.030431 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825c656-bf56-41a3-8e5c-db615b26e7e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:07.040457 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825c656-bf56-41a3-8e5c-db615b26e7e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:56:07.048019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-d825c656-bf56-41a3-8e5c-db615b26e7e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:56:07.048019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:56:07.048019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:56:07.048019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:56:07.048019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:56:07.048019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:56:07.048019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:56:07.048019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:56:07.048019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:56:07.048019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:56:07.048019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:56:07.048019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:56:07.048019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:56:07.048019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:56:07.048019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:56:07.048019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:56:07.049109 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:56:07.049109 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:56:07.049109 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:56:07.049109 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:56:07.049109 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:56:07.049109 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:56:07.049109 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:56:07.049109 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:56:07.049109 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:56:07.049109 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:56:07.049109 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:56:07.049109 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:56:07.049109 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:56:07.049109 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:56:07.049109 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:56:07.049109 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:56:07.050190 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:56:07.050190 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:56:07.050190 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:56:07.050190 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:56:07.050190 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:56:07.050190 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:56:07.050190 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:56:07.050190 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:56:07.050190 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:56:07.050190 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:56:07.050190 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:56:07.050190 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:56:07.053711 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 554/1101] 10.222.0.24 () {56 vars in 1096 bytes} [Mon May 16 18:56:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:56:07.055888 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c90f87-5106-47c9-8c65-6d79c66819bb None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:07.157221 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c90f87-5106-47c9-8c65-6d79c66819bb None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:07.191720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c372d2ca-f38a-43b6-bff6-e29d5bd419b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:07.192387 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372d2ca-f38a-43b6-bff6-e29d5bd419b8 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:07.192669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372d2ca-f38a-43b6-bff6-e29d5bd419b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:07.192941 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372d2ca-f38a-43b6-bff6-e29d5bd419b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:07.193812 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c372d2ca-f38a-43b6-bff6-e29d5bd419b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:56:07.194122 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c372d2ca-f38a-43b6-bff6-e29d5bd419b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:07.195603 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c372d2ca-f38a-43b6-bff6-e29d5bd419b8 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:07.203618 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 548/1102] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:56:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:56:07.212828 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825c656-bf56-41a3-8e5c-db615b26e7e2 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:07.313926 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825c656-bf56-41a3-8e5c-db615b26e7e2 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:07.347563 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbcc590-158e-418c-ad76-20784291db52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:07.348424 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcc590-158e-418c-ad76-20784291db52 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:07.348701 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcc590-158e-418c-ad76-20784291db52 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:07.348969 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcc590-158e-418c-ad76-20784291db52 None admin] PATH_INFO: `/v3/users/5b3ff1f011974b8e92aa8f18c31667cd` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:07.350369 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbcc590-158e-418c-ad76-20784291db52 None admin] RBAC: Authorizing `identity:get_user(user_id=5b3ff1f011974b8e92aa8f18c31667cd)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:07.351806 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbcc590-158e-418c-ad76-20784291db52 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:07.353425 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 555/1103] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:56:07 2022] GET /identity/v3/users/5b3ff1f011974b8e92aa8f18c31667cd => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:07.359300 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c372d2ca-f38a-43b6-bff6-e29d5bd419b8 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:07.463731 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c372d2ca-f38a-43b6-bff6-e29d5bd419b8 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:07.498581 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf142046-7579-4367-9138-298a1c01e622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:07.499216 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf142046-7579-4367-9138-298a1c01e622 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:07.499498 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf142046-7579-4367-9138-298a1c01e622 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:07.499770 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf142046-7579-4367-9138-298a1c01e622 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:07.570026 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf142046-7579-4367-9138-298a1c01e622 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:07.571473 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf142046-7579-4367-9138-298a1c01e622 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:07.671569 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 549/1104] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:56:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 18:56:07.678025 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbcc590-158e-418c-ad76-20784291db52 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:07.773846 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbcc590-158e-418c-ad76-20784291db52 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:07.807748 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a981f48-4230-4903-8728-a1ec262f5252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:07.808604 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a981f48-4230-4903-8728-a1ec262f5252 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:07.808882 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a981f48-4230-4903-8728-a1ec262f5252 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:07.809156 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a981f48-4230-4903-8728-a1ec262f5252 None admin] PATH_INFO: `/v3/projects/180cdaa50e2b46528552bac08f3a81a0` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:07.810442 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a981f48-4230-4903-8728-a1ec262f5252 None admin] RBAC: Authorizing `identity:get_project(project_id=180cdaa50e2b46528552bac08f3a81a0)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:07.811901 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a981f48-4230-4903-8728-a1ec262f5252 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:07.813583 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 556/1105] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:56:07 2022] GET /identity/v3/projects/180cdaa50e2b46528552bac08f3a81a0 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:07.819987 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf142046-7579-4367-9138-298a1c01e622 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:07.921008 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf142046-7579-4367-9138-298a1c01e622 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:07.954482 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aeda17-0285-410f-ac0d-bac90d022aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:07.955117 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aeda17-0285-410f-ac0d-bac90d022aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:07.955393 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aeda17-0285-410f-ac0d-bac90d022aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:07.955664 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aeda17-0285-410f-ac0d-bac90d022aa2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:07.956491 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aeda17-0285-410f-ac0d-bac90d022aa2 None admin] RBAC: Adding query filter params (role.id=5a6e54e81bb24eceb618d9ffa67f488e, scope.project.id=180cdaa50e2b46528552bac08f3a81a0, user.id=5b3ff1f011974b8e92aa8f18c31667cd) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:56:07.956803 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aeda17-0285-410f-ac0d-bac90d022aa2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:07.958337 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aeda17-0285-410f-ac0d-bac90d022aa2 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:07.964164 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 550/1106] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:56:07 2022] GET /identity/v3/role_assignments?user.id=5b3ff1f011974b8e92aa8f18c31667cd&scope.project.id=180cdaa50e2b46528552bac08f3a81a0&role.id=5a6e54e81bb24eceb618d9ffa67f488e => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:10.178143 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144a0f7-1d7d-4bb0-90fe-6166115d1ae8 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:10.178605 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144a0f7-1d7d-4bb0-90fe-6166115d1ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:10.178704 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144a0f7-1d7d-4bb0-90fe-6166115d1ae8 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:10.180054 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 557/1107] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:56:10.186602 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac055b7-ccca-4acf-96f6-8a79800edfd0 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:10.187314 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac055b7-ccca-4acf-96f6-8a79800edfd0 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:10.187419 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac055b7-ccca-4acf-96f6-8a79800edfd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:10.207023 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-0ac055b7-ccca-4acf-96f6-8a79800edfd0 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:10.208236 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0ac055b7-ccca-4acf-96f6-8a79800edfd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:10.276136 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 551/1108] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:56:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:56:10.305066 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144a0f7-1d7d-4bb0-90fe-6166115d1ae8 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:10.419265 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144a0f7-1d7d-4bb0-90fe-6166115d1ae8 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:10.452966 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a2bc7-4422-4b24-82ec-381216d41299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:10.453786 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a2bc7-4422-4b24-82ec-381216d41299 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:10.454066 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a2bc7-4422-4b24-82ec-381216d41299 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:10.454336 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a2bc7-4422-4b24-82ec-381216d41299 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:10.455631 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a2bc7-4422-4b24-82ec-381216d41299 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:10.457102 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a2bc7-4422-4b24-82ec-381216d41299 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:10.458813 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 558/1109] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:56:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:10.465647 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac055b7-ccca-4acf-96f6-8a79800edfd0 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:10.573840 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac055b7-ccca-4acf-96f6-8a79800edfd0 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:10.607701 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1f646-2e27-435f-bc1e-c97edacfaff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:10.608363 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1f646-2e27-435f-bc1e-c97edacfaff0 None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:10.608643 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1f646-2e27-435f-bc1e-c97edacfaff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:10.608919 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1f646-2e27-435f-bc1e-c97edacfaff0 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:10.609657 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f1f646-2e27-435f-bc1e-c97edacfaff0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:10.611097 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f1f646-2e27-435f-bc1e-c97edacfaff0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:10.631650 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 552/1110] 10.222.0.24 () {60 vars in 1132 bytes} [Mon May 16 18:56:10 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:56:12.864404 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07804d-6d59-45b1-85b6-623bc9d3da45 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:12.865422 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07804d-6d59-45b1-85b6-623bc9d3da45 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:12.865803 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07804d-6d59-45b1-85b6-623bc9d3da45 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:12.867981 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 559/1111] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:56:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:56:12.873634 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99615003-e005-453a-91ed-912cba15e4d4 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:12.874068 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99615003-e005-453a-91ed-912cba15e4d4 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:12.874168 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99615003-e005-453a-91ed-912cba15e4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:12.892474 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-99615003-e005-453a-91ed-912cba15e4d4 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:12.893680 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-99615003-e005-453a-91ed-912cba15e4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:12.958992 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 553/1112] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:56:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:56:12.982816 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07804d-6d59-45b1-85b6-623bc9d3da45 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:13.086065 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07804d-6d59-45b1-85b6-623bc9d3da45 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:13.119941 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4874d9e-9ee5-4d09-8802-f5c200d561a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:13.120724 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4874d9e-9ee5-4d09-8802-f5c200d561a1 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:13.121001 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4874d9e-9ee5-4d09-8802-f5c200d561a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:13.121269 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4874d9e-9ee5-4d09-8802-f5c200d561a1 None admin] PATH_INFO: `/v3/roles/fda97f4c5b1f4e1ba165f8dfa70ddbd6` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:13.122834 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4874d9e-9ee5-4d09-8802-f5c200d561a1 None admin] RBAC: Authorizing `identity:get_role(role_id=fda97f4c5b1f4e1ba165f8dfa70ddbd6)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:13.124213 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4874d9e-9ee5-4d09-8802-f5c200d561a1 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:13.125644 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 560/1113] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:56:12 2022] GET /identity/v3/roles/fda97f4c5b1f4e1ba165f8dfa70ddbd6 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:13.131934 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99615003-e005-453a-91ed-912cba15e4d4 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:13.232126 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99615003-e005-453a-91ed-912cba15e4d4 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:13.265757 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad463b86-11d8-4abb-8b49-c40609bc0535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:13.266619 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad463b86-11d8-4abb-8b49-c40609bc0535 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:13.266902 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad463b86-11d8-4abb-8b49-c40609bc0535 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:13.267172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad463b86-11d8-4abb-8b49-c40609bc0535 None admin] PATH_INFO: `/v3/users/3fd5bef3e27d4e488f43237d1accaffa` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:13.280382 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad463b86-11d8-4abb-8b49-c40609bc0535 None admin] RBAC: Authorizing `identity:get_user(user_id=3fd5bef3e27d4e488f43237d1accaffa)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:13.281879 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad463b86-11d8-4abb-8b49-c40609bc0535 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:13.283517 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 554/1114] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:56:13 2022] GET /identity/v3/users/3fd5bef3e27d4e488f43237d1accaffa => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:13.290650 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4874d9e-9ee5-4d09-8802-f5c200d561a1 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:13.399507 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4874d9e-9ee5-4d09-8802-f5c200d561a1 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:13.434738 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591032b-f7bb-4d61-978d-f6113a4429a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:13.435374 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591032b-f7bb-4d61-978d-f6113a4429a1 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:13.435654 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591032b-f7bb-4d61-978d-f6113a4429a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:13.435927 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591032b-f7bb-4d61-978d-f6113a4429a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:13.502166 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591032b-f7bb-4d61-978d-f6113a4429a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:13.503611 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591032b-f7bb-4d61-978d-f6113a4429a1 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:13.604787 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 561/1115] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:56:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 18:56:13.611303 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad463b86-11d8-4abb-8b49-c40609bc0535 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:13.711890 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad463b86-11d8-4abb-8b49-c40609bc0535 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:13.753552 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd860663-b717-4e07-9515-6e2cd5c4373c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:13.754440 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd860663-b717-4e07-9515-6e2cd5c4373c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:13.754710 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd860663-b717-4e07-9515-6e2cd5c4373c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:13.754974 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd860663-b717-4e07-9515-6e2cd5c4373c None admin] PATH_INFO: `/v3/projects/180cdaa50e2b46528552bac08f3a81a0` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:13.756298 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd860663-b717-4e07-9515-6e2cd5c4373c None admin] RBAC: Authorizing `identity:get_project(project_id=180cdaa50e2b46528552bac08f3a81a0)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:13.757759 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd860663-b717-4e07-9515-6e2cd5c4373c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:13.759455 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 555/1116] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:56:13 2022] GET /identity/v3/projects/180cdaa50e2b46528552bac08f3a81a0 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:13.769791 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591032b-f7bb-4d61-978d-f6113a4429a1 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:13.872107 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591032b-f7bb-4d61-978d-f6113a4429a1 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:13.909995 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037c729-2625-4d61-8209-8449eebb3a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:13.911267 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037c729-2625-4d61-8209-8449eebb3a2b None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:13.911716 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037c729-2625-4d61-8209-8449eebb3a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:13.911983 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037c729-2625-4d61-8209-8449eebb3a2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:13.912804 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4037c729-2625-4d61-8209-8449eebb3a2b None admin] RBAC: Adding query filter params (role.id=fda97f4c5b1f4e1ba165f8dfa70ddbd6, scope.project.id=180cdaa50e2b46528552bac08f3a81a0, user.id=3fd5bef3e27d4e488f43237d1accaffa) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:56:13.913127 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4037c729-2625-4d61-8209-8449eebb3a2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:13.914597 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4037c729-2625-4d61-8209-8449eebb3a2b None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:13.920291 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 562/1117] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:56:13 2022] GET /identity/v3/role_assignments?user.id=3fd5bef3e27d4e488f43237d1accaffa&scope.project.id=180cdaa50e2b46528552bac08f3a81a0&role.id=fda97f4c5b1f4e1ba165f8dfa70ddbd6 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:16.102742 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a79f0-1750-4260-a083-c1e18a78ad5a None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:16.103304 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a79f0-1750-4260-a083-c1e18a78ad5a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:16.103304 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a79f0-1750-4260-a083-c1e18a78ad5a None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:16.104669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 556/1118] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:56:16.111244 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d0f77-d62e-48f1-b788-f7a64ef45a20 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:16.111985 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d0f77-d62e-48f1-b788-f7a64ef45a20 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:16.112112 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d0f77-d62e-48f1-b788-f7a64ef45a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:16.137381 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-138d0f77-d62e-48f1-b788-f7a64ef45a20 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:16.138619 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-138d0f77-d62e-48f1-b788-f7a64ef45a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:16.220237 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 563/1119] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:56:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:56:16.243460 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a79f0-1750-4260-a083-c1e18a78ad5a None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:16.347780 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a79f0-1750-4260-a083-c1e18a78ad5a None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:16.381314 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7005cd8-19a3-4df1-bf4a-2e70d33d3816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:16.382113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7005cd8-19a3-4df1-bf4a-2e70d33d3816 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:16.382389 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7005cd8-19a3-4df1-bf4a-2e70d33d3816 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:16.382656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7005cd8-19a3-4df1-bf4a-2e70d33d3816 None admin] PATH_INFO: `/v3/roles/fda97f4c5b1f4e1ba165f8dfa70ddbd6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:16.384220 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7005cd8-19a3-4df1-bf4a-2e70d33d3816 None admin] RBAC: Authorizing `identity:get_role(role_id=fda97f4c5b1f4e1ba165f8dfa70ddbd6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:16.385587 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7005cd8-19a3-4df1-bf4a-2e70d33d3816 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:16.386963 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 557/1120] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:56:16 2022] GET /identity/v3/roles/fda97f4c5b1f4e1ba165f8dfa70ddbd6 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:16.393718 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d0f77-d62e-48f1-b788-f7a64ef45a20 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:16.501151 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d0f77-d62e-48f1-b788-f7a64ef45a20 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:16.536262 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47fe937-50e0-498a-abd4-8fe4472f15e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:16.537138 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fe937-50e0-498a-abd4-8fe4472f15e9 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:16.537415 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fe937-50e0-498a-abd4-8fe4472f15e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:16.537714 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fe937-50e0-498a-abd4-8fe4472f15e9 None admin] PATH_INFO: `/v3/users/3fd5bef3e27d4e488f43237d1accaffa` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:16.538907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47fe937-50e0-498a-abd4-8fe4472f15e9 None admin] RBAC: Authorizing `identity:get_user(user_id=3fd5bef3e27d4e488f43237d1accaffa)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:16.540365 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47fe937-50e0-498a-abd4-8fe4472f15e9 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:16.542046 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 564/1121] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:56:16 2022] GET /identity/v3/users/3fd5bef3e27d4e488f43237d1accaffa => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:16.551120 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7005cd8-19a3-4df1-bf4a-2e70d33d3816 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:16.659541 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7005cd8-19a3-4df1-bf4a-2e70d33d3816 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:16.693164 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5503789-ccfd-4ffe-8b9d-6d46d44777ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:16.694046 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5503789-ccfd-4ffe-8b9d-6d46d44777ec None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:16.694319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5503789-ccfd-4ffe-8b9d-6d46d44777ec None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:16.694587 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5503789-ccfd-4ffe-8b9d-6d46d44777ec None admin] PATH_INFO: `/v3/projects/180cdaa50e2b46528552bac08f3a81a0` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:16.695872 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5503789-ccfd-4ffe-8b9d-6d46d44777ec None admin] RBAC: Authorizing `identity:get_project(project_id=180cdaa50e2b46528552bac08f3a81a0)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:16.697292 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5503789-ccfd-4ffe-8b9d-6d46d44777ec None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:16.698993 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 558/1122] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:56:16 2022] GET /identity/v3/projects/180cdaa50e2b46528552bac08f3a81a0 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:16.707643 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47fe937-50e0-498a-abd4-8fe4472f15e9 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:16.819941 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47fe937-50e0-498a-abd4-8fe4472f15e9 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:16.857350 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b8b14-bf60-4dd4-a54c-068fd86ec7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:16.858274 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b8b14-bf60-4dd4-a54c-068fd86ec7c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:16.858550 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b8b14-bf60-4dd4-a54c-068fd86ec7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:16.858822 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b8b14-bf60-4dd4-a54c-068fd86ec7c7 None admin] PATH_INFO: `/v3/projects/180cdaa50e2b46528552bac08f3a81a0/users/3fd5bef3e27d4e488f43237d1accaffa/roles/fda97f4c5b1f4e1ba165f8dfa70ddbd6` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:16.861414 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b8b14-bf60-4dd4-a54c-068fd86ec7c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=180cdaa50e2b46528552bac08f3a81a0, user_id=3fd5bef3e27d4e488f43237d1accaffa, role_id=fda97f4c5b1f4e1ba165f8dfa70ddbd6)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:16.862891 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b8b14-bf60-4dd4-a54c-068fd86ec7c7 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:16.881951 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 565/1123] 10.222.0.24 () {58 vars in 1439 bytes} [Mon May 16 18:56:16 2022] PUT /identity/v3/projects/180cdaa50e2b46528552bac08f3a81a0/users/3fd5bef3e27d4e488f43237d1accaffa/roles/fda97f4c5b1f4e1ba165f8dfa70ddbd6 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:19.079969 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30f29c-9309-468c-89f7-48c901904dc0 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:19.080862 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30f29c-9309-468c-89f7-48c901904dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:19.080862 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30f29c-9309-468c-89f7-48c901904dc0 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:19.083122 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 559/1124] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:56:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:56:19.088514 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c481ef-d4c0-43da-97cb-499d370d975d None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:19.088927 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c481ef-d4c0-43da-97cb-499d370d975d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:19.089043 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c481ef-d4c0-43da-97cb-499d370d975d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:19.106927 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-26c481ef-d4c0-43da-97cb-499d370d975d None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:19.108103 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-26c481ef-d4c0-43da-97cb-499d370d975d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:19.175422 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 566/1125] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:56:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:56:19.199175 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30f29c-9309-468c-89f7-48c901904dc0 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:19.303028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30f29c-9309-468c-89f7-48c901904dc0 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:19.342770 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d484b-8f2a-4f8c-846c-edbf32c5234c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:19.343575 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d484b-8f2a-4f8c-846c-edbf32c5234c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:19.343853 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d484b-8f2a-4f8c-846c-edbf32c5234c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:19.344121 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d484b-8f2a-4f8c-846c-edbf32c5234c None admin] PATH_INFO: `/v3/roles/fda97f4c5b1f4e1ba165f8dfa70ddbd6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:19.345672 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d484b-8f2a-4f8c-846c-edbf32c5234c None admin] RBAC: Authorizing `identity:get_role(role_id=fda97f4c5b1f4e1ba165f8dfa70ddbd6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:19.347078 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d484b-8f2a-4f8c-846c-edbf32c5234c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:19.348470 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 560/1126] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:56:19 2022] GET /identity/v3/roles/fda97f4c5b1f4e1ba165f8dfa70ddbd6 => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:19.358317 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c481ef-d4c0-43da-97cb-499d370d975d None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:19.463739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c481ef-d4c0-43da-97cb-499d370d975d None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:19.499346 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46ab7d-fa55-467a-8e0a-e44e818c8504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:19.500224 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46ab7d-fa55-467a-8e0a-e44e818c8504 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:19.500563 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46ab7d-fa55-467a-8e0a-e44e818c8504 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:19.500839 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46ab7d-fa55-467a-8e0a-e44e818c8504 None admin] PATH_INFO: `/v3/users/3fd5bef3e27d4e488f43237d1accaffa` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:19.502088 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a46ab7d-fa55-467a-8e0a-e44e818c8504 None admin] RBAC: Authorizing `identity:get_user(user_id=3fd5bef3e27d4e488f43237d1accaffa)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:19.503530 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a46ab7d-fa55-467a-8e0a-e44e818c8504 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:19.505157 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 567/1127] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:56:19 2022] GET /identity/v3/users/3fd5bef3e27d4e488f43237d1accaffa => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:19.511058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d484b-8f2a-4f8c-846c-edbf32c5234c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:19.618029 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d484b-8f2a-4f8c-846c-edbf32c5234c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:19.658367 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769be13-4300-4daf-b3eb-36fb3519f9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:19.659008 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769be13-4300-4daf-b3eb-36fb3519f9eb None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:19.659281 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769be13-4300-4daf-b3eb-36fb3519f9eb None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:19.659547 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769be13-4300-4daf-b3eb-36fb3519f9eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:19.727326 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3769be13-4300-4daf-b3eb-36fb3519f9eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:19.728777 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3769be13-4300-4daf-b3eb-36fb3519f9eb None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:19.820710 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 561/1128] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:56:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 18:56:19.830811 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46ab7d-fa55-467a-8e0a-e44e818c8504 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:19.934715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46ab7d-fa55-467a-8e0a-e44e818c8504 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:19.968049 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73eaa0d-8f7a-4466-9189-f1ffdde787bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:19.969038 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73eaa0d-8f7a-4466-9189-f1ffdde787bc None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:19.969174 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73eaa0d-8f7a-4466-9189-f1ffdde787bc None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:19.969423 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73eaa0d-8f7a-4466-9189-f1ffdde787bc None admin] PATH_INFO: `/v3/projects/180cdaa50e2b46528552bac08f3a81a0` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:19.970670 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73eaa0d-8f7a-4466-9189-f1ffdde787bc None admin] RBAC: Authorizing `identity:get_project(project_id=180cdaa50e2b46528552bac08f3a81a0)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:19.972110 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73eaa0d-8f7a-4466-9189-f1ffdde787bc None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:19.973862 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 568/1129] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:56:19 2022] GET /identity/v3/projects/180cdaa50e2b46528552bac08f3a81a0 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:19.981097 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769be13-4300-4daf-b3eb-36fb3519f9eb None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:20.091559 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769be13-4300-4daf-b3eb-36fb3519f9eb None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:20.132763 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb757bc-0807-4196-a5ed-0003a0c3d1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:20.133426 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb757bc-0807-4196-a5ed-0003a0c3d1f3 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:20.133736 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb757bc-0807-4196-a5ed-0003a0c3d1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:20.134001 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb757bc-0807-4196-a5ed-0003a0c3d1f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:20.134829 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb757bc-0807-4196-a5ed-0003a0c3d1f3 None admin] RBAC: Adding query filter params (role.id=fda97f4c5b1f4e1ba165f8dfa70ddbd6, scope.project.id=180cdaa50e2b46528552bac08f3a81a0, user.id=3fd5bef3e27d4e488f43237d1accaffa) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:56:20.135138 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb757bc-0807-4196-a5ed-0003a0c3d1f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:20.136573 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb757bc-0807-4196-a5ed-0003a0c3d1f3 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:20.142567 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 562/1130] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:56:19 2022] GET /identity/v3/role_assignments?user.id=3fd5bef3e27d4e488f43237d1accaffa&scope.project.id=180cdaa50e2b46528552bac08f3a81a0&role.id=fda97f4c5b1f4e1ba165f8dfa70ddbd6 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:22.354886 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9adb6-61f9-4a6b-98fc-113b9b31f2c2 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:22.355444 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9adb6-61f9-4a6b-98fc-113b9b31f2c2 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:22.355444 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9adb6-61f9-4a6b-98fc-113b9b31f2c2 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:22.356817 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 569/1131] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:56:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:56:22.363379 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0fd62-d35c-425b-a21c-735ad11399c1 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:22.364115 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0fd62-d35c-425b-a21c-735ad11399c1 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:22.364270 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0fd62-d35c-425b-a21c-735ad11399c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:22.387158 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-ccc0fd62-d35c-425b-a21c-735ad11399c1 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:22.388351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ccc0fd62-d35c-425b-a21c-735ad11399c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:22.454626 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 563/1132] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:56:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:56:22.480432 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9adb6-61f9-4a6b-98fc-113b9b31f2c2 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:22.586544 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9adb6-61f9-4a6b-98fc-113b9b31f2c2 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:22.621261 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58fdfef-7c9c-4bb4-a4ae-d8eb77de66b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:22.622072 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fdfef-7c9c-4bb4-a4ae-d8eb77de66b1 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:22.622358 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fdfef-7c9c-4bb4-a4ae-d8eb77de66b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:22.622627 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fdfef-7c9c-4bb4-a4ae-d8eb77de66b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:22.623838 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58fdfef-7c9c-4bb4-a4ae-d8eb77de66b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:22.625304 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58fdfef-7c9c-4bb4-a4ae-d8eb77de66b1 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:22.626922 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 570/1133] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:56:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:22.632997 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc0fd62-d35c-425b-a21c-735ad11399c1 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:22.732431 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc0fd62-d35c-425b-a21c-735ad11399c1 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:22.765928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08789762-ff93-44e1-9bc0-4ee3d86ffff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:22.766572 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08789762-ff93-44e1-9bc0-4ee3d86ffff5 None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:22.766847 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08789762-ff93-44e1-9bc0-4ee3d86ffff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:22.767116 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08789762-ff93-44e1-9bc0-4ee3d86ffff5 None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:22.767820 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08789762-ff93-44e1-9bc0-4ee3d86ffff5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:22.769282 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08789762-ff93-44e1-9bc0-4ee3d86ffff5 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:22.806835 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 564/1134] 10.222.0.24 () {60 vars in 1141 bytes} [Mon May 16 18:56:22 2022] POST /identity/v3/projects => generated 311 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:56:25.022383 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af01f6-63c8-4ffd-9f43-fda8065af210 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:25.023283 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af01f6-63c8-4ffd-9f43-fda8065af210 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:25.023283 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af01f6-63c8-4ffd-9f43-fda8065af210 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:25.025418 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 571/1135] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:56:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:56:25.031100 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f6efd-818f-4e30-bff5-91f5ee609510 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:25.031519 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f6efd-818f-4e30-bff5-91f5ee609510 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:25.031631 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f6efd-818f-4e30-bff5-91f5ee609510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:25.050251 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-d39f6efd-818f-4e30-bff5-91f5ee609510 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:25.051413 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d39f6efd-818f-4e30-bff5-91f5ee609510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:25.121831 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 565/1136] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:56:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:56:25.146712 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af01f6-63c8-4ffd-9f43-fda8065af210 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:25.257473 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af01f6-63c8-4ffd-9f43-fda8065af210 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:25.291344 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb171dc-c878-49b8-9cd0-5880b72efff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:25.292058 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb171dc-c878-49b8-9cd0-5880b72efff1 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:25.292331 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb171dc-c878-49b8-9cd0-5880b72efff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:25.292606 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb171dc-c878-49b8-9cd0-5880b72efff1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:25.293902 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb171dc-c878-49b8-9cd0-5880b72efff1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:25.295339 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb171dc-c878-49b8-9cd0-5880b72efff1 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:25.296936 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 572/1137] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:56:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:25.303762 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f6efd-818f-4e30-bff5-91f5ee609510 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:25.410473 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f6efd-818f-4e30-bff5-91f5ee609510 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:25.444006 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942e1b9-80da-491c-bf6d-eb2ce7c29cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:25.444661 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942e1b9-80da-491c-bf6d-eb2ce7c29cb4 None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:25.444941 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942e1b9-80da-491c-bf6d-eb2ce7c29cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:25.445212 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942e1b9-80da-491c-bf6d-eb2ce7c29cb4 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:25.445944 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f942e1b9-80da-491c-bf6d-eb2ce7c29cb4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:25.447392 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f942e1b9-80da-491c-bf6d-eb2ce7c29cb4 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:25.473950 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 566/1138] 10.222.0.24 () {60 vars in 1132 bytes} [Mon May 16 18:56:25 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:56:27.723932 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2f7c5-3afe-4c39-8c4c-e07c5286e8ec None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:27.724832 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2f7c5-3afe-4c39-8c4c-e07c5286e8ec None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:27.724832 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2f7c5-3afe-4c39-8c4c-e07c5286e8ec None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:27.727075 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 573/1139] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:56:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:56:27.732610 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18199e2-a530-4b48-80e1-3c450b9e29c3 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:27.733022 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18199e2-a530-4b48-80e1-3c450b9e29c3 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:27.733130 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18199e2-a530-4b48-80e1-3c450b9e29c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:27.751696 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-a18199e2-a530-4b48-80e1-3c450b9e29c3 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:27.752864 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a18199e2-a530-4b48-80e1-3c450b9e29c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:27.833599 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 567/1140] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:56:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:56:27.870008 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da2f7c5-3afe-4c39-8c4c-e07c5286e8ec None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:27.983533 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da2f7c5-3afe-4c39-8c4c-e07c5286e8ec None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:28.017178 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c573cfd-f11a-48af-a4bb-abc3fbc9768b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:28.017992 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c573cfd-f11a-48af-a4bb-abc3fbc9768b None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:28.018269 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c573cfd-f11a-48af-a4bb-abc3fbc9768b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:28.018543 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c573cfd-f11a-48af-a4bb-abc3fbc9768b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:28.029062 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c573cfd-f11a-48af-a4bb-abc3fbc9768b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:56:28.037418 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-0c573cfd-f11a-48af-a4bb-abc3fbc9768b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:56:28.037418 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:56:28.037418 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:56:28.037418 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:56:28.037418 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:56:28.037418 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:56:28.037418 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:56:28.037418 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:56:28.037418 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:56:28.037418 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:56:28.037418 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:56:28.037418 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:56:28.037418 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:56:28.037418 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:56:28.037418 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:56:28.037418 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:56:28.038636 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:56:28.038636 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:56:28.038636 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:56:28.038636 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:56:28.038636 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:56:28.038636 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:56:28.038636 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:56:28.038636 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:56:28.038636 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:56:28.038636 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:56:28.038636 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:56:28.038636 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:56:28.038636 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:56:28.038636 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:56:28.038636 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:56:28.038636 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:56:28.040054 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:56:28.040054 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:56:28.040054 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:56:28.040054 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:56:28.040054 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:56:28.040054 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:56:28.040054 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:56:28.040054 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:56:28.040054 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:56:28.040054 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:56:28.040054 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:56:28.040054 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:56:28.040054 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 574/1141] 10.222.0.24 () {56 vars in 1096 bytes} [Mon May 16 18:56:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:56:28.048141 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18199e2-a530-4b48-80e1-3c450b9e29c3 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:28.163206 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18199e2-a530-4b48-80e1-3c450b9e29c3 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:28.200922 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020956c-5607-4ad9-ac70-dddef901a033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:28.201604 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020956c-5607-4ad9-ac70-dddef901a033 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:28.201885 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020956c-5607-4ad9-ac70-dddef901a033 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:28.202155 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020956c-5607-4ad9-ac70-dddef901a033 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:28.202905 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e020956c-5607-4ad9-ac70-dddef901a033 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:56:28.203222 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e020956c-5607-4ad9-ac70-dddef901a033 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:28.204590 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e020956c-5607-4ad9-ac70-dddef901a033 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:28.212526 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 568/1142] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:56:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:28.218521 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c573cfd-f11a-48af-a4bb-abc3fbc9768b None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:28.322447 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c573cfd-f11a-48af-a4bb-abc3fbc9768b None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:28.357208 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41311f-1c2d-4108-b419-daef2cefc16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:28.358105 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41311f-1c2d-4108-b419-daef2cefc16f None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:28.358388 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41311f-1c2d-4108-b419-daef2cefc16f None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:28.358632 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41311f-1c2d-4108-b419-daef2cefc16f None admin] PATH_INFO: `/v3/users/10c9eacbc90a42f89e356ebaf9e549e8` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:28.372112 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd41311f-1c2d-4108-b419-daef2cefc16f None admin] RBAC: Authorizing `identity:get_user(user_id=10c9eacbc90a42f89e356ebaf9e549e8)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:28.373572 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd41311f-1c2d-4108-b419-daef2cefc16f None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:28.375228 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 575/1143] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:56:28 2022] GET /identity/v3/users/10c9eacbc90a42f89e356ebaf9e549e8 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:28.381518 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020956c-5607-4ad9-ac70-dddef901a033 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:28.482932 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020956c-5607-4ad9-ac70-dddef901a033 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:28.518682 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd779c-3253-41a7-8336-e1d30bc6c4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:28.519661 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd779c-3253-41a7-8336-e1d30bc6c4e8 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:28.520090 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd779c-3253-41a7-8336-e1d30bc6c4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:28.520510 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd779c-3253-41a7-8336-e1d30bc6c4e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:28.590737 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd779c-3253-41a7-8336-e1d30bc6c4e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:28.592106 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd779c-3253-41a7-8336-e1d30bc6c4e8 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:28.702565 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 569/1144] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:56:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 18:56:28.703733 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41311f-1c2d-4108-b419-daef2cefc16f None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:28.803782 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41311f-1c2d-4108-b419-daef2cefc16f None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:28.840083 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a3315-cc22-4116-a625-4e3c91239980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:28.840988 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a3315-cc22-4116-a625-4e3c91239980 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:28.841212 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a3315-cc22-4116-a625-4e3c91239980 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:28.841483 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a3315-cc22-4116-a625-4e3c91239980 None admin] PATH_INFO: `/v3/projects/7e977cf65dbd4760bea184eef48a548a` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:28.842735 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a3315-cc22-4116-a625-4e3c91239980 None admin] RBAC: Authorizing `identity:get_project(project_id=7e977cf65dbd4760bea184eef48a548a)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:28.844176 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a3315-cc22-4116-a625-4e3c91239980 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:28.845884 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 576/1145] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:56:28 2022] GET /identity/v3/projects/7e977cf65dbd4760bea184eef48a548a => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:28.852959 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd779c-3253-41a7-8336-e1d30bc6c4e8 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:28.963792 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd779c-3253-41a7-8336-e1d30bc6c4e8 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:28.996975 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a75e1d-be6a-4dae-a0c2-19b5d86e231d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:28.997648 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a75e1d-be6a-4dae-a0c2-19b5d86e231d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:28.997930 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a75e1d-be6a-4dae-a0c2-19b5d86e231d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:28.998198 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a75e1d-be6a-4dae-a0c2-19b5d86e231d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:28.999029 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a75e1d-be6a-4dae-a0c2-19b5d86e231d None admin] RBAC: Adding query filter params (role.id=5a6e54e81bb24eceb618d9ffa67f488e, scope.project.id=7e977cf65dbd4760bea184eef48a548a, user.id=10c9eacbc90a42f89e356ebaf9e549e8) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:56:28.999338 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a75e1d-be6a-4dae-a0c2-19b5d86e231d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:29.000789 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a75e1d-be6a-4dae-a0c2-19b5d86e231d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:29.006429 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 570/1146] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:56:28 2022] GET /identity/v3/role_assignments?user.id=10c9eacbc90a42f89e356ebaf9e549e8&scope.project.id=7e977cf65dbd4760bea184eef48a548a&role.id=5a6e54e81bb24eceb618d9ffa67f488e => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:31.184393 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1fc06-44cc-4728-b242-be0a4662a7be None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:31.184875 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1fc06-44cc-4728-b242-be0a4662a7be None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:31.184967 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1fc06-44cc-4728-b242-be0a4662a7be None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:31.187187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 577/1147] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:56:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:56:31.192695 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550e2dd-2084-4fe7-aace-be1cde6a4a5b None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:31.193196 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550e2dd-2084-4fe7-aace-be1cde6a4a5b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:31.193299 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550e2dd-2084-4fe7-aace-be1cde6a4a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:31.212355 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-a550e2dd-2084-4fe7-aace-be1cde6a4a5b None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:31.213646 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a550e2dd-2084-4fe7-aace-be1cde6a4a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:31.286078 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 571/1148] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:56:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:56:31.308445 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1fc06-44cc-4728-b242-be0a4662a7be None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:31.416037 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1fc06-44cc-4728-b242-be0a4662a7be None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:31.449995 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e826ad-1e01-4142-8fea-76edb724330e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:31.450775 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e826ad-1e01-4142-8fea-76edb724330e None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:31.451054 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e826ad-1e01-4142-8fea-76edb724330e None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:31.451329 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e826ad-1e01-4142-8fea-76edb724330e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:31.461857 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e826ad-1e01-4142-8fea-76edb724330e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:56:31.469414 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-d2e826ad-1e01-4142-8fea-76edb724330e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:56:31.469414 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:56:31.469414 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:56:31.469414 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:56:31.469414 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:56:31.469414 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:56:31.469414 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:56:31.469414 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:56:31.469414 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:56:31.469414 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:56:31.469414 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:56:31.469414 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:56:31.469414 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:56:31.469414 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:56:31.469414 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:56:31.469414 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:56:31.470494 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:56:31.470494 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:56:31.470494 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:56:31.470494 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:56:31.470494 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:56:31.470494 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:56:31.470494 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:56:31.470494 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:56:31.470494 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:56:31.470494 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:56:31.470494 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:56:31.470494 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:56:31.470494 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:56:31.470494 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:56:31.470494 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:56:31.470494 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:56:31.471561 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:56:31.471561 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:56:31.471561 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:56:31.471561 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:56:31.471561 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:56:31.471561 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:56:31.471561 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:56:31.471561 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:56:31.471561 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:56:31.471561 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:56:31.471561 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:56:31.471561 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:56:31.471561 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 578/1149] 10.222.0.24 () {56 vars in 1096 bytes} [Mon May 16 18:56:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:56:31.477262 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550e2dd-2084-4fe7-aace-be1cde6a4a5b None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:31.584383 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550e2dd-2084-4fe7-aace-be1cde6a4a5b None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:31.623362 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6caa443-17e9-4f12-9d71-e8125e8d9434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:31.624030 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6caa443-17e9-4f12-9d71-e8125e8d9434 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:31.624344 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6caa443-17e9-4f12-9d71-e8125e8d9434 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:31.624609 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6caa443-17e9-4f12-9d71-e8125e8d9434 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:31.625358 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6caa443-17e9-4f12-9d71-e8125e8d9434 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:56:31.625690 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6caa443-17e9-4f12-9d71-e8125e8d9434 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:31.627066 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6caa443-17e9-4f12-9d71-e8125e8d9434 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:31.635067 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 572/1150] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:56:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:56:31.641414 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e826ad-1e01-4142-8fea-76edb724330e None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:31.751737 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e826ad-1e01-4142-8fea-76edb724330e None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:31.787412 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118cf93-a73c-4e57-b3bc-4aa659d169b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:31.788277 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118cf93-a73c-4e57-b3bc-4aa659d169b3 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:31.788554 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118cf93-a73c-4e57-b3bc-4aa659d169b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:31.788816 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118cf93-a73c-4e57-b3bc-4aa659d169b3 None admin] PATH_INFO: `/v3/users/10c9eacbc90a42f89e356ebaf9e549e8` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:31.790069 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c118cf93-a73c-4e57-b3bc-4aa659d169b3 None admin] RBAC: Authorizing `identity:get_user(user_id=10c9eacbc90a42f89e356ebaf9e549e8)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:31.791530 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c118cf93-a73c-4e57-b3bc-4aa659d169b3 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:31.793144 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 579/1151] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:56:31 2022] GET /identity/v3/users/10c9eacbc90a42f89e356ebaf9e549e8 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:31.801505 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6caa443-17e9-4f12-9d71-e8125e8d9434 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:31.900713 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6caa443-17e9-4f12-9d71-e8125e8d9434 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:31.934807 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c430b9-aca5-4424-a0f3-dfebbe5c07af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:31.935651 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c430b9-aca5-4424-a0f3-dfebbe5c07af None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:31.935931 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c430b9-aca5-4424-a0f3-dfebbe5c07af None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:31.936199 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c430b9-aca5-4424-a0f3-dfebbe5c07af None admin] PATH_INFO: `/v3/projects/7e977cf65dbd4760bea184eef48a548a` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:31.937520 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c430b9-aca5-4424-a0f3-dfebbe5c07af None admin] RBAC: Authorizing `identity:get_project(project_id=7e977cf65dbd4760bea184eef48a548a)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:31.938980 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c430b9-aca5-4424-a0f3-dfebbe5c07af None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:31.940666 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 573/1152] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:56:31 2022] GET /identity/v3/projects/7e977cf65dbd4760bea184eef48a548a => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:56:31.946844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118cf93-a73c-4e57-b3bc-4aa659d169b3 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:32.048989 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118cf93-a73c-4e57-b3bc-4aa659d169b3 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:32.083142 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25540a-2f9c-4851-90df-20b92a39f76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:32.084463 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25540a-2f9c-4851-90df-20b92a39f76f None admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:32.084818 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25540a-2f9c-4851-90df-20b92a39f76f None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:32.085175 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25540a-2f9c-4851-90df-20b92a39f76f None admin] PATH_INFO: `/v3/projects/7e977cf65dbd4760bea184eef48a548a/users/10c9eacbc90a42f89e356ebaf9e549e8/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:32.088845 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25540a-2f9c-4851-90df-20b92a39f76f None admin] RBAC: Authorizing `identity:create_grant(project_id=7e977cf65dbd4760bea184eef48a548a, user_id=10c9eacbc90a42f89e356ebaf9e549e8, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:32.091200 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25540a-2f9c-4851-90df-20b92a39f76f None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:32.112274 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 580/1153] 10.222.0.24 () {58 vars in 1439 bytes} [Mon May 16 18:56:31 2022] PUT /identity/v3/projects/7e977cf65dbd4760bea184eef48a548a/users/10c9eacbc90a42f89e356ebaf9e549e8/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:34.291239 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20468b0-0b75-4435-9a27-f5e72650f62f None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:34.291797 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20468b0-0b75-4435-9a27-f5e72650f62f None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:34.291797 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20468b0-0b75-4435-9a27-f5e72650f62f None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:34.293165 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 574/1154] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:56:34.299646 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b65d8-021f-46a1-8d1d-c60bffe4a3d9 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:34.300457 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b65d8-021f-46a1-8d1d-c60bffe4a3d9 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:34.300572 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b65d8-021f-46a1-8d1d-c60bffe4a3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:34.324511 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-923b65d8-021f-46a1-8d1d-c60bffe4a3d9 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:34.325789 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-923b65d8-021f-46a1-8d1d-c60bffe4a3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:34.394572 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 581/1155] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:56:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:56:34.418645 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20468b0-0b75-4435-9a27-f5e72650f62f None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:34.521825 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20468b0-0b75-4435-9a27-f5e72650f62f None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:34.555536 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a339a1e-5331-47aa-a192-2d43c2b608de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:34.556316 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a339a1e-5331-47aa-a192-2d43c2b608de None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:34.556593 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a339a1e-5331-47aa-a192-2d43c2b608de None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:34.556863 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a339a1e-5331-47aa-a192-2d43c2b608de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:34.567331 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a339a1e-5331-47aa-a192-2d43c2b608de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:56:34.574887 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-2a339a1e-5331-47aa-a192-2d43c2b608de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:56:34.574887 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:56:34.574887 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:56:34.574887 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:56:34.574887 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:56:34.574887 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:56:34.574887 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:56:34.574887 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:56:34.574887 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:56:34.574887 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:56:34.574887 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:56:34.574887 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:56:34.574887 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:56:34.574887 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:56:34.574887 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:56:34.574887 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:56:34.575958 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:56:34.575958 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:56:34.575958 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:56:34.575958 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:56:34.575958 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:56:34.575958 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:56:34.575958 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:56:34.575958 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:56:34.575958 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:56:34.575958 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:56:34.575958 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:56:34.575958 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:56:34.575958 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:56:34.575958 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:56:34.575958 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:56:34.575958 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:56:34.577217 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:56:34.577217 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:56:34.577217 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:56:34.577217 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:56:34.577217 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:56:34.577217 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:56:34.577217 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:56:34.577217 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:56:34.577217 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:56:34.577217 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:56:34.577217 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:56:34.577217 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:56:34.577217 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 575/1156] 10.222.0.24 () {56 vars in 1096 bytes} [Mon May 16 18:56:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:56:34.582945 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b65d8-021f-46a1-8d1d-c60bffe4a3d9 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:34.684708 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b65d8-021f-46a1-8d1d-c60bffe4a3d9 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:34.718372 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1b207-58b0-4c2e-b1c1-ed96a1f20f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:34.719025 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1b207-58b0-4c2e-b1c1-ed96a1f20f07 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:34.719305 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1b207-58b0-4c2e-b1c1-ed96a1f20f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:34.719532 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1b207-58b0-4c2e-b1c1-ed96a1f20f07 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:34.720308 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba1b207-58b0-4c2e-b1c1-ed96a1f20f07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:56:34.720615 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba1b207-58b0-4c2e-b1c1-ed96a1f20f07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:34.722034 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba1b207-58b0-4c2e-b1c1-ed96a1f20f07 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:34.729985 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 582/1157] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:56:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:34.736691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a339a1e-5331-47aa-a192-2d43c2b608de None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:34.839284 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a339a1e-5331-47aa-a192-2d43c2b608de None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:34.872998 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48996559-7aaf-404c-9017-c86dc984f9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:34.873879 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48996559-7aaf-404c-9017-c86dc984f9f6 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:34.874160 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48996559-7aaf-404c-9017-c86dc984f9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:34.874431 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48996559-7aaf-404c-9017-c86dc984f9f6 None admin] PATH_INFO: `/v3/users/10c9eacbc90a42f89e356ebaf9e549e8` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:34.875725 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48996559-7aaf-404c-9017-c86dc984f9f6 None admin] RBAC: Authorizing `identity:get_user(user_id=10c9eacbc90a42f89e356ebaf9e549e8)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:34.877185 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48996559-7aaf-404c-9017-c86dc984f9f6 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:34.878897 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 576/1158] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:56:34 2022] GET /identity/v3/users/10c9eacbc90a42f89e356ebaf9e549e8 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:34.887793 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1b207-58b0-4c2e-b1c1-ed96a1f20f07 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:34.996915 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1b207-58b0-4c2e-b1c1-ed96a1f20f07 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:35.030730 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b8f565-c4b0-4b83-acd5-148216c3dc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:35.031372 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b8f565-c4b0-4b83-acd5-148216c3dc10 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:35.031647 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b8f565-c4b0-4b83-acd5-148216c3dc10 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:35.031932 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b8f565-c4b0-4b83-acd5-148216c3dc10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:35.104214 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b8f565-c4b0-4b83-acd5-148216c3dc10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:35.105700 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b8f565-c4b0-4b83-acd5-148216c3dc10 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:35.207611 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 583/1159] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:56:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 18:56:35.217400 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48996559-7aaf-404c-9017-c86dc984f9f6 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:35.323623 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48996559-7aaf-404c-9017-c86dc984f9f6 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:35.357013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9280a4-a6b2-48b4-ae82-7c3623ed1656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:35.357890 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9280a4-a6b2-48b4-ae82-7c3623ed1656 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:35.358165 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9280a4-a6b2-48b4-ae82-7c3623ed1656 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:35.358432 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9280a4-a6b2-48b4-ae82-7c3623ed1656 None admin] PATH_INFO: `/v3/projects/7e977cf65dbd4760bea184eef48a548a` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:35.359710 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9280a4-a6b2-48b4-ae82-7c3623ed1656 None admin] RBAC: Authorizing `identity:get_project(project_id=7e977cf65dbd4760bea184eef48a548a)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:35.361140 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9280a4-a6b2-48b4-ae82-7c3623ed1656 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:35.362849 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 577/1160] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:56:35 2022] GET /identity/v3/projects/7e977cf65dbd4760bea184eef48a548a => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:35.369280 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b8f565-c4b0-4b83-acd5-148216c3dc10 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:35.471442 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b8f565-c4b0-4b83-acd5-148216c3dc10 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:35.504735 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de56cdfd-c188-40b6-9fd4-0f04f1e58638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:35.505378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56cdfd-c188-40b6-9fd4-0f04f1e58638 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:35.505726 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56cdfd-c188-40b6-9fd4-0f04f1e58638 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:35.506002 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56cdfd-c188-40b6-9fd4-0f04f1e58638 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:35.506825 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de56cdfd-c188-40b6-9fd4-0f04f1e58638 None admin] RBAC: Adding query filter params (role.id=5a6e54e81bb24eceb618d9ffa67f488e, scope.project.id=7e977cf65dbd4760bea184eef48a548a, user.id=10c9eacbc90a42f89e356ebaf9e549e8) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:56:35.507140 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de56cdfd-c188-40b6-9fd4-0f04f1e58638 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:35.508589 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de56cdfd-c188-40b6-9fd4-0f04f1e58638 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:35.514358 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 584/1161] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:56:35 2022] GET /identity/v3/role_assignments?user.id=10c9eacbc90a42f89e356ebaf9e549e8&scope.project.id=7e977cf65dbd4760bea184eef48a548a&role.id=5a6e54e81bb24eceb618d9ffa67f488e => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:37.737686 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29a05a-372f-4fd5-8cb8-c68b80081e43 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:37.738295 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29a05a-372f-4fd5-8cb8-c68b80081e43 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:37.738295 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29a05a-372f-4fd5-8cb8-c68b80081e43 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:37.739611 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 578/1162] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:56:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:56:37.748529 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8a282-48c9-4f05-9d84-1f3ebfd5f67c None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:37.749256 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8a282-48c9-4f05-9d84-1f3ebfd5f67c None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:37.749409 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8a282-48c9-4f05-9d84-1f3ebfd5f67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:37.775155 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-e3a8a282-48c9-4f05-9d84-1f3ebfd5f67c None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:37.776307 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-e3a8a282-48c9-4f05-9d84-1f3ebfd5f67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:37.842967 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 585/1163] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:56:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:56:37.864609 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29a05a-372f-4fd5-8cb8-c68b80081e43 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:37.966977 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29a05a-372f-4fd5-8cb8-c68b80081e43 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:38.000287 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c23d4-e866-4fb9-bb88-b60fa9000f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:38.000848 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c23d4-e866-4fb9-bb88-b60fa9000f00 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:38.001121 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c23d4-e866-4fb9-bb88-b60fa9000f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:38.001382 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c23d4-e866-4fb9-bb88-b60fa9000f00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:38.066192 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399c23d4-e866-4fb9-bb88-b60fa9000f00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:38.067967 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399c23d4-e866-4fb9-bb88-b60fa9000f00 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:38.177005 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 579/1164] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:56:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 18:56:38.183329 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8a282-48c9-4f05-9d84-1f3ebfd5f67c None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:38.279168 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8a282-48c9-4f05-9d84-1f3ebfd5f67c None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:38.315716 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f05cc-6d1b-449d-be23-571559c0dd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:38.316514 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f05cc-6d1b-449d-be23-571559c0dd25 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:38.316791 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f05cc-6d1b-449d-be23-571559c0dd25 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:38.317063 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f05cc-6d1b-449d-be23-571559c0dd25 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:38.324232 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f05cc-6d1b-449d-be23-571559c0dd25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:38.325719 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f05cc-6d1b-449d-be23-571559c0dd25 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:38.339669 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-de5f05cc-6d1b-449d-be23-571559c0dd25 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 16 18:56:38.339669 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:56:38.339669 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 16 18:56:38.339669 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 16 18:56:38.339669 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:56:38.339669 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:56:38.339669 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:56:38.339669 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:56:38.339669 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 16 18:56:38.339669 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:56:38.339669 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:56:38.339669 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:56:38.339669 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:56:38.339669 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:56:38.339669 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:56:38.339669 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:56:38.339669 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:56:38.340866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:56:38.340866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:56:38.340866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:56:38.340866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:56:38.340866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:56:38.340866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:56:38.340866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:56:38.340866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:56:38.340866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:56:38.340866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:56:38.340866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:56:38.340866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:56:38.340866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:56:38.340866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:56:38.340866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:56:38.340866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:56:38.341960 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:56:38.341960 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:56:38.341960 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:56:38.341960 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:56:38.341960 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:56:38.341960 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:56:38.341960 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:56:38.341960 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:56:38.341960 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:56:38.341960 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:56:38.341960 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 16 18:56:38.341960 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:56:38.341960 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 16 18:56:38.341960 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:56:38.341960 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 586/1165] 10.222.0.24 () {56 vars in 1117 bytes} [Mon May 16 18:56:38 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:56:38.347083 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c23d4-e866-4fb9-bb88-b60fa9000f00 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:38.456458 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c23d4-e866-4fb9-bb88-b60fa9000f00 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:38.492251 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103e46d-b790-4010-8093-464c8da3ccc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:38.492920 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103e46d-b790-4010-8093-464c8da3ccc0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:38.493198 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103e46d-b790-4010-8093-464c8da3ccc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:38.493467 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103e46d-b790-4010-8093-464c8da3ccc0 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:38.494220 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103e46d-b790-4010-8093-464c8da3ccc0 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:56:38.494529 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103e46d-b790-4010-8093-464c8da3ccc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:38.495901 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103e46d-b790-4010-8093-464c8da3ccc0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:38.502964 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 580/1166] 10.222.0.24 () {56 vars in 1115 bytes} [Mon May 16 18:56:38 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:40.682769 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e6a33-a848-482a-98a9-9c479be304ac None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:40.683617 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e6a33-a848-482a-98a9-9c479be304ac None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:40.683617 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e6a33-a848-482a-98a9-9c479be304ac None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:40.685896 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 587/1167] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:56:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:56:40.691407 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032e40d-fce5-4d67-8e4b-540db615388a None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:40.691850 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032e40d-fce5-4d67-8e4b-540db615388a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:40.691952 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032e40d-fce5-4d67-8e4b-540db615388a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:40.709332 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-6032e40d-fce5-4d67-8e4b-540db615388a None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:40.710534 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6032e40d-fce5-4d67-8e4b-540db615388a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:40.785689 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 581/1168] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:56:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:56:40.809695 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e6a33-a848-482a-98a9-9c479be304ac None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:40.920137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e6a33-a848-482a-98a9-9c479be304ac None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:40.952952 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57847822-5dad-449e-9824-b4990f589e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:40.953520 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57847822-5dad-449e-9824-b4990f589e49 None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:40.953799 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57847822-5dad-449e-9824-b4990f589e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:40.954093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57847822-5dad-449e-9824-b4990f589e49 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:40.954824 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57847822-5dad-449e-9824-b4990f589e49 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:40.956192 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57847822-5dad-449e-9824-b4990f589e49 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:40.974655 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 588/1169] 10.222.0.24 () {60 vars in 1138 bytes} [Mon May 16 18:56:40 2022] POST /identity/v3/domains => generated 267 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:56:43.180657 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446aea88-bac5-4692-aa35-f93c7b355890 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:43.181093 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446aea88-bac5-4692-aa35-f93c7b355890 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:43.181209 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446aea88-bac5-4692-aa35-f93c7b355890 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:43.182616 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 582/1170] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:56:43.188129 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e4aac-7ac7-4c55-8346-50b4481a6dd9 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:43.188545 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e4aac-7ac7-4c55-8346-50b4481a6dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:43.188636 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e4aac-7ac7-4c55-8346-50b4481a6dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:43.207698 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-1b7e4aac-7ac7-4c55-8346-50b4481a6dd9 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:43.208948 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-1b7e4aac-7ac7-4c55-8346-50b4481a6dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:43.279457 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 589/1171] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:56:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:56:43.303551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446aea88-bac5-4692-aa35-f93c7b355890 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:43.414297 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446aea88-bac5-4692-aa35-f93c7b355890 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:43.447128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60374d4c-7c81-4bff-a058-dd6c6da845b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:43.447968 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60374d4c-7c81-4bff-a058-dd6c6da845b6 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:43.448242 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60374d4c-7c81-4bff-a058-dd6c6da845b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:43.448508 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60374d4c-7c81-4bff-a058-dd6c6da845b6 None admin] PATH_INFO: `/v3/domains/29bc64daa9af4c70b8e9aad08980373e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:43.458694 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60374d4c-7c81-4bff-a058-dd6c6da845b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=29bc64daa9af4c70b8e9aad08980373e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:43.460147 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60374d4c-7c81-4bff-a058-dd6c6da845b6 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:43.461785 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 583/1172] 10.222.0.24 () {56 vars in 1183 bytes} [Mon May 16 18:56:43 2022] GET /identity/v3/domains/29bc64daa9af4c70b8e9aad08980373e => generated 267 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:43.471032 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e4aac-7ac7-4c55-8346-50b4481a6dd9 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:43.573191 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e4aac-7ac7-4c55-8346-50b4481a6dd9 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:43.606848 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becdcd93-8c4c-4f57-b1f9-b2661acf309b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:43.607486 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becdcd93-8c4c-4f57-b1f9-b2661acf309b None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:43.607757 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becdcd93-8c4c-4f57-b1f9-b2661acf309b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:43.608022 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becdcd93-8c4c-4f57-b1f9-b2661acf309b None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:43.608722 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becdcd93-8c4c-4f57-b1f9-b2661acf309b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:43.610186 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becdcd93-8c4c-4f57-b1f9-b2661acf309b None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:43.637702 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 590/1173] 10.222.0.24 () {60 vars in 1141 bytes} [Mon May 16 18:56:43 2022] POST /identity/v3/projects => generated 361 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:56:45.875984 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5d949-bf94-48fa-b294-62421a85587b None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:45.876552 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5d949-bf94-48fa-b294-62421a85587b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:45.876552 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5d949-bf94-48fa-b294-62421a85587b None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:45.878008 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 584/1174] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:56:45.884583 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba8a2d-d1da-4a6d-8036-55c9f37d3c95 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:45.885321 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba8a2d-d1da-4a6d-8036-55c9f37d3c95 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:45.885450 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba8a2d-d1da-4a6d-8036-55c9f37d3c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:45.912887 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-0aba8a2d-d1da-4a6d-8036-55c9f37d3c95 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:45.914108 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-0aba8a2d-d1da-4a6d-8036-55c9f37d3c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:45.985881 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 591/1175] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:56:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:56:46.011034 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5d949-bf94-48fa-b294-62421a85587b None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:46.120610 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5d949-bf94-48fa-b294-62421a85587b None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:46.159333 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5233e9-e4a8-4b26-bd3f-ba602f218837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:46.160203 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5233e9-e4a8-4b26-bd3f-ba602f218837 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:46.160486 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5233e9-e4a8-4b26-bd3f-ba602f218837 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:46.160737 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5233e9-e4a8-4b26-bd3f-ba602f218837 None admin] PATH_INFO: `/v3/domains/29bc64daa9af4c70b8e9aad08980373e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:46.161962 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5233e9-e4a8-4b26-bd3f-ba602f218837 None admin] RBAC: Authorizing `identity:get_domain(domain_id=29bc64daa9af4c70b8e9aad08980373e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:46.163399 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5233e9-e4a8-4b26-bd3f-ba602f218837 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:46.165015 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 585/1176] 10.222.0.24 () {56 vars in 1183 bytes} [Mon May 16 18:56:46 2022] GET /identity/v3/domains/29bc64daa9af4c70b8e9aad08980373e => generated 267 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:46.171019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba8a2d-d1da-4a6d-8036-55c9f37d3c95 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:46.275862 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba8a2d-d1da-4a6d-8036-55c9f37d3c95 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:46.309792 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06fbbee-7801-4b49-ac4e-7a298063d449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:46.310462 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06fbbee-7801-4b49-ac4e-7a298063d449 None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:46.310749 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06fbbee-7801-4b49-ac4e-7a298063d449 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:46.311018 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06fbbee-7801-4b49-ac4e-7a298063d449 None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:46.311724 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06fbbee-7801-4b49-ac4e-7a298063d449 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:46.313163 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06fbbee-7801-4b49-ac4e-7a298063d449 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:46.337740 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 592/1177] 10.222.0.24 () {60 vars in 1132 bytes} [Mon May 16 18:56:46 2022] POST /identity/v3/users => generated 311 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:56:48.566504 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3f683-2417-4e2d-810e-e6dd0c6189a8 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:48.567042 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3f683-2417-4e2d-810e-e6dd0c6189a8 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:48.567042 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3f683-2417-4e2d-810e-e6dd0c6189a8 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:48.568346 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 586/1178] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:56:48.574755 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9adeef-e9a2-4c1d-a83a-8d1060943dd1 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:48.575518 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9adeef-e9a2-4c1d-a83a-8d1060943dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:48.575615 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9adeef-e9a2-4c1d-a83a-8d1060943dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:48.597427 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-4b9adeef-e9a2-4c1d-a83a-8d1060943dd1 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:48.598683 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-4b9adeef-e9a2-4c1d-a83a-8d1060943dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:48.664360 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 593/1179] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:56:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:56:48.688127 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3f683-2417-4e2d-810e-e6dd0c6189a8 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:48.792739 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3f683-2417-4e2d-810e-e6dd0c6189a8 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:48.826566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af5c8e-61e5-4d0a-802e-b4b220e6a92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:48.827279 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af5c8e-61e5-4d0a-802e-b4b220e6a92c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:48.827558 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af5c8e-61e5-4d0a-802e-b4b220e6a92c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:48.827831 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af5c8e-61e5-4d0a-802e-b4b220e6a92c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:48.838353 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1af5c8e-61e5-4d0a-802e-b4b220e6a92c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:56:48.846006 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-c1af5c8e-61e5-4d0a-802e-b4b220e6a92c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:56:48.846006 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:56:48.846006 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:56:48.846006 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:56:48.846006 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:56:48.846006 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:56:48.846006 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:56:48.846006 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:56:48.846006 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:56:48.846006 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:56:48.846006 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:56:48.846006 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:56:48.846006 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:56:48.846006 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:56:48.846006 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:56:48.846006 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:56:48.847021 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:56:48.847021 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:56:48.847021 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:56:48.847021 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:56:48.847021 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:56:48.847021 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:56:48.847021 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:56:48.847021 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:56:48.847021 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:56:48.847021 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:56:48.847021 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:56:48.847021 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:56:48.847021 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:56:48.847021 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:56:48.847021 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:56:48.847021 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:56:48.848082 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:56:48.848082 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:56:48.848082 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:56:48.848082 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:56:48.848082 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:56:48.848082 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:56:48.848082 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:56:48.848082 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:56:48.848082 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:56:48.848082 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:56:48.848082 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:56:48.848082 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:56:48.848082 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 587/1180] 10.222.0.24 () {56 vars in 1096 bytes} [Mon May 16 18:56:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:56:48.853290 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9adeef-e9a2-4c1d-a83a-8d1060943dd1 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:48.947112 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9adeef-e9a2-4c1d-a83a-8d1060943dd1 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:48.980396 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad6ebe-526e-4046-8447-d65a91a86a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:48.981043 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad6ebe-526e-4046-8447-d65a91a86a1c None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:48.981315 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad6ebe-526e-4046-8447-d65a91a86a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:48.981585 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad6ebe-526e-4046-8447-d65a91a86a1c None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:48.982350 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad6ebe-526e-4046-8447-d65a91a86a1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:56:48.982653 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad6ebe-526e-4046-8447-d65a91a86a1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:48.984018 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad6ebe-526e-4046-8447-d65a91a86a1c None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:48.991921 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 594/1181] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:56:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:48.997919 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af5c8e-61e5-4d0a-802e-b4b220e6a92c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:49.108896 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af5c8e-61e5-4d0a-802e-b4b220e6a92c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:49.148630 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adae33b-fbb8-4d0b-b83c-8a7de33bb15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:49.149510 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adae33b-fbb8-4d0b-b83c-8a7de33bb15b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:49.149825 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adae33b-fbb8-4d0b-b83c-8a7de33bb15b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:49.150096 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adae33b-fbb8-4d0b-b83c-8a7de33bb15b None admin] PATH_INFO: `/v3/users/59250223119c4724958da92c9f248447` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:49.164462 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adae33b-fbb8-4d0b-b83c-8a7de33bb15b None admin] RBAC: Authorizing `identity:get_user(user_id=59250223119c4724958da92c9f248447)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:49.165971 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adae33b-fbb8-4d0b-b83c-8a7de33bb15b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:49.167699 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 588/1182] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:56:48 2022] GET /identity/v3/users/59250223119c4724958da92c9f248447 => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:49.173712 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad6ebe-526e-4046-8447-d65a91a86a1c None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:49.275374 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad6ebe-526e-4046-8447-d65a91a86a1c None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:49.309612 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90639680-105c-44b5-bea7-97cbefc237c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:49.310275 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90639680-105c-44b5-bea7-97cbefc237c7 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:49.310551 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90639680-105c-44b5-bea7-97cbefc237c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:49.310828 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90639680-105c-44b5-bea7-97cbefc237c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:49.376206 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90639680-105c-44b5-bea7-97cbefc237c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:49.377632 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90639680-105c-44b5-bea7-97cbefc237c7 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:49.476744 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 595/1183] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:56:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 18:56:49.483732 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adae33b-fbb8-4d0b-b83c-8a7de33bb15b None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:49.598420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adae33b-fbb8-4d0b-b83c-8a7de33bb15b None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:49.632245 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b97df-5e62-457b-ae3e-e4642d54c084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:49.633026 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b97df-5e62-457b-ae3e-e4642d54c084 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:49.633297 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b97df-5e62-457b-ae3e-e4642d54c084 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:49.633571 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b97df-5e62-457b-ae3e-e4642d54c084 None admin] PATH_INFO: `/v3/projects/8c1e08c6ecae4bca9f561b198468b37b` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:49.634759 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b97df-5e62-457b-ae3e-e4642d54c084 None admin] RBAC: Authorizing `identity:get_project(project_id=8c1e08c6ecae4bca9f561b198468b37b)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:49.636185 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b97df-5e62-457b-ae3e-e4642d54c084 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:49.637987 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 589/1184] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:56:49 2022] GET /identity/v3/projects/8c1e08c6ecae4bca9f561b198468b37b => generated 361 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:49.647863 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90639680-105c-44b5-bea7-97cbefc237c7 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:49.745967 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90639680-105c-44b5-bea7-97cbefc237c7 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:49.779430 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea8a15-0c0b-4176-98c0-9a941d1895b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:49.780067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea8a15-0c0b-4176-98c0-9a941d1895b2 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:49.780336 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea8a15-0c0b-4176-98c0-9a941d1895b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:49.780602 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea8a15-0c0b-4176-98c0-9a941d1895b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:49.781428 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea8a15-0c0b-4176-98c0-9a941d1895b2 None admin] RBAC: Adding query filter params (role.id=5a6e54e81bb24eceb618d9ffa67f488e, scope.project.id=8c1e08c6ecae4bca9f561b198468b37b, user.id=59250223119c4724958da92c9f248447) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:56:49.781758 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea8a15-0c0b-4176-98c0-9a941d1895b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:49.783186 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea8a15-0c0b-4176-98c0-9a941d1895b2 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:49.788935 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 596/1185] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:56:49 2022] GET /identity/v3/role_assignments?user.id=59250223119c4724958da92c9f248447&scope.project.id=8c1e08c6ecae4bca9f561b198468b37b&role.id=5a6e54e81bb24eceb618d9ffa67f488e => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:51.965738 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f05f46-5efc-4939-95d3-b9897e6420a0 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:51.966608 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f05f46-5efc-4939-95d3-b9897e6420a0 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:51.966608 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f05f46-5efc-4939-95d3-b9897e6420a0 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:51.968807 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 590/1186] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:56:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:56:51.975370 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf272b44-308e-4061-9779-319b9b3eaa55 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:51.976060 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf272b44-308e-4061-9779-319b9b3eaa55 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:51.976219 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf272b44-308e-4061-9779-319b9b3eaa55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:52.003786 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-cf272b44-308e-4061-9779-319b9b3eaa55 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:52.005429 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-cf272b44-308e-4061-9779-319b9b3eaa55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:52.070976 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 597/1187] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:56:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:56:52.098293 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f05f46-5efc-4939-95d3-b9897e6420a0 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:52.201610 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f05f46-5efc-4939-95d3-b9897e6420a0 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:52.237722 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b6746-8536-454b-8f3f-5051fe99e39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:52.238460 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b6746-8536-454b-8f3f-5051fe99e39c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:52.238732 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b6746-8536-454b-8f3f-5051fe99e39c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:52.239071 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b6746-8536-454b-8f3f-5051fe99e39c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:52.249420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b6746-8536-454b-8f3f-5051fe99e39c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:56:52.256998 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-c11b6746-8536-454b-8f3f-5051fe99e39c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:56:52.256998 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:56:52.256998 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:56:52.256998 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:56:52.256998 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:56:52.256998 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:56:52.256998 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:56:52.256998 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:56:52.256998 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:56:52.256998 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:56:52.256998 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:56:52.256998 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:56:52.256998 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:56:52.256998 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:56:52.256998 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:56:52.256998 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:56:52.258062 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:56:52.258062 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:56:52.258062 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:56:52.258062 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:56:52.258062 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:56:52.258062 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:56:52.258062 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:56:52.258062 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:56:52.258062 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:56:52.258062 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:56:52.258062 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:56:52.258062 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:56:52.258062 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:56:52.258062 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:56:52.258062 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:56:52.258062 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:56:52.259045 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:56:52.259045 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:56:52.259045 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:56:52.259045 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:56:52.259045 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:56:52.259045 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:56:52.259045 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:56:52.259045 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:56:52.259045 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:56:52.259045 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:56:52.259045 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:56:52.259045 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:56:52.259045 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 591/1188] 10.222.0.24 () {56 vars in 1096 bytes} [Mon May 16 18:56:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:56:52.264932 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf272b44-308e-4061-9779-319b9b3eaa55 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:52.365018 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf272b44-308e-4061-9779-319b9b3eaa55 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:52.400138 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874cf82-f883-4e3e-8973-6a1bf891b86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:52.400802 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874cf82-f883-4e3e-8973-6a1bf891b86c None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:52.401089 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874cf82-f883-4e3e-8973-6a1bf891b86c None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:52.401361 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874cf82-f883-4e3e-8973-6a1bf891b86c None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:52.402136 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874cf82-f883-4e3e-8973-6a1bf891b86c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:56:52.402441 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874cf82-f883-4e3e-8973-6a1bf891b86c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:52.403843 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874cf82-f883-4e3e-8973-6a1bf891b86c None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:52.412431 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 598/1189] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:56:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:52.418689 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b6746-8536-454b-8f3f-5051fe99e39c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:52.523993 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b6746-8536-454b-8f3f-5051fe99e39c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:52.563835 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454debb-7c92-42fb-874a-40b1b1e2025c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:52.564689 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454debb-7c92-42fb-874a-40b1b1e2025c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:52.564967 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454debb-7c92-42fb-874a-40b1b1e2025c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:52.565243 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454debb-7c92-42fb-874a-40b1b1e2025c None admin] PATH_INFO: `/v3/users/59250223119c4724958da92c9f248447` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:52.566557 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454debb-7c92-42fb-874a-40b1b1e2025c None admin] RBAC: Authorizing `identity:get_user(user_id=59250223119c4724958da92c9f248447)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:52.568100 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454debb-7c92-42fb-874a-40b1b1e2025c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:52.569728 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 592/1190] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:56:52 2022] GET /identity/v3/users/59250223119c4724958da92c9f248447 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:52.578978 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874cf82-f883-4e3e-8973-6a1bf891b86c None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:52.714663 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874cf82-f883-4e3e-8973-6a1bf891b86c None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:52.750911 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4a738-9f52-415b-b736-8444a82325c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:52.751763 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4a738-9f52-415b-b736-8444a82325c9 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:52.752049 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4a738-9f52-415b-b736-8444a82325c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:52.752319 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4a738-9f52-415b-b736-8444a82325c9 None admin] PATH_INFO: `/v3/projects/8c1e08c6ecae4bca9f561b198468b37b` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:52.753636 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4a738-9f52-415b-b736-8444a82325c9 None admin] RBAC: Authorizing `identity:get_project(project_id=8c1e08c6ecae4bca9f561b198468b37b)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:52.755152 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4a738-9f52-415b-b736-8444a82325c9 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:52.756850 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 599/1191] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:56:52 2022] GET /identity/v3/projects/8c1e08c6ecae4bca9f561b198468b37b => generated 361 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:52.763719 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454debb-7c92-42fb-874a-40b1b1e2025c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:52.865231 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454debb-7c92-42fb-874a-40b1b1e2025c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:52.898259 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700a752-6ed0-4114-a13e-43b90b19bffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:52.899131 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700a752-6ed0-4114-a13e-43b90b19bffb None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:52.899403 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700a752-6ed0-4114-a13e-43b90b19bffb None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:52.899669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700a752-6ed0-4114-a13e-43b90b19bffb None admin] PATH_INFO: `/v3/projects/8c1e08c6ecae4bca9f561b198468b37b/users/59250223119c4724958da92c9f248447/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:52.901854 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700a752-6ed0-4114-a13e-43b90b19bffb None admin] RBAC: Authorizing `identity:create_grant(project_id=8c1e08c6ecae4bca9f561b198468b37b, user_id=59250223119c4724958da92c9f248447, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:52.903286 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700a752-6ed0-4114-a13e-43b90b19bffb None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:52.919213 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 593/1192] 10.222.0.24 () {58 vars in 1439 bytes} [Mon May 16 18:56:52 2022] PUT /identity/v3/projects/8c1e08c6ecae4bca9f561b198468b37b/users/59250223119c4724958da92c9f248447/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:55.104225 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f57d25-1a5a-48b3-a698-c77dc56ff840 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:55.105114 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f57d25-1a5a-48b3-a698-c77dc56ff840 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:55.105286 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f57d25-1a5a-48b3-a698-c77dc56ff840 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:55.107579 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 600/1193] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:56:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:56:55.116365 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d58e4e-b5d3-4cd0-947e-6854f4f57ced None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:55.116811 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d58e4e-b5d3-4cd0-947e-6854f4f57ced None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:55.116900 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d58e4e-b5d3-4cd0-947e-6854f4f57ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:55.141734 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-87d58e4e-b5d3-4cd0-947e-6854f4f57ced None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:55.143491 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-87d58e4e-b5d3-4cd0-947e-6854f4f57ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:55.215905 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 594/1194] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:56:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:56:55.248784 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f57d25-1a5a-48b3-a698-c77dc56ff840 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:55.364967 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f57d25-1a5a-48b3-a698-c77dc56ff840 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:55.398377 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73499c15-6561-4713-8bd2-bd1a4a0bb098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:55.399171 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73499c15-6561-4713-8bd2-bd1a4a0bb098 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:55.399452 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73499c15-6561-4713-8bd2-bd1a4a0bb098 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:55.399726 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73499c15-6561-4713-8bd2-bd1a4a0bb098 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:55.410298 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73499c15-6561-4713-8bd2-bd1a4a0bb098 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:56:55.418013 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-73499c15-6561-4713-8bd2-bd1a4a0bb098 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:56:55.418013 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:56:55.418013 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:56:55.418013 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:56:55.418013 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:56:55.418013 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:56:55.418013 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:56:55.418013 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:56:55.418013 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:56:55.418013 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:56:55.418013 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:56:55.418013 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:56:55.418013 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:56:55.418013 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:56:55.418013 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:56:55.418013 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:56:55.419085 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:56:55.419085 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:56:55.419085 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:56:55.419085 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:56:55.419085 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:56:55.419085 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:56:55.419085 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:56:55.419085 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:56:55.419085 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:56:55.419085 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:56:55.419085 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:56:55.419085 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:56:55.419085 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:56:55.419085 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:56:55.419085 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:56:55.419085 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:56:55.420098 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:56:55.420098 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:56:55.420098 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:56:55.420098 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:56:55.420098 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:56:55.420098 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:56:55.420098 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:56:55.420098 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:56:55.420098 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:56:55.420098 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:56:55.420098 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:56:55.420098 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:56:55.420098 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 601/1195] 10.222.0.24 () {56 vars in 1096 bytes} [Mon May 16 18:56:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:56:55.427937 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d58e4e-b5d3-4cd0-947e-6854f4f57ced None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:55.531229 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d58e4e-b5d3-4cd0-947e-6854f4f57ced None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:55.565029 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b5602-d5cb-421e-8be3-0fe87c79c778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:55.565703 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b5602-d5cb-421e-8be3-0fe87c79c778 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:55.565976 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b5602-d5cb-421e-8be3-0fe87c79c778 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:55.566241 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b5602-d5cb-421e-8be3-0fe87c79c778 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:55.567060 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b5602-d5cb-421e-8be3-0fe87c79c778 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:56:55.567366 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b5602-d5cb-421e-8be3-0fe87c79c778 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:55.568737 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b5602-d5cb-421e-8be3-0fe87c79c778 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:55.576579 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 595/1196] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:56:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:55.583201 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73499c15-6561-4713-8bd2-bd1a4a0bb098 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:55.687490 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73499c15-6561-4713-8bd2-bd1a4a0bb098 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:55.722990 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c71e0-55f4-4fec-af01-c798fb234cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:55.723943 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c71e0-55f4-4fec-af01-c798fb234cdf None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:55.724220 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c71e0-55f4-4fec-af01-c798fb234cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:55.724489 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c71e0-55f4-4fec-af01-c798fb234cdf None admin] PATH_INFO: `/v3/users/59250223119c4724958da92c9f248447` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:55.725740 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c71e0-55f4-4fec-af01-c798fb234cdf None admin] RBAC: Authorizing `identity:get_user(user_id=59250223119c4724958da92c9f248447)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:55.727199 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c71e0-55f4-4fec-af01-c798fb234cdf None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:55.728830 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 602/1197] 10.222.0.24 () {56 vars in 1177 bytes} [Mon May 16 18:56:55 2022] GET /identity/v3/users/59250223119c4724958da92c9f248447 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:55.735471 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b5602-d5cb-421e-8be3-0fe87c79c778 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:55.859743 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b5602-d5cb-421e-8be3-0fe87c79c778 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:55.893075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a482e-693c-4845-a09a-ca920e9e9324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:55.893816 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a482e-693c-4845-a09a-ca920e9e9324 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:55.894095 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a482e-693c-4845-a09a-ca920e9e9324 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:55.894369 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a482e-693c-4845-a09a-ca920e9e9324 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:55.972772 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a482e-693c-4845-a09a-ca920e9e9324 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:55.974199 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a482e-693c-4845-a09a-ca920e9e9324 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:56.085142 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 596/1198] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:56:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 18:56:56.091340 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c71e0-55f4-4fec-af01-c798fb234cdf None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:56.186710 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c71e0-55f4-4fec-af01-c798fb234cdf None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:56.219961 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4096f-b4fb-4f4e-b294-59c3b0372cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:56.220822 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4096f-b4fb-4f4e-b294-59c3b0372cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:56.221093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4096f-b4fb-4f4e-b294-59c3b0372cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:56.221360 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4096f-b4fb-4f4e-b294-59c3b0372cc4 None admin] PATH_INFO: `/v3/projects/8c1e08c6ecae4bca9f561b198468b37b` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:56.222656 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4096f-b4fb-4f4e-b294-59c3b0372cc4 None admin] RBAC: Authorizing `identity:get_project(project_id=8c1e08c6ecae4bca9f561b198468b37b)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:56.224208 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4096f-b4fb-4f4e-b294-59c3b0372cc4 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:56.225862 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 603/1199] 10.222.0.24 () {56 vars in 1186 bytes} [Mon May 16 18:56:56 2022] GET /identity/v3/projects/8c1e08c6ecae4bca9f561b198468b37b => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:56.232236 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a482e-693c-4845-a09a-ca920e9e9324 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:56.338039 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a482e-693c-4845-a09a-ca920e9e9324 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:56.371988 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75baa64-3a9e-4b18-8875-d73e148a6213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:56.372630 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75baa64-3a9e-4b18-8875-d73e148a6213 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:56.372908 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75baa64-3a9e-4b18-8875-d73e148a6213 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:56.373176 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75baa64-3a9e-4b18-8875-d73e148a6213 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:56.374046 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75baa64-3a9e-4b18-8875-d73e148a6213 None admin] RBAC: Adding query filter params (role.id=5a6e54e81bb24eceb618d9ffa67f488e, scope.project.id=8c1e08c6ecae4bca9f561b198468b37b, user.id=59250223119c4724958da92c9f248447) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:56:56.374361 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75baa64-3a9e-4b18-8875-d73e148a6213 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:56.375831 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75baa64-3a9e-4b18-8875-d73e148a6213 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:56.381787 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 597/1200] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:56:56 2022] GET /identity/v3/role_assignments?user.id=59250223119c4724958da92c9f248447&scope.project.id=8c1e08c6ecae4bca9f561b198468b37b&role.id=5a6e54e81bb24eceb618d9ffa67f488e => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:57:56.892577 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01fe624-7d64-45f1-ab99-ee7a0712fc18 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:56.893175 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01fe624-7d64-45f1-ab99-ee7a0712fc18 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:56.893175 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01fe624-7d64-45f1-ab99-ee7a0712fc18 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:56.894763 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 604/1201] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:57:56.901680 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c6e6b-9fe6-4358-b0b9-aa4d99107c7b None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:56.902304 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c6e6b-9fe6-4358-b0b9-aa4d99107c7b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:56.902304 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c6e6b-9fe6-4358-b0b9-aa4d99107c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:56.920908 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-e33c6e6b-9fe6-4358-b0b9-aa4d99107c7b None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:56.922441 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e33c6e6b-9fe6-4358-b0b9-aa4d99107c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:56.999483 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 598/1202] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:57:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:57:57.025331 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01fe624-7d64-45f1-ab99-ee7a0712fc18 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:57.137142 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01fe624-7d64-45f1-ab99-ee7a0712fc18 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:57.175152 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60d0b8-e037-4f91-bddd-d938bb2c5d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:57.176058 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60d0b8-e037-4f91-bddd-d938bb2c5d11 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:57.176439 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60d0b8-e037-4f91-bddd-d938bb2c5d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:57.176676 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60d0b8-e037-4f91-bddd-d938bb2c5d11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:57.188013 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa60d0b8-e037-4f91-bddd-d938bb2c5d11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:57.189770 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa60d0b8-e037-4f91-bddd-d938bb2c5d11 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:57.212676 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-aa60d0b8-e037-4f91-bddd-d938bb2c5d11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:57:57.212676 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:57:57.212676 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:57:57.212676 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:57:57.212676 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:57:57.212676 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:57:57.212676 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:57:57.212676 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:57:57.212676 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:57:57.212676 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:57:57.212676 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:57:57.212676 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:57:57.212676 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:57:57.212676 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:57:57.212676 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:57:57.213780 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:57:57.213780 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:57:57.213780 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:57:57.213780 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:57:57.213780 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:57:57.213780 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:57:57.213780 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:57:57.213780 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:57:57.213780 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:57:57.213780 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:57:57.213780 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:57:57.213780 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:57:57.213780 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:57:57.213780 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:57:57.213780 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:57:57.213780 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:57:57.213780 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:57:57.219070 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:57:57.219070 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:57:57.219070 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:57:57.219070 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:57:57.219070 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 605/1203] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:57:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:57:57.220053 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c6e6b-9fe6-4358-b0b9-aa4d99107c7b None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:57.330830 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c6e6b-9fe6-4358-b0b9-aa4d99107c7b None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:57.367655 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181de5a-dcfe-42dc-8499-219d7ac63f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:57.368338 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181de5a-dcfe-42dc-8499-219d7ac63f0e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:57.368617 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181de5a-dcfe-42dc-8499-219d7ac63f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:57.368929 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181de5a-dcfe-42dc-8499-219d7ac63f0e None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:57.369722 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181de5a-dcfe-42dc-8499-219d7ac63f0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:57:57.370113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181de5a-dcfe-42dc-8499-219d7ac63f0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:57.371620 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181de5a-dcfe-42dc-8499-219d7ac63f0e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:57.385219 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 599/1204] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:57:57.391435 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60d0b8-e037-4f91-bddd-d938bb2c5d11 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:57.507107 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60d0b8-e037-4f91-bddd-d938bb2c5d11 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:57.542520 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd40c50-62cb-4c29-8431-71533c3f1c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:57.543277 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd40c50-62cb-4c29-8431-71533c3f1c54 None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:57.543537 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd40c50-62cb-4c29-8431-71533c3f1c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:57.543842 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd40c50-62cb-4c29-8431-71533c3f1c54 None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:57.544548 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd40c50-62cb-4c29-8431-71533c3f1c54 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:57.546156 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd40c50-62cb-4c29-8431-71533c3f1c54 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:57.570825 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 606/1205] 10.222.0.24 () {60 vars in 1132 bytes} [Mon May 16 18:57:57 2022] POST /identity/v3/users => generated 251 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:57:59.894002 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ba3d2-ca1f-4207-b2f4-a8575d59f84f None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:59.894616 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ba3d2-ca1f-4207-b2f4-a8575d59f84f None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:59.894616 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ba3d2-ca1f-4207-b2f4-a8575d59f84f None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:59.896042 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 600/1206] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:57:59.903882 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33640014-f618-4c49-9e5c-935a6d3bb858 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:59.904398 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33640014-f618-4c49-9e5c-935a6d3bb858 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:59.904807 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33640014-f618-4c49-9e5c-935a6d3bb858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:59.923333 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-33640014-f618-4c49-9e5c-935a6d3bb858 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:59.924638 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-33640014-f618-4c49-9e5c-935a6d3bb858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:59.997870 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 607/1207] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:57:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:58:00.021084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ba3d2-ca1f-4207-b2f4-a8575d59f84f None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:00.124899 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ba3d2-ca1f-4207-b2f4-a8575d59f84f None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:00.165435 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601e018-e922-4da5-817f-d7e83f811e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:00.166623 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601e018-e922-4da5-817f-d7e83f811e37 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:00.166966 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601e018-e922-4da5-817f-d7e83f811e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:00.167267 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601e018-e922-4da5-817f-d7e83f811e37 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:00.179518 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601e018-e922-4da5-817f-d7e83f811e37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:58:00.188442 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-7601e018-e922-4da5-817f-d7e83f811e37 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 18:58:00.188442 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:58:00.188442 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:58:00.188442 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:58:00.188442 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:58:00.188442 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:58:00.188442 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:58:00.188442 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:58:00.188442 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:58:00.188442 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:58:00.188442 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:58:00.188442 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:58:00.188442 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:58:00.188442 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:58:00.188442 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:58:00.188442 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:58:00.189432 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:58:00.189432 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:58:00.189432 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:58:00.189432 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:58:00.189432 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:58:00.189432 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:58:00.189432 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:58:00.189432 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:58:00.189432 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:58:00.189432 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:58:00.189432 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:58:00.189432 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:58:00.189432 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:58:00.189432 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:58:00.189432 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:58:00.189432 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:58:00.190322 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:58:00.190322 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:58:00.190322 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:58:00.190322 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:58:00.190322 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:58:00.190322 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:58:00.190322 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:58:00.190322 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:58:00.190322 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:58:00.190322 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:58:00.190322 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 18:58:00.190322 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:58:00.195262 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 601/1208] 10.222.0.24 () {56 vars in 1102 bytes} [Mon May 16 18:58:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:58:00.196768 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33640014-f618-4c49-9e5c-935a6d3bb858 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:00.310349 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33640014-f618-4c49-9e5c-935a6d3bb858 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:00.347586 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f9bd8-c9f5-402a-9ec8-5163dce3ac77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:00.348259 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f9bd8-c9f5-402a-9ec8-5163dce3ac77 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:00.348533 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f9bd8-c9f5-402a-9ec8-5163dce3ac77 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:00.348804 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f9bd8-c9f5-402a-9ec8-5163dce3ac77 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:00.349623 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f9bd8-c9f5-402a-9ec8-5163dce3ac77 None admin] RBAC: Adding query filter params (name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:58:00.349954 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f9bd8-c9f5-402a-9ec8-5163dce3ac77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:00.351699 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f9bd8-c9f5-402a-9ec8-5163dce3ac77 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:00.361548 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 608/1209] 10.222.0.24 () {56 vars in 1103 bytes} [Mon May 16 18:58:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:58:00.367539 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601e018-e922-4da5-817f-d7e83f811e37 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:00.481785 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601e018-e922-4da5-817f-d7e83f811e37 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:00.517850 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b13ca1-2ef7-43b8-a409-5970bbb3e2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:00.518766 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b13ca1-2ef7-43b8-a409-5970bbb3e2a6 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:00.519015 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b13ca1-2ef7-43b8-a409-5970bbb3e2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:00.519347 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b13ca1-2ef7-43b8-a409-5970bbb3e2a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:00.530211 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b13ca1-2ef7-43b8-a409-5970bbb3e2a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:00.532072 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b13ca1-2ef7-43b8-a409-5970bbb3e2a6 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:00.552613 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-79b13ca1-2ef7-43b8-a409-5970bbb3e2a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:58:00.552613 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:58:00.552613 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:58:00.552613 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:58:00.552613 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:58:00.552613 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:58:00.552613 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:58:00.552613 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:58:00.552613 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:58:00.552613 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:58:00.552613 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:58:00.552613 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:58:00.552613 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:58:00.552613 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:58:00.552613 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:58:00.554028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:58:00.554028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:58:00.554028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:58:00.554028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:58:00.554028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:58:00.554028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:58:00.554028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:58:00.554028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:58:00.554028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:58:00.554028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:58:00.554028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:58:00.554028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:58:00.554028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:58:00.554028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:58:00.554028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:58:00.554028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:58:00.554028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:58:00.555136 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:58:00.555136 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:58:00.555136 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:58:00.555136 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:58:00.555136 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 602/1210] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:58:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:58:00.559821 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f9bd8-c9f5-402a-9ec8-5163dce3ac77 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:00.666482 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f9bd8-c9f5-402a-9ec8-5163dce3ac77 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:00.703204 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83732b5d-3fea-47b6-99e1-b1e6a6d77927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:00.704012 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83732b5d-3fea-47b6-99e1-b1e6a6d77927 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:00.704293 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83732b5d-3fea-47b6-99e1-b1e6a6d77927 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:00.704646 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83732b5d-3fea-47b6-99e1-b1e6a6d77927 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:00.705550 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83732b5d-3fea-47b6-99e1-b1e6a6d77927 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:58:00.705975 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83732b5d-3fea-47b6-99e1-b1e6a6d77927 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:00.708516 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83732b5d-3fea-47b6-99e1-b1e6a6d77927 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:00.722196 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 609/1211] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:58:00.728190 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b13ca1-2ef7-43b8-a409-5970bbb3e2a6 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:00.843322 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b13ca1-2ef7-43b8-a409-5970bbb3e2a6 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:00.880506 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42bddd-7c6d-436c-b578-78ac401dfba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:00.881605 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42bddd-7c6d-436c-b578-78ac401dfba9 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:00.881979 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42bddd-7c6d-436c-b578-78ac401dfba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:00.882255 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42bddd-7c6d-436c-b578-78ac401dfba9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:00.890995 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed42bddd-7c6d-436c-b578-78ac401dfba9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:00.892612 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed42bddd-7c6d-436c-b578-78ac401dfba9 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:00.909472 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-ed42bddd-7c6d-436c-b578-78ac401dfba9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 18:58:00.909472 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:58:00.909472 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:58:00.909472 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:58:00.909472 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:58:00.909472 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:58:00.909472 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:58:00.909472 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:58:00.909472 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:58:00.909472 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:58:00.909472 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:58:00.909472 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:58:00.909472 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:58:00.909472 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:58:00.909472 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:58:00.909472 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:58:00.910971 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:58:00.910971 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:58:00.910971 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:58:00.910971 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:58:00.910971 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:58:00.910971 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:58:00.910971 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:58:00.910971 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:58:00.910971 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:58:00.910971 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:58:00.910971 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:58:00.910971 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:58:00.910971 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:58:00.910971 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:58:00.910971 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:58:00.910971 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:58:00.910971 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:58:00.910971 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:58:00.911977 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:58:00.911977 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:58:00.911977 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:58:00.911977 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:58:00.911977 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:58:00.911977 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:58:00.911977 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:58:00.911977 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:58:00.911977 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 18:58:00.911977 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:58:00.911977 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 603/1212] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:58:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:58:00.917192 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83732b5d-3fea-47b6-99e1-b1e6a6d77927 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:01.038388 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83732b5d-3fea-47b6-99e1-b1e6a6d77927 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:01.076456 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4ccc4-e5a4-4496-80bf-38e3259d5c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:01.077244 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4ccc4-e5a4-4496-80bf-38e3259d5c80 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:01.077515 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4ccc4-e5a4-4496-80bf-38e3259d5c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:01.077916 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4ccc4-e5a4-4496-80bf-38e3259d5c80 None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:01.078890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4ccc4-e5a4-4496-80bf-38e3259d5c80 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:58:01.079266 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4ccc4-e5a4-4496-80bf-38e3259d5c80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:01.080902 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4ccc4-e5a4-4496-80bf-38e3259d5c80 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:01.103503 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 610/1213] 10.222.0.24 () {56 vars in 1143 bytes} [Mon May 16 18:58:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:58:01.110433 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42bddd-7c6d-436c-b578-78ac401dfba9 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:01.221815 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42bddd-7c6d-436c-b578-78ac401dfba9 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:01.259014 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0119b8-ecae-4434-ad9f-413f0793d828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:01.259736 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0119b8-ecae-4434-ad9f-413f0793d828 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:01.260050 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0119b8-ecae-4434-ad9f-413f0793d828 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:01.260351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0119b8-ecae-4434-ad9f-413f0793d828 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:01.332978 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0119b8-ecae-4434-ad9f-413f0793d828 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:01.334693 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0119b8-ecae-4434-ad9f-413f0793d828 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:01.437466 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 604/1214] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:58:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 16 18:58:01.444911 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4ccc4-e5a4-4496-80bf-38e3259d5c80 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:01.553926 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4ccc4-e5a4-4496-80bf-38e3259d5c80 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:01.593331 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104b4dd-4830-4657-88cc-e1ab5e27b07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:01.594189 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104b4dd-4830-4657-88cc-e1ab5e27b07b None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:01.594471 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104b4dd-4830-4657-88cc-e1ab5e27b07b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:01.594742 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104b4dd-4830-4657-88cc-e1ab5e27b07b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:01.606964 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5104b4dd-4830-4657-88cc-e1ab5e27b07b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:01.609696 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5104b4dd-4830-4657-88cc-e1ab5e27b07b None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:01.630932 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-5104b4dd-4830-4657-88cc-e1ab5e27b07b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:58:01.630932 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:58:01.630932 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:58:01.630932 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:58:01.630932 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:58:01.630932 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:58:01.630932 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:58:01.630932 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:58:01.630932 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:58:01.630932 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:58:01.630932 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:58:01.630932 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:58:01.630932 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:58:01.630932 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:58:01.630932 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:58:01.639296 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:58:01.639296 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:58:01.639296 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:58:01.639296 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:58:01.639296 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:58:01.639296 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:58:01.639296 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:58:01.639296 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:58:01.639296 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:58:01.639296 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:58:01.639296 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:58:01.639296 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:58:01.639296 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:58:01.639296 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:58:01.639296 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:58:01.639296 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:58:01.639296 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:58:01.640213 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:58:01.640213 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:58:01.640213 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:58:01.640213 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:58:01.640213 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 611/1215] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:58:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:58:01.640495 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0119b8-ecae-4434-ad9f-413f0793d828 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:01.757070 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0119b8-ecae-4434-ad9f-413f0793d828 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:01.793241 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944fe78f-1ffd-4f4e-ada7-c9228a6e5e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:01.793972 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fe78f-1ffd-4f4e-ada7-c9228a6e5e30 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:01.795274 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fe78f-1ffd-4f4e-ada7-c9228a6e5e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:01.795274 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fe78f-1ffd-4f4e-ada7-c9228a6e5e30 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:01.795445 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944fe78f-1ffd-4f4e-ada7-c9228a6e5e30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:58:01.795647 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944fe78f-1ffd-4f4e-ada7-c9228a6e5e30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:01.797067 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944fe78f-1ffd-4f4e-ada7-c9228a6e5e30 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:01.812360 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 605/1216] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:58:01.818335 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104b4dd-4830-4657-88cc-e1ab5e27b07b None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:01.927623 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104b4dd-4830-4657-88cc-e1ab5e27b07b None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:01.967150 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec72217-e62d-45c1-b8f8-bbb6056e8b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:01.967968 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec72217-e62d-45c1-b8f8-bbb6056e8b21 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:01.968251 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec72217-e62d-45c1-b8f8-bbb6056e8b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:01.968526 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec72217-e62d-45c1-b8f8-bbb6056e8b21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:01.975519 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec72217-e62d-45c1-b8f8-bbb6056e8b21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:01.977248 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec72217-e62d-45c1-b8f8-bbb6056e8b21 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:01.993339 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-2ec72217-e62d-45c1-b8f8-bbb6056e8b21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:58:01.993339 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:58:01.993339 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:58:01.993339 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:58:01.993339 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:58:01.993339 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:58:01.993339 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:58:01.993339 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:58:01.993339 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:58:01.993339 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:58:01.993339 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:58:01.993339 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:58:01.993339 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:58:01.993339 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:58:01.993339 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:58:01.994686 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:58:01.994686 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:58:01.994686 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:58:01.994686 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:58:01.994686 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:58:01.994686 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:58:01.994686 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:58:01.994686 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:58:01.994686 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:58:01.994686 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:58:01.994686 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:58:01.994686 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:58:01.994686 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:58:01.994686 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:58:01.994686 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:58:01.994686 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:58:01.994686 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:58:01.995617 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:58:01.995617 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:58:01.995617 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:58:01.995617 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:58:01.995617 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:58:01.995617 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:58:01.995617 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:58:01.995617 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:58:01.995617 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 612/1217] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:58:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:58:02.002707 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944fe78f-1ffd-4f4e-ada7-c9228a6e5e30 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:02.110976 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944fe78f-1ffd-4f4e-ada7-c9228a6e5e30 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:02.152440 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97aab44-933c-4cb5-b082-bcb4b513573f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:02.153171 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97aab44-933c-4cb5-b082-bcb4b513573f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:02.153456 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97aab44-933c-4cb5-b082-bcb4b513573f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:02.153762 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97aab44-933c-4cb5-b082-bcb4b513573f None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:02.154558 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97aab44-933c-4cb5-b082-bcb4b513573f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:58:02.154950 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97aab44-933c-4cb5-b082-bcb4b513573f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:02.156758 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97aab44-933c-4cb5-b082-bcb4b513573f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:02.174394 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 606/1218] 10.222.0.24 () {56 vars in 1148 bytes} [Mon May 16 18:58:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:58:02.176437 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec72217-e62d-45c1-b8f8-bbb6056e8b21 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:02.292452 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec72217-e62d-45c1-b8f8-bbb6056e8b21 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:02.328829 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c63b8-437f-46c8-8a1b-53dddf1cd9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:02.330562 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c63b8-437f-46c8-8a1b-53dddf1cd9ba None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:02.330562 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c63b8-437f-46c8-8a1b-53dddf1cd9ba None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:02.330562 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c63b8-437f-46c8-8a1b-53dddf1cd9ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:02.330964 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c63b8-437f-46c8-8a1b-53dddf1cd9ba None admin] RBAC: Adding query filter params (role.id=48c59cffd0c84f83b89761ff42040687, scope.project.id=084e70bbad784892b195bb11a68bf857, user.id=629742b135b2447898e8291d9a360295) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:58:02.331149 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c63b8-437f-46c8-8a1b-53dddf1cd9ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:02.332607 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c63b8-437f-46c8-8a1b-53dddf1cd9ba None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:02.338810 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 613/1219] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:58:02 2022] GET /identity/v3/role_assignments?user.id=629742b135b2447898e8291d9a360295&scope.project.id=084e70bbad784892b195bb11a68bf857&role.id=48c59cffd0c84f83b89761ff42040687 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:58:04.735782 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593ec23-3f3b-42b0-9c60-24d2a94d5176 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:04.736352 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593ec23-3f3b-42b0-9c60-24d2a94d5176 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:04.736352 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593ec23-3f3b-42b0-9c60-24d2a94d5176 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:04.737912 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 607/1220] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:58:04.744294 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92184cf-d9db-44e0-b9e3-1f22761ee812 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:04.744850 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92184cf-d9db-44e0-b9e3-1f22761ee812 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:04.744987 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92184cf-d9db-44e0-b9e3-1f22761ee812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:04.764332 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-a92184cf-d9db-44e0-b9e3-1f22761ee812 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:58:04.766038 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a92184cf-d9db-44e0-b9e3-1f22761ee812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:58:04.842173 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 614/1221] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:58:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:58:04.867115 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593ec23-3f3b-42b0-9c60-24d2a94d5176 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:04.973316 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593ec23-3f3b-42b0-9c60-24d2a94d5176 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:05.008647 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652e285-bc38-463e-a312-5ac24f21c89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:05.009548 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652e285-bc38-463e-a312-5ac24f21c89c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:05.009743 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652e285-bc38-463e-a312-5ac24f21c89c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:05.009998 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652e285-bc38-463e-a312-5ac24f21c89c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:05.022831 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652e285-bc38-463e-a312-5ac24f21c89c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:58:05.031780 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-d652e285-bc38-463e-a312-5ac24f21c89c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 18:58:05.031780 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:58:05.031780 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:58:05.031780 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:58:05.031780 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:58:05.031780 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:58:05.031780 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:58:05.031780 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:58:05.031780 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:58:05.031780 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:58:05.031780 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:58:05.031780 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:58:05.031780 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:58:05.031780 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:58:05.031780 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:58:05.031780 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:58:05.032834 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:58:05.032834 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:58:05.032834 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:58:05.032834 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:58:05.032834 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:58:05.032834 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:58:05.032834 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:58:05.032834 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:58:05.032834 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:58:05.032834 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:58:05.032834 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:58:05.032834 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:58:05.032834 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:58:05.032834 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:58:05.032834 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:58:05.032834 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:58:05.034127 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:58:05.034127 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:58:05.034127 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:58:05.034127 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:58:05.034127 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:58:05.034127 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:58:05.034127 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:58:05.034127 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:58:05.034127 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:58:05.034127 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:58:05.034127 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 18:58:05.034127 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:58:05.034127 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 608/1222] 10.222.0.24 () {56 vars in 1102 bytes} [Mon May 16 18:58:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:58:05.040700 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92184cf-d9db-44e0-b9e3-1f22761ee812 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:05.156401 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92184cf-d9db-44e0-b9e3-1f22761ee812 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:05.192819 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841275c5-e281-4bc6-979c-f2e4f2b3a79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:05.193497 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841275c5-e281-4bc6-979c-f2e4f2b3a79f None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:05.193816 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841275c5-e281-4bc6-979c-f2e4f2b3a79f None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:05.194093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841275c5-e281-4bc6-979c-f2e4f2b3a79f None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:05.194843 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841275c5-e281-4bc6-979c-f2e4f2b3a79f None admin] RBAC: Adding query filter params (name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:58:05.195154 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841275c5-e281-4bc6-979c-f2e4f2b3a79f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:05.196546 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841275c5-e281-4bc6-979c-f2e4f2b3a79f None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:05.204390 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 615/1223] 10.222.0.24 () {56 vars in 1103 bytes} [Mon May 16 18:58:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:58:05.210295 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652e285-bc38-463e-a312-5ac24f21c89c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:05.314759 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652e285-bc38-463e-a312-5ac24f21c89c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:05.349152 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f423cc7-0fcd-4135-8083-95e9d8206e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:05.349984 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f423cc7-0fcd-4135-8083-95e9d8206e85 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:05.350303 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f423cc7-0fcd-4135-8083-95e9d8206e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:05.350687 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f423cc7-0fcd-4135-8083-95e9d8206e85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:05.361696 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f423cc7-0fcd-4135-8083-95e9d8206e85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:05.363166 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f423cc7-0fcd-4135-8083-95e9d8206e85 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:05.380933 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-7f423cc7-0fcd-4135-8083-95e9d8206e85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:58:05.380933 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:58:05.380933 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:58:05.380933 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:58:05.380933 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:58:05.380933 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:58:05.380933 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:58:05.380933 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:58:05.380933 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:58:05.380933 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:58:05.380933 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:58:05.380933 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:58:05.380933 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:58:05.380933 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:58:05.380933 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:58:05.382102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:58:05.382102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:58:05.382102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:58:05.382102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:58:05.382102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:58:05.382102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:58:05.382102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:58:05.382102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:58:05.382102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:58:05.382102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:58:05.382102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:58:05.382102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:58:05.382102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:58:05.382102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:58:05.382102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:58:05.382102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:58:05.382102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:58:05.383345 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:58:05.383345 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:58:05.383345 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:58:05.383345 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:58:05.383345 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 609/1224] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:58:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:58:05.389089 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841275c5-e281-4bc6-979c-f2e4f2b3a79f None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:05.494439 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841275c5-e281-4bc6-979c-f2e4f2b3a79f None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:05.529386 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d94ffb-ffbe-4a75-ab79-d78693d1a2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:05.530116 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d94ffb-ffbe-4a75-ab79-d78693d1a2d0 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:05.530748 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d94ffb-ffbe-4a75-ab79-d78693d1a2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:05.531072 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d94ffb-ffbe-4a75-ab79-d78693d1a2d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:05.531864 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d94ffb-ffbe-4a75-ab79-d78693d1a2d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:58:05.532228 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d94ffb-ffbe-4a75-ab79-d78693d1a2d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:05.533903 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d94ffb-ffbe-4a75-ab79-d78693d1a2d0 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:05.547083 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 616/1225] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:58:05.552853 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f423cc7-0fcd-4135-8083-95e9d8206e85 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:05.664237 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f423cc7-0fcd-4135-8083-95e9d8206e85 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:05.702825 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4e849-0227-4ce7-a7d3-52c788c1ff54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:05.703649 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4e849-0227-4ce7-a7d3-52c788c1ff54 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:05.703927 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4e849-0227-4ce7-a7d3-52c788c1ff54 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:05.704199 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4e849-0227-4ce7-a7d3-52c788c1ff54 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:05.711725 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4e849-0227-4ce7-a7d3-52c788c1ff54 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:05.714346 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4e849-0227-4ce7-a7d3-52c788c1ff54 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:05.729152 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-18e4e849-0227-4ce7-a7d3-52c788c1ff54 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 18:58:05.729152 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:58:05.729152 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:58:05.729152 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:58:05.729152 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:58:05.729152 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:58:05.729152 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:58:05.729152 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:58:05.729152 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:58:05.729152 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:58:05.729152 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:58:05.729152 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:58:05.729152 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:58:05.729152 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:58:05.729152 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:58:05.729152 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:58:05.730327 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:58:05.730327 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:58:05.730327 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:58:05.730327 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:58:05.730327 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:58:05.730327 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:58:05.730327 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:58:05.730327 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:58:05.730327 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:58:05.730327 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:58:05.730327 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:58:05.730327 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:58:05.730327 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:58:05.730327 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:58:05.730327 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:58:05.730327 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:58:05.730327 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:58:05.730327 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:58:05.731292 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:58:05.731292 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:58:05.731292 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:58:05.731292 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:58:05.731292 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:58:05.731292 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:58:05.731292 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:58:05.731292 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:58:05.731292 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 18:58:05.731292 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:58:05.731292 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 610/1226] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:58:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:58:05.736251 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d94ffb-ffbe-4a75-ab79-d78693d1a2d0 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:05.837746 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d94ffb-ffbe-4a75-ab79-d78693d1a2d0 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:05.876220 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f67a7-17b3-424f-b7f1-ea678f67e180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:05.876910 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f67a7-17b3-424f-b7f1-ea678f67e180 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:05.877194 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f67a7-17b3-424f-b7f1-ea678f67e180 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:05.877491 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f67a7-17b3-424f-b7f1-ea678f67e180 None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:05.878465 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405f67a7-17b3-424f-b7f1-ea678f67e180 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:58:05.878834 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405f67a7-17b3-424f-b7f1-ea678f67e180 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:05.880403 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405f67a7-17b3-424f-b7f1-ea678f67e180 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:05.898307 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 617/1227] 10.222.0.24 () {56 vars in 1143 bytes} [Mon May 16 18:58:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:58:05.904441 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4e849-0227-4ce7-a7d3-52c788c1ff54 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:06.014470 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4e849-0227-4ce7-a7d3-52c788c1ff54 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:06.049272 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4b3f8-b02b-4361-bbc2-99891f4b2560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:06.050192 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4b3f8-b02b-4361-bbc2-99891f4b2560 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:06.050534 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4b3f8-b02b-4361-bbc2-99891f4b2560 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:06.050870 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4b3f8-b02b-4361-bbc2-99891f4b2560 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:06.062123 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b4b3f8-b02b-4361-bbc2-99891f4b2560 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:06.063602 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b4b3f8-b02b-4361-bbc2-99891f4b2560 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:06.082799 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-41b4b3f8-b02b-4361-bbc2-99891f4b2560 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:58:06.082799 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:58:06.082799 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:58:06.082799 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:58:06.082799 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:58:06.082799 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:58:06.082799 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:58:06.082799 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:58:06.082799 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:58:06.082799 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:58:06.082799 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:58:06.082799 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:58:06.082799 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:58:06.082799 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:58:06.082799 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:58:06.083805 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:58:06.083805 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:58:06.083805 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:58:06.083805 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:58:06.083805 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:58:06.083805 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:58:06.083805 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:58:06.083805 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:58:06.083805 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:58:06.083805 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:58:06.083805 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:58:06.083805 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:58:06.083805 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:58:06.083805 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:58:06.083805 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:58:06.083805 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:58:06.083805 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:58:06.084697 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:58:06.084697 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:58:06.084697 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:58:06.084697 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:58:06.084697 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 611/1228] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:58:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:58:06.090249 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f67a7-17b3-424f-b7f1-ea678f67e180 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:06.198456 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f67a7-17b3-424f-b7f1-ea678f67e180 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:06.235222 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045798f6-a4ee-4946-b3eb-7617f626ce26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:06.235895 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045798f6-a4ee-4946-b3eb-7617f626ce26 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:06.236179 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045798f6-a4ee-4946-b3eb-7617f626ce26 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:06.236450 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045798f6-a4ee-4946-b3eb-7617f626ce26 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:06.237189 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045798f6-a4ee-4946-b3eb-7617f626ce26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:58:06.237559 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045798f6-a4ee-4946-b3eb-7617f626ce26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:06.239059 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045798f6-a4ee-4946-b3eb-7617f626ce26 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:06.251122 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 618/1229] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:58:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:58:06.257020 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4b3f8-b02b-4361-bbc2-99891f4b2560 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:06.360291 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4b3f8-b02b-4361-bbc2-99891f4b2560 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:06.397855 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd93ad1-e297-4abc-9754-fdb8afd2ffdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:06.398683 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd93ad1-e297-4abc-9754-fdb8afd2ffdc None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:06.398968 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd93ad1-e297-4abc-9754-fdb8afd2ffdc None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:06.399263 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd93ad1-e297-4abc-9754-fdb8afd2ffdc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:06.407478 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd93ad1-e297-4abc-9754-fdb8afd2ffdc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:06.409445 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd93ad1-e297-4abc-9754-fdb8afd2ffdc None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:06.426789 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-6bd93ad1-e297-4abc-9754-fdb8afd2ffdc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:58:06.426789 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:58:06.426789 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:58:06.426789 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:58:06.426789 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:58:06.426789 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:58:06.426789 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:58:06.426789 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:58:06.426789 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:58:06.426789 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:58:06.426789 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:58:06.426789 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:58:06.426789 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:58:06.426789 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:58:06.426789 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:58:06.427836 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:58:06.427836 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:58:06.427836 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:58:06.427836 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:58:06.427836 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:58:06.427836 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:58:06.427836 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:58:06.427836 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:58:06.427836 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:58:06.427836 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:58:06.427836 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:58:06.427836 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:58:06.427836 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:58:06.427836 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:58:06.427836 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:58:06.427836 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:58:06.427836 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:58:06.428761 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:58:06.428761 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:58:06.428761 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:58:06.428761 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:58:06.428761 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:58:06.428761 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:58:06.428761 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:58:06.428761 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:58:06.435712 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045798f6-a4ee-4946-b3eb-7617f626ce26 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:06.436123 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 612/1230] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:58:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:58:06.545390 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045798f6-a4ee-4946-b3eb-7617f626ce26 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:06.584623 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c0bd0-8be5-4570-ad3b-6bbe249dad1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:06.585296 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c0bd0-8be5-4570-ad3b-6bbe249dad1a None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:06.585609 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c0bd0-8be5-4570-ad3b-6bbe249dad1a None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:06.585888 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c0bd0-8be5-4570-ad3b-6bbe249dad1a None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:06.586687 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c0bd0-8be5-4570-ad3b-6bbe249dad1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:58:06.587001 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c0bd0-8be5-4570-ad3b-6bbe249dad1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:06.588456 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c0bd0-8be5-4570-ad3b-6bbe249dad1a None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:06.606240 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 619/1231] 10.222.0.24 () {56 vars in 1148 bytes} [Mon May 16 18:58:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:58:06.608095 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd93ad1-e297-4abc-9754-fdb8afd2ffdc None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:06.714769 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd93ad1-e297-4abc-9754-fdb8afd2ffdc None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:06.747556 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28701062-fb09-4ca2-9867-22af6c8cceef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:06.748463 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28701062-fb09-4ca2-9867-22af6c8cceef None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:06.748717 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28701062-fb09-4ca2-9867-22af6c8cceef None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:06.748989 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28701062-fb09-4ca2-9867-22af6c8cceef None admin] PATH_INFO: `/v3/projects/084e70bbad784892b195bb11a68bf857/users/629742b135b2447898e8291d9a360295/roles/48c59cffd0c84f83b89761ff42040687` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:06.763076 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28701062-fb09-4ca2-9867-22af6c8cceef None admin] RBAC: Authorizing `identity:create_grant(project_id=084e70bbad784892b195bb11a68bf857, user_id=629742b135b2447898e8291d9a360295, role_id=48c59cffd0c84f83b89761ff42040687)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:06.764566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28701062-fb09-4ca2-9867-22af6c8cceef None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:06.779569 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 613/1232] 10.222.0.24 () {58 vars in 1439 bytes} [Mon May 16 18:58:06 2022] PUT /identity/v3/projects/084e70bbad784892b195bb11a68bf857/users/629742b135b2447898e8291d9a360295/roles/48c59cffd0c84f83b89761ff42040687 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:58:09.059627 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d683b5-4b9e-42fb-80ba-9acf033f544d None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:09.060291 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d683b5-4b9e-42fb-80ba-9acf033f544d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:09.060291 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d683b5-4b9e-42fb-80ba-9acf033f544d None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:09.062419 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 620/1233] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:58:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:58:09.067878 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfab61-ddef-48ad-b7da-75d7e9c010bf None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:09.068317 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfab61-ddef-48ad-b7da-75d7e9c010bf None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:09.068467 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfab61-ddef-48ad-b7da-75d7e9c010bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:09.086383 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-06dfab61-ddef-48ad-b7da-75d7e9c010bf None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:58:09.087605 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-06dfab61-ddef-48ad-b7da-75d7e9c010bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:58:09.157218 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 614/1234] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:58:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:58:09.180452 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d683b5-4b9e-42fb-80ba-9acf033f544d None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:09.287596 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d683b5-4b9e-42fb-80ba-9acf033f544d None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:09.322876 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3343d-1a7f-41e4-9392-5db982e97188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:09.323603 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3343d-1a7f-41e4-9392-5db982e97188 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:09.323950 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3343d-1a7f-41e4-9392-5db982e97188 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:09.324224 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3343d-1a7f-41e4-9392-5db982e97188 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:09.334163 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3343d-1a7f-41e4-9392-5db982e97188 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:58:09.341866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-7ae3343d-1a7f-41e4-9392-5db982e97188 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 18:58:09.341866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:58:09.341866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:58:09.341866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:58:09.341866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:58:09.341866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:58:09.341866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:58:09.341866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:58:09.341866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:58:09.341866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:58:09.341866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:58:09.341866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:58:09.341866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:58:09.341866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:58:09.341866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:58:09.341866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:58:09.348208 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:58:09.348208 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:58:09.348208 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:58:09.348208 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:58:09.348208 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:58:09.348208 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:58:09.348208 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:58:09.348208 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:58:09.348208 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:58:09.348208 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:58:09.348208 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:58:09.348208 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:58:09.348208 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:58:09.348208 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:58:09.348208 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:58:09.348208 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:58:09.349408 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:58:09.349408 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:58:09.349408 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:58:09.349408 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:58:09.349408 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:58:09.349408 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:58:09.349408 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:58:09.349408 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:58:09.349408 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:58:09.349408 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:58:09.349408 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 18:58:09.349408 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:58:09.349408 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 621/1235] 10.222.0.24 () {56 vars in 1102 bytes} [Mon May 16 18:58:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:58:09.351442 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dfab61-ddef-48ad-b7da-75d7e9c010bf None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:09.454156 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dfab61-ddef-48ad-b7da-75d7e9c010bf None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:09.488735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd75cc5-087f-4d26-b323-c58113d63038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:09.489617 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd75cc5-087f-4d26-b323-c58113d63038 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:09.489899 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd75cc5-087f-4d26-b323-c58113d63038 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:09.490177 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd75cc5-087f-4d26-b323-c58113d63038 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:09.490943 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd75cc5-087f-4d26-b323-c58113d63038 None admin] RBAC: Adding query filter params (name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:58:09.491250 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd75cc5-087f-4d26-b323-c58113d63038 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:09.492792 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd75cc5-087f-4d26-b323-c58113d63038 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:09.502451 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 615/1236] 10.222.0.24 () {56 vars in 1103 bytes} [Mon May 16 18:58:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:58:09.508513 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3343d-1a7f-41e4-9392-5db982e97188 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:09.617729 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3343d-1a7f-41e4-9392-5db982e97188 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:09.657046 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7f828-7253-419f-8ae2-872f5609adbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:09.657954 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7f828-7253-419f-8ae2-872f5609adbd None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:09.658291 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7f828-7253-419f-8ae2-872f5609adbd None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:09.658583 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7f828-7253-419f-8ae2-872f5609adbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:09.670023 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc7f828-7253-419f-8ae2-872f5609adbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:09.671593 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc7f828-7253-419f-8ae2-872f5609adbd None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:09.689308 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-abc7f828-7253-419f-8ae2-872f5609adbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:58:09.689308 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:58:09.689308 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:58:09.689308 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:58:09.689308 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:58:09.689308 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:58:09.689308 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:58:09.689308 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:58:09.689308 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:58:09.689308 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:58:09.689308 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:58:09.689308 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:58:09.689308 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:58:09.689308 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:58:09.689308 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:58:09.690458 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:58:09.690458 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:58:09.690458 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:58:09.690458 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:58:09.690458 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:58:09.690458 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:58:09.690458 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:58:09.690458 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:58:09.690458 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:58:09.690458 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:58:09.690458 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:58:09.690458 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:58:09.690458 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:58:09.690458 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:58:09.690458 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:58:09.690458 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:58:09.690458 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:58:09.691473 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:58:09.691473 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:58:09.691473 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:58:09.691473 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:58:09.691473 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 622/1237] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:58:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:58:09.696572 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd75cc5-087f-4d26-b323-c58113d63038 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:09.799452 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd75cc5-087f-4d26-b323-c58113d63038 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:09.834720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80d742-a638-49a6-a227-e21f0db034cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:09.835398 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80d742-a638-49a6-a227-e21f0db034cf None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:09.835678 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80d742-a638-49a6-a227-e21f0db034cf None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:09.835950 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80d742-a638-49a6-a227-e21f0db034cf None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:09.836676 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec80d742-a638-49a6-a227-e21f0db034cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:58:09.836984 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec80d742-a638-49a6-a227-e21f0db034cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:09.838409 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec80d742-a638-49a6-a227-e21f0db034cf None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:09.850987 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 616/1238] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:58:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:58:09.857272 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7f828-7253-419f-8ae2-872f5609adbd None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:09.965558 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7f828-7253-419f-8ae2-872f5609adbd None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:10.001943 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c179249-35f1-4f8d-bc27-0cee44f04f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:10.002756 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c179249-35f1-4f8d-bc27-0cee44f04f3c None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:10.003048 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c179249-35f1-4f8d-bc27-0cee44f04f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:10.003306 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c179249-35f1-4f8d-bc27-0cee44f04f3c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:10.011068 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c179249-35f1-4f8d-bc27-0cee44f04f3c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:10.012529 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c179249-35f1-4f8d-bc27-0cee44f04f3c None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:10.028067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-2c179249-35f1-4f8d-bc27-0cee44f04f3c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 18:58:10.028067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:58:10.028067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:58:10.028067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:58:10.028067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:58:10.028067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:58:10.028067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:58:10.028067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:58:10.028067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:58:10.028067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:58:10.028067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:58:10.028067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:58:10.028067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:58:10.028067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:58:10.028067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:58:10.028067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:58:10.029281 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:58:10.029281 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:58:10.029281 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:58:10.029281 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:58:10.029281 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:58:10.029281 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:58:10.029281 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:58:10.029281 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:58:10.029281 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:58:10.029281 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:58:10.029281 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:58:10.029281 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:58:10.029281 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:58:10.029281 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:58:10.029281 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:58:10.029281 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:58:10.029281 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:58:10.029281 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:58:10.030722 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:58:10.030722 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:58:10.030722 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:58:10.030722 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:58:10.030722 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:58:10.030722 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:58:10.030722 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:58:10.030722 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:58:10.030722 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 18:58:10.030722 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:58:10.030722 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 623/1239] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:58:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:58:10.035739 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80d742-a638-49a6-a227-e21f0db034cf None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:10.141807 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80d742-a638-49a6-a227-e21f0db034cf None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:10.175764 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74052521-71e5-4f88-8530-cb37558fa801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:10.176443 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74052521-71e5-4f88-8530-cb37558fa801 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:10.176777 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74052521-71e5-4f88-8530-cb37558fa801 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:10.177130 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74052521-71e5-4f88-8530-cb37558fa801 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:10.177995 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74052521-71e5-4f88-8530-cb37558fa801 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:58:10.178302 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74052521-71e5-4f88-8530-cb37558fa801 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:10.179754 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74052521-71e5-4f88-8530-cb37558fa801 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:10.197559 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 617/1240] 10.222.0.24 () {56 vars in 1143 bytes} [Mon May 16 18:58:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:58:10.203520 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c179249-35f1-4f8d-bc27-0cee44f04f3c None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:10.318190 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c179249-35f1-4f8d-bc27-0cee44f04f3c None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:10.355904 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c2e18-457a-487e-a522-ec9b78381c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:10.356555 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c2e18-457a-487e-a522-ec9b78381c09 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:10.356830 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c2e18-457a-487e-a522-ec9b78381c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:10.357099 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c2e18-457a-487e-a522-ec9b78381c09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:10.441685 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c2e18-457a-487e-a522-ec9b78381c09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:10.443569 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c2e18-457a-487e-a522-ec9b78381c09 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:10.563451 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 624/1241] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:58:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 18:58:10.569971 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74052521-71e5-4f88-8530-cb37558fa801 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:10.677849 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74052521-71e5-4f88-8530-cb37558fa801 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:10.711541 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3b83f-9437-4a66-95b6-5e54e0c892e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:10.712409 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3b83f-9437-4a66-95b6-5e54e0c892e9 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:10.712725 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3b83f-9437-4a66-95b6-5e54e0c892e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:10.712998 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3b83f-9437-4a66-95b6-5e54e0c892e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:10.724968 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3b83f-9437-4a66-95b6-5e54e0c892e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:10.726554 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3b83f-9437-4a66-95b6-5e54e0c892e9 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:10.745086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-ade3b83f-9437-4a66-95b6-5e54e0c892e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:58:10.745086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:58:10.745086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:58:10.745086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:58:10.745086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:58:10.745086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:58:10.745086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:58:10.745086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:58:10.745086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:58:10.745086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:58:10.745086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:58:10.745086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:58:10.745086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:58:10.745086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:58:10.745086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:58:10.746388 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:58:10.746388 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:58:10.746388 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:58:10.746388 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:58:10.746388 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:58:10.746388 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:58:10.746388 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:58:10.746388 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:58:10.746388 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:58:10.746388 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:58:10.746388 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:58:10.746388 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:58:10.746388 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:58:10.746388 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:58:10.746388 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:58:10.746388 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:58:10.746388 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:58:10.747627 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:58:10.747627 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:58:10.747627 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:58:10.747627 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:58:10.747627 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 618/1242] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:58:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:58:10.752737 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c2e18-457a-487e-a522-ec9b78381c09 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:10.856219 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c2e18-457a-487e-a522-ec9b78381c09 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:10.892355 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974432a0-03db-40bd-a01c-f2c0ad51144c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:10.893302 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974432a0-03db-40bd-a01c-f2c0ad51144c None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:10.893645 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974432a0-03db-40bd-a01c-f2c0ad51144c None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:10.893922 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974432a0-03db-40bd-a01c-f2c0ad51144c None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:10.894658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974432a0-03db-40bd-a01c-f2c0ad51144c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:58:10.895094 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974432a0-03db-40bd-a01c-f2c0ad51144c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:10.896557 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974432a0-03db-40bd-a01c-f2c0ad51144c None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:10.911600 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 625/1243] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:58:10.917951 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3b83f-9437-4a66-95b6-5e54e0c892e9 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:11.023822 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3b83f-9437-4a66-95b6-5e54e0c892e9 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:11.062648 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec583333-7bdb-4ea0-8eb0-5a4f0e5ee8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:11.063456 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec583333-7bdb-4ea0-8eb0-5a4f0e5ee8b6 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:11.063732 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec583333-7bdb-4ea0-8eb0-5a4f0e5ee8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:11.064002 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec583333-7bdb-4ea0-8eb0-5a4f0e5ee8b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:11.071532 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec583333-7bdb-4ea0-8eb0-5a4f0e5ee8b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:11.072999 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec583333-7bdb-4ea0-8eb0-5a4f0e5ee8b6 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:11.089013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-ec583333-7bdb-4ea0-8eb0-5a4f0e5ee8b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:58:11.089013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:58:11.089013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:58:11.089013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:58:11.089013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:58:11.089013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:58:11.089013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:58:11.089013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:58:11.089013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:58:11.089013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:58:11.089013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:58:11.089013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:58:11.089013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:58:11.089013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:58:11.089013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:58:11.090233 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:58:11.090233 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:58:11.090233 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:58:11.090233 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:58:11.090233 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:58:11.090233 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:58:11.090233 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:58:11.090233 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:58:11.090233 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:58:11.090233 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:58:11.090233 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:58:11.090233 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:58:11.090233 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:58:11.090233 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:58:11.090233 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:58:11.090233 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:58:11.090233 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:58:11.091348 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:58:11.091348 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:58:11.091348 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:58:11.091348 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:58:11.091348 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:58:11.091348 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:58:11.091348 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:58:11.091348 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:58:11.091348 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 619/1244] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:58:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:58:11.096935 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974432a0-03db-40bd-a01c-f2c0ad51144c None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:11.203137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974432a0-03db-40bd-a01c-f2c0ad51144c None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:11.237370 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9d048-c215-4845-8aa4-0e5fed8aa21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:11.238090 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9d048-c215-4845-8aa4-0e5fed8aa21e None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:11.238368 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9d048-c215-4845-8aa4-0e5fed8aa21e None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:11.238638 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9d048-c215-4845-8aa4-0e5fed8aa21e None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:11.239424 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9d048-c215-4845-8aa4-0e5fed8aa21e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:58:11.239731 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9d048-c215-4845-8aa4-0e5fed8aa21e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:11.241171 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9d048-c215-4845-8aa4-0e5fed8aa21e None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:11.253929 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 626/1245] 10.222.0.24 () {56 vars in 1148 bytes} [Mon May 16 18:58:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:58:11.259861 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec583333-7bdb-4ea0-8eb0-5a4f0e5ee8b6 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:11.367874 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec583333-7bdb-4ea0-8eb0-5a4f0e5ee8b6 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:11.401489 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598d071-f1ec-436d-bca3-d8d518a5068b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:11.402138 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598d071-f1ec-436d-bca3-d8d518a5068b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:11.402448 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598d071-f1ec-436d-bca3-d8d518a5068b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:11.402721 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598d071-f1ec-436d-bca3-d8d518a5068b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:11.403549 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0598d071-f1ec-436d-bca3-d8d518a5068b None admin] RBAC: Adding query filter params (role.id=48c59cffd0c84f83b89761ff42040687, scope.project.id=084e70bbad784892b195bb11a68bf857, user.id=629742b135b2447898e8291d9a360295) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:58:11.403836 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0598d071-f1ec-436d-bca3-d8d518a5068b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:11.405680 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0598d071-f1ec-436d-bca3-d8d518a5068b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:11.411597 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 620/1246] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:58:11 2022] GET /identity/v3/role_assignments?user.id=629742b135b2447898e8291d9a360295&scope.project.id=084e70bbad784892b195bb11a68bf857&role.id=48c59cffd0c84f83b89761ff42040687 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:58:13.798694 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79747a9-f0e1-4d42-ab66-dc742c4c11db None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:13.799332 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79747a9-f0e1-4d42-ab66-dc742c4c11db None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:13.799332 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79747a9-f0e1-4d42-ab66-dc742c4c11db None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:13.801071 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 627/1247] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:58:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:58:13.806703 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39678b-7393-43ee-98c8-e8dc678db9e0 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:13.807318 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39678b-7393-43ee-98c8-e8dc678db9e0 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:13.807318 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39678b-7393-43ee-98c8-e8dc678db9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:13.825315 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-cc39678b-7393-43ee-98c8-e8dc678db9e0 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:58:13.826531 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-cc39678b-7393-43ee-98c8-e8dc678db9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:58:13.901227 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 621/1248] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:58:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 18:58:13.935340 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79747a9-f0e1-4d42-ab66-dc742c4c11db None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:14.050014 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79747a9-f0e1-4d42-ab66-dc742c4c11db None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:14.085847 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df10bf9-4f02-442c-8c80-7595e444a683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:14.086727 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df10bf9-4f02-442c-8c80-7595e444a683 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:14.087015 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df10bf9-4f02-442c-8c80-7595e444a683 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:14.087412 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df10bf9-4f02-442c-8c80-7595e444a683 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:14.098118 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df10bf9-4f02-442c-8c80-7595e444a683 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:58:14.105802 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-2df10bf9-4f02-442c-8c80-7595e444a683 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:58:14.105802 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:58:14.105802 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:58:14.105802 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:58:14.105802 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:58:14.105802 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:58:14.105802 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:58:14.105802 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:58:14.105802 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:58:14.105802 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:58:14.105802 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:58:14.105802 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:58:14.105802 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:58:14.105802 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:58:14.105802 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:58:14.105802 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:58:14.106934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:58:14.106934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:58:14.106934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:58:14.106934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:58:14.106934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:58:14.106934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:58:14.106934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:58:14.106934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:58:14.106934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:58:14.106934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:58:14.106934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:58:14.106934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:58:14.106934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:58:14.106934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:58:14.106934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:58:14.106934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:58:14.107813 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:58:14.107813 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:58:14.107813 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:58:14.107813 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:58:14.107813 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:58:14.107813 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:58:14.107813 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:58:14.107813 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:58:14.107813 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:58:14.107813 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:58:14.107813 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:58:14.107813 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:58:14.108654 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 628/1249] 10.222.0.24 () {56 vars in 1096 bytes} [Mon May 16 18:58:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:58:14.114752 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39678b-7393-43ee-98c8-e8dc678db9e0 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:14.217539 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39678b-7393-43ee-98c8-e8dc678db9e0 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:14.254489 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d238d76-6463-4758-946e-c41c9eaa94c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:14.255223 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d238d76-6463-4758-946e-c41c9eaa94c9 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:14.255505 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d238d76-6463-4758-946e-c41c9eaa94c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:14.255773 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d238d76-6463-4758-946e-c41c9eaa94c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:14.256548 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d238d76-6463-4758-946e-c41c9eaa94c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:58:14.256946 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d238d76-6463-4758-946e-c41c9eaa94c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:14.258482 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d238d76-6463-4758-946e-c41c9eaa94c9 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:14.266788 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 622/1250] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:58:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:58:14.272920 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df10bf9-4f02-442c-8c80-7595e444a683 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:14.383788 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df10bf9-4f02-442c-8c80-7595e444a683 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:14.419408 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2cdd3-7b6f-40f3-8fc1-1a9cc65ac7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:14.420209 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2cdd3-7b6f-40f3-8fc1-1a9cc65ac7a2 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:14.420480 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2cdd3-7b6f-40f3-8fc1-1a9cc65ac7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:14.420747 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2cdd3-7b6f-40f3-8fc1-1a9cc65ac7a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:14.432288 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2cdd3-7b6f-40f3-8fc1-1a9cc65ac7a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:14.434049 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2cdd3-7b6f-40f3-8fc1-1a9cc65ac7a2 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:14.456378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-a1e2cdd3-7b6f-40f3-8fc1-1a9cc65ac7a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:58:14.456378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:58:14.456378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:58:14.456378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:58:14.456378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:58:14.456378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:58:14.456378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:58:14.456378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:58:14.456378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:58:14.456378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:58:14.456378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:58:14.456378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:58:14.456378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:58:14.456378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:58:14.456378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:58:14.457474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:58:14.457474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:58:14.457474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:58:14.457474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:58:14.457474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:58:14.457474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:58:14.457474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:58:14.457474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:58:14.457474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:58:14.457474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:58:14.457474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:58:14.457474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:58:14.457474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:58:14.457474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:58:14.457474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:58:14.457474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:58:14.457474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:58:14.458483 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:58:14.458483 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:58:14.458483 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:58:14.458483 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:58:14.458483 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 629/1251] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:58:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:58:14.464944 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d238d76-6463-4758-946e-c41c9eaa94c9 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:14.572298 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d238d76-6463-4758-946e-c41c9eaa94c9 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:14.609563 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742dfaea-a8ad-4005-a034-458fc6de2f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:14.610403 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742dfaea-a8ad-4005-a034-458fc6de2f9f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:14.610680 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742dfaea-a8ad-4005-a034-458fc6de2f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:14.610984 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742dfaea-a8ad-4005-a034-458fc6de2f9f None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:14.611881 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742dfaea-a8ad-4005-a034-458fc6de2f9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:58:14.612212 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742dfaea-a8ad-4005-a034-458fc6de2f9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:14.614161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742dfaea-a8ad-4005-a034-458fc6de2f9f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:14.629066 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 623/1252] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:58:14.635954 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2cdd3-7b6f-40f3-8fc1-1a9cc65ac7a2 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:14.755637 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2cdd3-7b6f-40f3-8fc1-1a9cc65ac7a2 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:14.793693 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99cb21-df76-4ea2-b96d-913d77b51402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:14.794586 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99cb21-df76-4ea2-b96d-913d77b51402 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:14.794884 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99cb21-df76-4ea2-b96d-913d77b51402 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:14.795303 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99cb21-df76-4ea2-b96d-913d77b51402 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:14.803693 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d99cb21-df76-4ea2-b96d-913d77b51402 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:14.805380 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d99cb21-df76-4ea2-b96d-913d77b51402 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:14.821705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-3d99cb21-df76-4ea2-b96d-913d77b51402 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 18:58:14.821705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:58:14.821705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:58:14.821705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:58:14.821705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:58:14.821705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:58:14.821705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:58:14.821705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:58:14.821705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:58:14.821705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:58:14.821705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:58:14.821705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:58:14.821705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:58:14.821705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:58:14.821705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:58:14.821705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:58:14.822854 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:58:14.822854 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:58:14.822854 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:58:14.822854 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:58:14.822854 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:58:14.822854 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:58:14.822854 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:58:14.822854 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:58:14.822854 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:58:14.822854 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:58:14.822854 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:58:14.822854 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:58:14.822854 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:58:14.822854 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:58:14.822854 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:58:14.822854 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:58:14.822854 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:58:14.822854 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:58:14.823830 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:58:14.823830 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:58:14.823830 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:58:14.823830 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:58:14.823830 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:58:14.823830 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:58:14.823830 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:58:14.823830 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:58:14.823830 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 18:58:14.823830 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:58:14.823830 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 630/1253] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:58:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:58:14.829100 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742dfaea-a8ad-4005-a034-458fc6de2f9f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:14.935128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742dfaea-a8ad-4005-a034-458fc6de2f9f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:14.972366 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f0a05-6985-4511-b202-93ced0d9c5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:14.973062 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f0a05-6985-4511-b202-93ced0d9c5e1 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:14.973433 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f0a05-6985-4511-b202-93ced0d9c5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:14.973755 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f0a05-6985-4511-b202-93ced0d9c5e1 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:14.974756 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f0a05-6985-4511-b202-93ced0d9c5e1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:58:14.975160 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f0a05-6985-4511-b202-93ced0d9c5e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:14.976897 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f0a05-6985-4511-b202-93ced0d9c5e1 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:14.997232 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 624/1254] 10.222.0.24 () {56 vars in 1143 bytes} [Mon May 16 18:58:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:58:15.003027 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99cb21-df76-4ea2-b96d-913d77b51402 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:15.111431 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99cb21-df76-4ea2-b96d-913d77b51402 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:15.148330 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f42c2-071f-45f9-9002-ca6c961d622b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:15.149027 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f42c2-071f-45f9-9002-ca6c961d622b None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:15.149319 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f42c2-071f-45f9-9002-ca6c961d622b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:15.149639 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f42c2-071f-45f9-9002-ca6c961d622b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:15.217118 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f42c2-071f-45f9-9002-ca6c961d622b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:15.218544 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f42c2-071f-45f9-9002-ca6c961d622b None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:15.324624 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 631/1255] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:58:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 16 18:58:15.333591 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f0a05-6985-4511-b202-93ced0d9c5e1 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:15.446810 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f0a05-6985-4511-b202-93ced0d9c5e1 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:15.486252 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8bbcb-4edc-4f05-97fa-a271bfe186b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:15.487191 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8bbcb-4edc-4f05-97fa-a271bfe186b4 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:15.487509 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8bbcb-4edc-4f05-97fa-a271bfe186b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:15.488012 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8bbcb-4edc-4f05-97fa-a271bfe186b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:15.499231 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac8bbcb-4edc-4f05-97fa-a271bfe186b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:15.501162 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac8bbcb-4edc-4f05-97fa-a271bfe186b4 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:15.524086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-1ac8bbcb-4edc-4f05-97fa-a271bfe186b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:58:15.524086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:58:15.524086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:58:15.524086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:58:15.524086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:58:15.524086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:58:15.524086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:58:15.524086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:58:15.524086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:58:15.524086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:58:15.524086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:58:15.524086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:58:15.524086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:58:15.524086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:58:15.524086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:58:15.525143 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:58:15.525143 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:58:15.525143 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:58:15.525143 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:58:15.525143 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:58:15.525143 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:58:15.525143 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:58:15.525143 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:58:15.525143 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:58:15.525143 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:58:15.525143 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:58:15.525143 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:58:15.525143 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:58:15.525143 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:58:15.525143 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:58:15.525143 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:58:15.525143 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:58:15.526176 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:58:15.526176 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:58:15.526176 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:58:15.526176 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:58:15.526176 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 625/1256] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:58:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:58:15.532708 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f42c2-071f-45f9-9002-ca6c961d622b None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:15.641862 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f42c2-071f-45f9-9002-ca6c961d622b None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:15.684621 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a63fa-b557-4596-b1c7-1951dd350955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:15.685272 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a63fa-b557-4596-b1c7-1951dd350955 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:15.685553 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a63fa-b557-4596-b1c7-1951dd350955 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:15.685833 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a63fa-b557-4596-b1c7-1951dd350955 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:15.686549 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a63fa-b557-4596-b1c7-1951dd350955 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:58:15.686851 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a63fa-b557-4596-b1c7-1951dd350955 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:15.688227 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a63fa-b557-4596-b1c7-1951dd350955 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:15.699745 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 632/1257] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:58:15.705524 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8bbcb-4edc-4f05-97fa-a271bfe186b4 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:15.804363 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8bbcb-4edc-4f05-97fa-a271bfe186b4 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:15.838647 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eefdbef-7d55-4ac4-8082-9b59abe4a7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:15.839480 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefdbef-7d55-4ac4-8082-9b59abe4a7d4 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:15.839775 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefdbef-7d55-4ac4-8082-9b59abe4a7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:15.840113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefdbef-7d55-4ac4-8082-9b59abe4a7d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:15.847411 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eefdbef-7d55-4ac4-8082-9b59abe4a7d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:15.849157 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eefdbef-7d55-4ac4-8082-9b59abe4a7d4 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:15.864274 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-9eefdbef-7d55-4ac4-8082-9b59abe4a7d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:58:15.864274 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:58:15.864274 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:58:15.864274 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:58:15.864274 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:58:15.864274 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:58:15.864274 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:58:15.864274 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:58:15.864274 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:58:15.864274 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:58:15.864274 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:58:15.864274 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:58:15.864274 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:58:15.864274 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:58:15.864274 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:58:15.865390 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:58:15.865390 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:58:15.865390 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:58:15.865390 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:58:15.865390 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:58:15.865390 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:58:15.865390 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:58:15.865390 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:58:15.865390 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:58:15.865390 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:58:15.865390 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:58:15.865390 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:58:15.865390 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:58:15.865390 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:58:15.865390 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:58:15.865390 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:58:15.865390 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:58:15.866697 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:58:15.866697 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:58:15.866697 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:58:15.866697 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:58:15.866697 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:58:15.866697 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:58:15.866697 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:58:15.866697 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:58:15.870749 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 626/1258] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:58:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:58:15.871911 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a63fa-b557-4596-b1c7-1951dd350955 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:15.975115 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a63fa-b557-4596-b1c7-1951dd350955 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:16.013065 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c69b6d-317b-4698-b72c-ab302287cd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:16.013799 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c69b6d-317b-4698-b72c-ab302287cd38 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:16.014079 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c69b6d-317b-4698-b72c-ab302287cd38 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:16.014350 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c69b6d-317b-4698-b72c-ab302287cd38 None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:16.015126 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c69b6d-317b-4698-b72c-ab302287cd38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:58:16.015434 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c69b6d-317b-4698-b72c-ab302287cd38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:16.016918 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c69b6d-317b-4698-b72c-ab302287cd38 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:16.036525 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 633/1259] 10.222.0.24 () {56 vars in 1148 bytes} [Mon May 16 18:58:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:58:16.037996 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eefdbef-7d55-4ac4-8082-9b59abe4a7d4 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:16.141973 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eefdbef-7d55-4ac4-8082-9b59abe4a7d4 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:16.178028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd739e47-9a8a-4d59-bfe6-45d059c2c3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:16.178788 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd739e47-9a8a-4d59-bfe6-45d059c2c3a0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:16.179096 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd739e47-9a8a-4d59-bfe6-45d059c2c3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:16.179430 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd739e47-9a8a-4d59-bfe6-45d059c2c3a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:16.180360 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd739e47-9a8a-4d59-bfe6-45d059c2c3a0 None admin] RBAC: Adding query filter params (role.id=5a6e54e81bb24eceb618d9ffa67f488e, scope.project.id=084e70bbad784892b195bb11a68bf857, user.id=629742b135b2447898e8291d9a360295) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:58:16.180795 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd739e47-9a8a-4d59-bfe6-45d059c2c3a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:16.182487 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd739e47-9a8a-4d59-bfe6-45d059c2c3a0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:16.188172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 627/1260] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:58:16 2022] GET /identity/v3/role_assignments?user.id=629742b135b2447898e8291d9a360295&scope.project.id=084e70bbad784892b195bb11a68bf857&role.id=5a6e54e81bb24eceb618d9ffa67f488e => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:58:18.395972 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bae6c4-f5b2-4841-b093-7a33b66e6d62 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:18.396508 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bae6c4-f5b2-4841-b093-7a33b66e6d62 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:18.396508 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bae6c4-f5b2-4841-b093-7a33b66e6d62 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:18.398646 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 634/1261] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:58:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:58:18.406909 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d4923-834c-4949-ab23-f8ad7ef65710 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:18.407370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d4923-834c-4949-ab23-f8ad7ef65710 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:18.407473 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d4923-834c-4949-ab23-f8ad7ef65710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:18.425684 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-467d4923-834c-4949-ab23-f8ad7ef65710 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:58:18.426939 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-467d4923-834c-4949-ab23-f8ad7ef65710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:58:18.491261 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 628/1262] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:58:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 18:58:18.519478 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bae6c4-f5b2-4841-b093-7a33b66e6d62 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:18.640954 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bae6c4-f5b2-4841-b093-7a33b66e6d62 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:18.682189 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68471395-c572-4b73-9d04-7681fe90342d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:18.683148 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68471395-c572-4b73-9d04-7681fe90342d None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:18.683508 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68471395-c572-4b73-9d04-7681fe90342d None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:18.683907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68471395-c572-4b73-9d04-7681fe90342d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:18.696756 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68471395-c572-4b73-9d04-7681fe90342d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:58:18.704844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-68471395-c572-4b73-9d04-7681fe90342d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:58:18.704844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:58:18.704844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:58:18.704844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:58:18.704844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:58:18.704844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:58:18.704844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:58:18.704844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:58:18.704844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:58:18.704844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:58:18.704844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:58:18.704844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:58:18.704844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:58:18.704844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:58:18.704844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:58:18.704844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:58:18.706012 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:58:18.706012 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:58:18.706012 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:58:18.706012 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:58:18.706012 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:58:18.706012 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:58:18.706012 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:58:18.706012 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:58:18.706012 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:58:18.706012 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:58:18.706012 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:58:18.706012 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:58:18.706012 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:58:18.706012 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:58:18.706012 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:58:18.706012 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:58:18.707059 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:58:18.707059 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:58:18.707059 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:58:18.707059 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:58:18.707059 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:58:18.707059 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:58:18.707059 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:58:18.707059 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:58:18.707059 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:58:18.707059 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:58:18.707059 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:58:18.707059 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:58:18.707059 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 635/1263] 10.222.0.24 () {56 vars in 1096 bytes} [Mon May 16 18:58:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:58:18.712664 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d4923-834c-4949-ab23-f8ad7ef65710 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:18.823180 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d4923-834c-4949-ab23-f8ad7ef65710 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:18.856645 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c9bf0-8d07-4cc4-ae8b-61d99683ec92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:18.857336 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c9bf0-8d07-4cc4-ae8b-61d99683ec92 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:18.857641 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c9bf0-8d07-4cc4-ae8b-61d99683ec92 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:18.857908 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c9bf0-8d07-4cc4-ae8b-61d99683ec92 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:18.858655 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500c9bf0-8d07-4cc4-ae8b-61d99683ec92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:58:18.858952 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500c9bf0-8d07-4cc4-ae8b-61d99683ec92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:18.860341 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500c9bf0-8d07-4cc4-ae8b-61d99683ec92 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:18.868274 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 629/1264] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:58:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:58:18.877869 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68471395-c572-4b73-9d04-7681fe90342d None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:18.980676 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68471395-c572-4b73-9d04-7681fe90342d None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:19.014329 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63893a-6d01-465a-8ec7-a5077e763c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:19.015116 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63893a-6d01-465a-8ec7-a5077e763c02 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:19.015400 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63893a-6d01-465a-8ec7-a5077e763c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:19.015669 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63893a-6d01-465a-8ec7-a5077e763c02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:19.027681 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af63893a-6d01-465a-8ec7-a5077e763c02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:19.029153 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af63893a-6d01-465a-8ec7-a5077e763c02 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:19.047699 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-af63893a-6d01-465a-8ec7-a5077e763c02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:58:19.047699 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:58:19.047699 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:58:19.047699 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:58:19.047699 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:58:19.047699 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:58:19.047699 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:58:19.047699 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:58:19.047699 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:58:19.047699 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:58:19.047699 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:58:19.047699 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:58:19.047699 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:58:19.047699 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:58:19.047699 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:58:19.048711 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:58:19.048711 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:58:19.048711 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:58:19.048711 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:58:19.048711 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:58:19.048711 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:58:19.048711 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:58:19.048711 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:58:19.048711 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:58:19.048711 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:58:19.048711 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:58:19.048711 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:58:19.048711 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:58:19.048711 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:58:19.048711 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:58:19.048711 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:58:19.048711 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:58:19.049836 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:58:19.049836 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:58:19.049836 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:58:19.049836 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:58:19.049836 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 636/1265] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:58:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:58:19.055489 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c9bf0-8d07-4cc4-ae8b-61d99683ec92 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:19.163651 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c9bf0-8d07-4cc4-ae8b-61d99683ec92 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:19.198165 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3e4b0-339a-465b-9009-83423b632d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:19.198819 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3e4b0-339a-465b-9009-83423b632d2d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:19.199103 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3e4b0-339a-465b-9009-83423b632d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:19.199376 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3e4b0-339a-465b-9009-83423b632d2d None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:19.200094 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3e4b0-339a-465b-9009-83423b632d2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:58:19.200396 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3e4b0-339a-465b-9009-83423b632d2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:19.201810 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3e4b0-339a-465b-9009-83423b632d2d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:19.213174 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 630/1266] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:58:19.219094 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63893a-6d01-465a-8ec7-a5077e763c02 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:19.324733 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63893a-6d01-465a-8ec7-a5077e763c02 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:19.359409 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407e3b9-4e4a-4f2d-89f6-18f4fc00ecd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:19.360192 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407e3b9-4e4a-4f2d-89f6-18f4fc00ecd3 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:19.360471 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407e3b9-4e4a-4f2d-89f6-18f4fc00ecd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:19.360740 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407e3b9-4e4a-4f2d-89f6-18f4fc00ecd3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:19.368266 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407e3b9-4e4a-4f2d-89f6-18f4fc00ecd3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:19.369778 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407e3b9-4e4a-4f2d-89f6-18f4fc00ecd3 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:19.384318 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-b407e3b9-4e4a-4f2d-89f6-18f4fc00ecd3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 18:58:19.384318 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:58:19.384318 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:58:19.384318 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:58:19.384318 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:58:19.384318 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:58:19.384318 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:58:19.384318 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:58:19.384318 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:58:19.384318 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:58:19.384318 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:58:19.384318 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:58:19.384318 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:58:19.384318 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:58:19.384318 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:58:19.384318 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:58:19.385487 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:58:19.385487 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:58:19.385487 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:58:19.385487 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:58:19.385487 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:58:19.385487 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:58:19.385487 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:58:19.385487 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:58:19.385487 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:58:19.385487 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:58:19.385487 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:58:19.385487 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:58:19.385487 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:58:19.385487 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:58:19.385487 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:58:19.385487 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:58:19.385487 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:58:19.385487 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:58:19.386674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:58:19.386674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:58:19.386674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:58:19.386674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:58:19.386674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:58:19.386674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:58:19.386674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:58:19.386674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:58:19.386674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 18:58:19.386674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:58:19.386674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 637/1267] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:58:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:58:19.393372 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3e4b0-339a-465b-9009-83423b632d2d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:19.499336 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3e4b0-339a-465b-9009-83423b632d2d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:19.532752 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e0023-6c79-4fdd-b3b8-7dbea5163237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:19.533414 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e0023-6c79-4fdd-b3b8-7dbea5163237 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:19.533720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e0023-6c79-4fdd-b3b8-7dbea5163237 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:19.533986 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e0023-6c79-4fdd-b3b8-7dbea5163237 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:19.534816 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829e0023-6c79-4fdd-b3b8-7dbea5163237 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:58:19.535121 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829e0023-6c79-4fdd-b3b8-7dbea5163237 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:19.536648 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829e0023-6c79-4fdd-b3b8-7dbea5163237 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:19.552721 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 631/1268] 10.222.0.24 () {56 vars in 1143 bytes} [Mon May 16 18:58:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:58:19.558675 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407e3b9-4e4a-4f2d-89f6-18f4fc00ecd3 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:19.675155 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407e3b9-4e4a-4f2d-89f6-18f4fc00ecd3 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:19.713460 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016d008-e28e-43fd-9feb-21b5f942710d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:19.714274 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016d008-e28e-43fd-9feb-21b5f942710d None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:19.714548 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016d008-e28e-43fd-9feb-21b5f942710d None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:19.714814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016d008-e28e-43fd-9feb-21b5f942710d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:19.725377 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5016d008-e28e-43fd-9feb-21b5f942710d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:19.726864 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5016d008-e28e-43fd-9feb-21b5f942710d None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:19.743728 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-5016d008-e28e-43fd-9feb-21b5f942710d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:58:19.743728 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:58:19.743728 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:58:19.743728 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:58:19.743728 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:58:19.743728 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:58:19.743728 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:58:19.743728 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:58:19.743728 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:58:19.743728 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:58:19.743728 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:58:19.743728 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:58:19.743728 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:58:19.743728 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:58:19.743728 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:58:19.744814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:58:19.744814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:58:19.744814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:58:19.744814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:58:19.744814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:58:19.744814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:58:19.744814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:58:19.744814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:58:19.744814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:58:19.744814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:58:19.744814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:58:19.744814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:58:19.744814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:58:19.744814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:58:19.744814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:58:19.744814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:58:19.744814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:58:19.746337 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:58:19.746337 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:58:19.746337 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:58:19.746337 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:58:19.746337 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 638/1269] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:58:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:58:19.754242 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e0023-6c79-4fdd-b3b8-7dbea5163237 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:19.857178 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e0023-6c79-4fdd-b3b8-7dbea5163237 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:19.894638 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f67401-85ff-4a0c-8cd3-ba86fef1d836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:19.895395 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f67401-85ff-4a0c-8cd3-ba86fef1d836 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:19.895677 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f67401-85ff-4a0c-8cd3-ba86fef1d836 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:19.895946 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f67401-85ff-4a0c-8cd3-ba86fef1d836 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:19.896663 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f67401-85ff-4a0c-8cd3-ba86fef1d836 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:58:19.896972 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f67401-85ff-4a0c-8cd3-ba86fef1d836 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:19.898380 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f67401-85ff-4a0c-8cd3-ba86fef1d836 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:19.909732 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 632/1270] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:58:19.916357 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016d008-e28e-43fd-9feb-21b5f942710d None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:20.022276 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016d008-e28e-43fd-9feb-21b5f942710d None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:20.056195 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9aa48-fdcc-496d-b7fc-6bf64a1c8602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:20.057304 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9aa48-fdcc-496d-b7fc-6bf64a1c8602 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:20.057638 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9aa48-fdcc-496d-b7fc-6bf64a1c8602 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:20.057915 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9aa48-fdcc-496d-b7fc-6bf64a1c8602 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:20.066287 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9aa48-fdcc-496d-b7fc-6bf64a1c8602 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:20.067864 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9aa48-fdcc-496d-b7fc-6bf64a1c8602 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:20.083382 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-80e9aa48-fdcc-496d-b7fc-6bf64a1c8602 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:58:20.083382 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:58:20.083382 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:58:20.083382 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:58:20.083382 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:58:20.083382 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:58:20.083382 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:58:20.083382 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:58:20.083382 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:58:20.083382 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:58:20.083382 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:58:20.083382 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:58:20.083382 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:58:20.083382 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:58:20.083382 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:58:20.084393 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:58:20.084393 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:58:20.084393 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:58:20.084393 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:58:20.084393 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:58:20.084393 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:58:20.084393 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:58:20.084393 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:58:20.084393 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:58:20.084393 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:58:20.084393 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:58:20.084393 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:58:20.084393 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:58:20.084393 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:58:20.084393 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:58:20.084393 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:58:20.084393 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:58:20.085329 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:58:20.085329 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:58:20.085329 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:58:20.085329 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:58:20.085329 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:58:20.085329 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:58:20.085329 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:58:20.085329 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:58:20.085329 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 639/1271] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:58:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:58:20.090561 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f67401-85ff-4a0c-8cd3-ba86fef1d836 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:20.189163 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f67401-85ff-4a0c-8cd3-ba86fef1d836 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:20.221990 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403647ec-cd60-4e35-9f06-4350d7e6843b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:20.222632 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403647ec-cd60-4e35-9f06-4350d7e6843b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:20.222907 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403647ec-cd60-4e35-9f06-4350d7e6843b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:20.223214 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403647ec-cd60-4e35-9f06-4350d7e6843b None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:20.223992 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403647ec-cd60-4e35-9f06-4350d7e6843b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:58:20.224298 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403647ec-cd60-4e35-9f06-4350d7e6843b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:20.225765 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403647ec-cd60-4e35-9f06-4350d7e6843b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:20.237428 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 633/1272] 10.222.0.24 () {56 vars in 1148 bytes} [Mon May 16 18:58:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:58:20.244331 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9aa48-fdcc-496d-b7fc-6bf64a1c8602 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:20.353361 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9aa48-fdcc-496d-b7fc-6bf64a1c8602 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:20.391019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17fbc8-6cd2-4e4c-81d9-8b576e40d703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:20.391902 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17fbc8-6cd2-4e4c-81d9-8b576e40d703 None admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:20.392183 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17fbc8-6cd2-4e4c-81d9-8b576e40d703 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:20.392456 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17fbc8-6cd2-4e4c-81d9-8b576e40d703 None admin] PATH_INFO: `/v3/projects/084e70bbad784892b195bb11a68bf857/users/629742b135b2447898e8291d9a360295/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:20.394531 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17fbc8-6cd2-4e4c-81d9-8b576e40d703 None admin] RBAC: Authorizing `identity:create_grant(project_id=084e70bbad784892b195bb11a68bf857, user_id=629742b135b2447898e8291d9a360295, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:20.396088 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17fbc8-6cd2-4e4c-81d9-8b576e40d703 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:20.412192 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 640/1273] 10.222.0.24 () {58 vars in 1439 bytes} [Mon May 16 18:58:20 2022] PUT /identity/v3/projects/084e70bbad784892b195bb11a68bf857/users/629742b135b2447898e8291d9a360295/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:58:22.604639 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb2c8b-099b-45c6-bca7-cfc07596cf5f None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:22.605332 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb2c8b-099b-45c6-bca7-cfc07596cf5f None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:22.605332 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb2c8b-099b-45c6-bca7-cfc07596cf5f None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:22.609583 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 634/1274] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:58:22.616974 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92789328-edf2-4575-8e72-02bd0ab8cd62 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:22.617420 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92789328-edf2-4575-8e72-02bd0ab8cd62 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:22.617561 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92789328-edf2-4575-8e72-02bd0ab8cd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:22.639737 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-92789328-edf2-4575-8e72-02bd0ab8cd62 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:58:22.641158 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-92789328-edf2-4575-8e72-02bd0ab8cd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:58:22.715142 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 641/1275] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:58:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:58:22.739437 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb2c8b-099b-45c6-bca7-cfc07596cf5f None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:22.862560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb2c8b-099b-45c6-bca7-cfc07596cf5f None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:22.903314 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215dcb2a-595a-44be-acc5-fe4f66a673b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:22.904122 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215dcb2a-595a-44be-acc5-fe4f66a673b0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:22.904392 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215dcb2a-595a-44be-acc5-fe4f66a673b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:22.904965 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215dcb2a-595a-44be-acc5-fe4f66a673b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:22.915895 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215dcb2a-595a-44be-acc5-fe4f66a673b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:58:22.923462 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-215dcb2a-595a-44be-acc5-fe4f66a673b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:58:22.923462 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:58:22.923462 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:58:22.923462 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:58:22.923462 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:58:22.923462 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:58:22.923462 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:58:22.923462 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:58:22.923462 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:58:22.923462 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:58:22.923462 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:58:22.923462 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:58:22.923462 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:58:22.923462 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:58:22.923462 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:58:22.923462 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:58:22.924523 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:58:22.924523 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:58:22.924523 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:58:22.924523 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:58:22.924523 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:58:22.924523 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:58:22.924523 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:58:22.924523 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:58:22.924523 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:58:22.924523 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:58:22.924523 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:58:22.924523 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:58:22.924523 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:58:22.924523 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:58:22.924523 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:58:22.924523 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:58:22.925924 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:58:22.925924 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:58:22.925924 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:58:22.925924 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:58:22.925924 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:58:22.925924 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:58:22.925924 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:58:22.925924 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:58:22.925924 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:58:22.925924 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:58:22.925924 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:58:22.925924 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:58:22.925924 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 635/1276] 10.222.0.24 () {56 vars in 1096 bytes} [Mon May 16 18:58:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:58:22.932150 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92789328-edf2-4575-8e72-02bd0ab8cd62 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:23.027429 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92789328-edf2-4575-8e72-02bd0ab8cd62 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:23.062606 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c16219-22e1-4de6-a18d-50a4c1ba8e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:23.063253 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c16219-22e1-4de6-a18d-50a4c1ba8e39 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:23.063527 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c16219-22e1-4de6-a18d-50a4c1ba8e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:23.063791 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c16219-22e1-4de6-a18d-50a4c1ba8e39 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:23.064531 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c16219-22e1-4de6-a18d-50a4c1ba8e39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:58:23.064837 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c16219-22e1-4de6-a18d-50a4c1ba8e39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:23.066248 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c16219-22e1-4de6-a18d-50a4c1ba8e39 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:23.074361 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 642/1277] 10.222.0.24 () {56 vars in 1099 bytes} [Mon May 16 18:58:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:58:23.080689 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215dcb2a-595a-44be-acc5-fe4f66a673b0 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:23.188704 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215dcb2a-595a-44be-acc5-fe4f66a673b0 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:23.229868 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e3ece-f7b4-42ef-b764-15252c91991d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:23.230662 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e3ece-f7b4-42ef-b764-15252c91991d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:23.230938 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e3ece-f7b4-42ef-b764-15252c91991d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:23.231207 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e3ece-f7b4-42ef-b764-15252c91991d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:23.241795 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e3ece-f7b4-42ef-b764-15252c91991d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:23.243255 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e3ece-f7b4-42ef-b764-15252c91991d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:23.259915 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-7a3e3ece-f7b4-42ef-b764-15252c91991d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:58:23.259915 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:58:23.259915 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:58:23.259915 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:58:23.259915 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:58:23.259915 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:58:23.259915 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:58:23.259915 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:58:23.259915 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:58:23.259915 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:58:23.259915 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:58:23.259915 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:58:23.259915 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:58:23.259915 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:58:23.259915 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:58:23.260906 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:58:23.260906 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:58:23.260906 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:58:23.260906 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:58:23.260906 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:58:23.260906 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:58:23.260906 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:58:23.260906 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:58:23.260906 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:58:23.260906 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:58:23.260906 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:58:23.260906 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:58:23.260906 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:58:23.260906 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:58:23.260906 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:58:23.260906 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:58:23.260906 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:58:23.261939 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:58:23.261939 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:58:23.261939 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:58:23.261939 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:58:23.261939 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 636/1278] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:58:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:58:23.270195 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c16219-22e1-4de6-a18d-50a4c1ba8e39 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:23.377769 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c16219-22e1-4de6-a18d-50a4c1ba8e39 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:23.411448 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562dabf0-686f-4008-8576-2b9942ae9e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:23.412119 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dabf0-686f-4008-8576-2b9942ae9e07 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:23.412394 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dabf0-686f-4008-8576-2b9942ae9e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:23.412671 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dabf0-686f-4008-8576-2b9942ae9e07 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:23.413448 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562dabf0-686f-4008-8576-2b9942ae9e07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:58:23.413712 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562dabf0-686f-4008-8576-2b9942ae9e07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:23.415093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562dabf0-686f-4008-8576-2b9942ae9e07 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:23.426590 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 643/1279] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:58:23.432360 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e3ece-f7b4-42ef-b764-15252c91991d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:23.534830 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e3ece-f7b4-42ef-b764-15252c91991d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:23.574420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6ed5b-1455-4c4c-bba1-02f103c4ee3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:23.575222 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6ed5b-1455-4c4c-bba1-02f103c4ee3e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:23.575500 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6ed5b-1455-4c4c-bba1-02f103c4ee3e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:23.575766 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6ed5b-1455-4c4c-bba1-02f103c4ee3e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:23.583426 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6ed5b-1455-4c4c-bba1-02f103c4ee3e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:23.585026 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6ed5b-1455-4c4c-bba1-02f103c4ee3e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:23.599013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-2ed6ed5b-1455-4c4c-bba1-02f103c4ee3e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 18:58:23.599013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:58:23.599013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:58:23.599013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:58:23.599013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:58:23.599013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:58:23.599013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:58:23.599013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:58:23.599013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:58:23.599013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:58:23.599013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:58:23.599013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:58:23.599013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:58:23.599013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:58:23.599013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:58:23.599013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:58:23.600065 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:58:23.600065 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:58:23.600065 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:58:23.600065 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:58:23.600065 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:58:23.600065 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:58:23.600065 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:58:23.600065 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:58:23.600065 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:58:23.600065 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:58:23.600065 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:58:23.600065 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:58:23.600065 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:58:23.600065 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:58:23.600065 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:58:23.600065 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:58:23.600065 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:58:23.600065 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:58:23.601463 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:58:23.601463 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:58:23.601463 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:58:23.601463 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:58:23.601463 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:58:23.601463 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:58:23.601463 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:58:23.601463 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:58:23.601463 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 18:58:23.601463 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:58:23.601463 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 637/1280] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:58:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:58:23.606900 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562dabf0-686f-4008-8576-2b9942ae9e07 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:23.722646 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562dabf0-686f-4008-8576-2b9942ae9e07 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:23.762423 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834ffd9-6237-4d16-a9f3-aecde51cb10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:23.763086 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834ffd9-6237-4d16-a9f3-aecde51cb10d None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:23.763365 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834ffd9-6237-4d16-a9f3-aecde51cb10d None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:23.763628 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834ffd9-6237-4d16-a9f3-aecde51cb10d None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:23.764578 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2834ffd9-6237-4d16-a9f3-aecde51cb10d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:58:23.764890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2834ffd9-6237-4d16-a9f3-aecde51cb10d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:23.766363 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2834ffd9-6237-4d16-a9f3-aecde51cb10d None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:23.784522 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 644/1281] 10.222.0.24 () {56 vars in 1143 bytes} [Mon May 16 18:58:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:58:23.791453 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6ed5b-1455-4c4c-bba1-02f103c4ee3e None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:23.900000 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6ed5b-1455-4c4c-bba1-02f103c4ee3e None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:23.935948 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a66d4-2317-4cc3-95e8-31b935d77527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:23.937032 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a66d4-2317-4cc3-95e8-31b935d77527 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:23.937520 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a66d4-2317-4cc3-95e8-31b935d77527 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:23.937967 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a66d4-2317-4cc3-95e8-31b935d77527 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:24.009129 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6a66d4-2317-4cc3-95e8-31b935d77527 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:24.010538 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6a66d4-2317-4cc3-95e8-31b935d77527 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:24.123480 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 638/1282] 10.222.0.24 () {58 vars in 1282 bytes} [Mon May 16 18:58:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 18:58:24.130188 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834ffd9-6237-4d16-a9f3-aecde51cb10d None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:24.246244 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834ffd9-6237-4d16-a9f3-aecde51cb10d None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:24.281448 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80bf6d8-6294-46ff-bb41-cd1f0ad75702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:24.282220 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80bf6d8-6294-46ff-bb41-cd1f0ad75702 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:24.282506 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80bf6d8-6294-46ff-bb41-cd1f0ad75702 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:24.282775 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80bf6d8-6294-46ff-bb41-cd1f0ad75702 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:24.292951 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80bf6d8-6294-46ff-bb41-cd1f0ad75702 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:24.294469 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80bf6d8-6294-46ff-bb41-cd1f0ad75702 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:24.311823 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-d80bf6d8-6294-46ff-bb41-cd1f0ad75702 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:58:24.311823 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:58:24.311823 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:58:24.311823 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:58:24.311823 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:58:24.311823 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:58:24.311823 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:58:24.311823 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:58:24.311823 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:58:24.311823 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:58:24.311823 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:58:24.311823 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:58:24.311823 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:58:24.311823 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:58:24.311823 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:58:24.312840 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:58:24.312840 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:58:24.312840 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:58:24.312840 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:58:24.312840 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:58:24.312840 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:58:24.312840 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:58:24.312840 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:58:24.312840 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:58:24.312840 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:58:24.312840 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:58:24.312840 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:58:24.312840 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:58:24.312840 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:58:24.312840 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:58:24.312840 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:58:24.312840 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:58:24.315012 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:58:24.315012 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:58:24.315012 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:58:24.315012 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:58:24.315012 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 645/1283] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 18:58:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:58:24.319689 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a66d4-2317-4cc3-95e8-31b935d77527 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:24.430268 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a66d4-2317-4cc3-95e8-31b935d77527 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:24.465981 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cffeff1-6a40-4ae0-82a8-a2a84b15ecda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:24.466652 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffeff1-6a40-4ae0-82a8-a2a84b15ecda None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:24.466927 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffeff1-6a40-4ae0-82a8-a2a84b15ecda None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:24.467195 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffeff1-6a40-4ae0-82a8-a2a84b15ecda None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:24.467904 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cffeff1-6a40-4ae0-82a8-a2a84b15ecda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:58:24.468202 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cffeff1-6a40-4ae0-82a8-a2a84b15ecda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:24.470516 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cffeff1-6a40-4ae0-82a8-a2a84b15ecda None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:24.481822 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 639/1284] 10.222.0.24 () {56 vars in 1109 bytes} [Mon May 16 18:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:58:24.488160 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80bf6d8-6294-46ff-bb41-cd1f0ad75702 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:24.613736 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80bf6d8-6294-46ff-bb41-cd1f0ad75702 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:24.657214 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a7c11-f862-42d4-bfc1-51c85c5d4233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:24.658018 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a7c11-f862-42d4-bfc1-51c85c5d4233 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:24.658329 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a7c11-f862-42d4-bfc1-51c85c5d4233 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:24.658599 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a7c11-f862-42d4-bfc1-51c85c5d4233 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:24.665882 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a7c11-f862-42d4-bfc1-51c85c5d4233 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:24.667375 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a7c11-f862-42d4-bfc1-51c85c5d4233 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:24.682004 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application [None req-c19a7c11-f862-42d4-bfc1-51c85c5d4233 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:58:24.682004 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:58:24.682004 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:58:24.682004 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:58:24.682004 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:58:24.682004 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:58:24.682004 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:58:24.682004 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:58:24.682004 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:58:24.682004 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:58:24.682004 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:58:24.682004 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:58:24.682004 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:58:24.682004 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:58:24.682004 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:58:24.683042 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:58:24.683042 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:58:24.683042 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:58:24.683042 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:58:24.683042 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:58:24.683042 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:58:24.683042 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:58:24.683042 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:58:24.683042 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application with Lock( May 16 18:58:24.683042 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:58:24.683042 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._enter() May 16 18:58:24.683042 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:58:24.683042 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:58:24.683042 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:58:24.683042 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.creator() May 16 18:58:24.683042 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:58:24.683042 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application created_value = creator( May 16 18:58:24.684007 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:58:24.684007 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:58:24.684007 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:58:24.684007 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:58:24.684007 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:58:24.684007 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:58:24.684007 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:58:24.684007 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: ERROR keystone.server.flask.application May 16 18:58:24.684007 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 646/1285] 10.222.0.24 () {56 vars in 1111 bytes} [Mon May 16 18:58:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:58:24.689432 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cffeff1-6a40-4ae0-82a8-a2a84b15ecda None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:24.789418 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cffeff1-6a40-4ae0-82a8-a2a84b15ecda None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:24.822089 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744d9db-8eeb-44c6-9dc8-eefdbce457a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:24.822721 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744d9db-8eeb-44c6-9dc8-eefdbce457a6 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:24.823011 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744d9db-8eeb-44c6-9dc8-eefdbce457a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:24.823280 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744d9db-8eeb-44c6-9dc8-eefdbce457a6 None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:24.824052 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744d9db-8eeb-44c6-9dc8-eefdbce457a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:58:24.824354 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744d9db-8eeb-44c6-9dc8-eefdbce457a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:24.825810 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744d9db-8eeb-44c6-9dc8-eefdbce457a6 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:24.837418 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 640/1286] 10.222.0.24 () {56 vars in 1148 bytes} [Mon May 16 18:58:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:58:24.844264 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a7c11-f862-42d4-bfc1-51c85c5d4233 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:24.949523 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a7c11-f862-42d4-bfc1-51c85c5d4233 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:24.982782 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874ab2a-669a-441b-ab3e-cc91d758aaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:24.983426 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874ab2a-669a-441b-ab3e-cc91d758aaef None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:24.983707 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874ab2a-669a-441b-ab3e-cc91d758aaef None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:24.983977 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874ab2a-669a-441b-ab3e-cc91d758aaef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:24.984789 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3874ab2a-669a-441b-ab3e-cc91d758aaef None admin] RBAC: Adding query filter params (role.id=5a6e54e81bb24eceb618d9ffa67f488e, scope.project.id=084e70bbad784892b195bb11a68bf857, user.id=629742b135b2447898e8291d9a360295) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:58:24.985093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3874ab2a-669a-441b-ab3e-cc91d758aaef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:24.986552 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3874ab2a-669a-441b-ab3e-cc91d758aaef None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:24.992393 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 647/1287] 10.222.0.24 () {56 vars in 1374 bytes} [Mon May 16 18:58:24 2022] GET /identity/v3/role_assignments?user.id=629742b135b2447898e8291d9a360295&scope.project.id=084e70bbad784892b195bb11a68bf857&role.id=5a6e54e81bb24eceb618d9ffa67f488e => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:58:27.214449 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44ea5a-ec98-485f-9273-bf6212a7687f None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:27.214986 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44ea5a-ec98-485f-9273-bf6212a7687f None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:27.214986 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44ea5a-ec98-485f-9273-bf6212a7687f None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:27.216537 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 641/1288] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:58:27.222969 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53073fba-aedb-492b-93e9-95b1cabac9b2 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:27.223663 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53073fba-aedb-492b-93e9-95b1cabac9b2 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:27.223841 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53073fba-aedb-492b-93e9-95b1cabac9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:27.248161 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-53073fba-aedb-492b-93e9-95b1cabac9b2 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:58:27.249347 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-53073fba-aedb-492b-93e9-95b1cabac9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:58:27.317946 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 648/1289] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:58:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:58:27.346053 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44ea5a-ec98-485f-9273-bf6212a7687f None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:27.449053 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44ea5a-ec98-485f-9273-bf6212a7687f None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:27.482400 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac141c-0051-4ee1-898a-8a701196cbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:27.483186 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac141c-0051-4ee1-898a-8a701196cbe6 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:27.483465 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac141c-0051-4ee1-898a-8a701196cbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:27.483739 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac141c-0051-4ee1-898a-8a701196cbe6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:27.484395 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac141c-0051-4ee1-898a-8a701196cbe6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:27.485795 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac141c-0051-4ee1-898a-8a701196cbe6 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:27.497546 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-56ac141c-0051-4ee1-898a-8a701196cbe6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 16 18:58:27.497546 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:58:27.497546 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:58:27.497546 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:58:27.497546 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:58:27.497546 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:58:27.497546 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:58:27.497546 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:58:27.497546 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 18:58:27.497546 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:58:27.497546 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:58:27.497546 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:58:27.497546 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:58:27.497546 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:58:27.497546 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:58:27.497546 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:58:27.497546 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:58:27.498688 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:58:27.498688 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:58:27.498688 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:58:27.498688 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:58:27.498688 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:58:27.498688 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:58:27.498688 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:58:27.498688 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:58:27.498688 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:58:27.498688 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:58:27.498688 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:58:27.498688 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:58:27.498688 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:58:27.498688 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:58:27.498688 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:58:27.498688 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:58:27.499803 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:58:27.499803 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:58:27.499803 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:58:27.499803 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:58:27.499803 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:58:27.499803 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:58:27.499803 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:58:27.499803 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:58:27.499803 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:58:27.499803 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:58:27.499803 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:58:27.499803 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:58:27.499803 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 18:58:27.499803 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:58:27.501781 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 642/1290] 10.222.0.24 () {56 vars in 1117 bytes} [Mon May 16 18:58:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:58:27.505133 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53073fba-aedb-492b-93e9-95b1cabac9b2 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:27.603920 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53073fba-aedb-492b-93e9-95b1cabac9b2 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:27.644236 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f20f5-1d52-4be3-a23b-ba9728d32c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:27.644964 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f20f5-1d52-4be3-a23b-ba9728d32c8a None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:27.645306 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f20f5-1d52-4be3-a23b-ba9728d32c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:27.645586 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f20f5-1d52-4be3-a23b-ba9728d32c8a None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:27.646340 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f20f5-1d52-4be3-a23b-ba9728d32c8a None admin] RBAC: Adding query filter params (name=placement) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:58:27.646602 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f20f5-1d52-4be3-a23b-ba9728d32c8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:27.648096 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f20f5-1d52-4be3-a23b-ba9728d32c8a None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:27.653352 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 649/1291] 10.222.0.24 () {56 vars in 1116 bytes} [Mon May 16 18:58:27 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:58:27.660499 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac141c-0051-4ee1-898a-8a701196cbe6 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:27.768144 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac141c-0051-4ee1-898a-8a701196cbe6 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:27.810066 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878af700-560c-4e2a-93d1-6e13085f5f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:27.810700 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878af700-560c-4e2a-93d1-6e13085f5f83 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:27.810980 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878af700-560c-4e2a-93d1-6e13085f5f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:27.811250 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878af700-560c-4e2a-93d1-6e13085f5f83 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:27.811949 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878af700-560c-4e2a-93d1-6e13085f5f83 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:58:27.812248 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878af700-560c-4e2a-93d1-6e13085f5f83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:27.813654 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878af700-560c-4e2a-93d1-6e13085f5f83 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:27.818247 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 643/1292] 10.222.0.24 () {56 vars in 1116 bytes} [Mon May 16 18:58:27 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:58:29.991655 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e477c-ac24-47fd-b2ae-5c3cad2007a1 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:29.992223 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e477c-ac24-47fd-b2ae-5c3cad2007a1 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:29.992223 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e477c-ac24-47fd-b2ae-5c3cad2007a1 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:29.993566 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 650/1293] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:58:29.999943 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e756711-c070-4193-b5fc-54d6eb1913c9 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:30.000656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e756711-c070-4193-b5fc-54d6eb1913c9 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:30.000854 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e756711-c070-4193-b5fc-54d6eb1913c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:30.021415 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-9e756711-c070-4193-b5fc-54d6eb1913c9 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:58:30.022634 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9e756711-c070-4193-b5fc-54d6eb1913c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:58:30.091348 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 644/1294] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:58:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:58:30.117041 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e477c-ac24-47fd-b2ae-5c3cad2007a1 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:30.233147 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e477c-ac24-47fd-b2ae-5c3cad2007a1 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:30.267475 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb935c-118d-47c3-84a6-624d00e4f766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:30.268067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb935c-118d-47c3-84a6-624d00e4f766 None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:30.268348 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb935c-118d-47c3-84a6-624d00e4f766 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:30.268621 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb935c-118d-47c3-84a6-624d00e4f766 None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:30.269347 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb935c-118d-47c3-84a6-624d00e4f766 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:30.270758 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb935c-118d-47c3-84a6-624d00e4f766 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:30.286986 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 651/1295] 10.222.0.24 () {60 vars in 1141 bytes} [Mon May 16 18:58:30 2022] POST /identity/v3/services => generated 246 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:58:32.485728 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0205c-141d-497e-b874-c41a6a741724 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:32.486296 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0205c-141d-497e-b874-c41a6a741724 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:32.486296 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0205c-141d-497e-b874-c41a6a741724 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:32.487564 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 645/1296] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:58:32.494068 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211bc693-026d-4f56-a931-306423fe9b3c None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:32.494776 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211bc693-026d-4f56-a931-306423fe9b3c None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:32.494936 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211bc693-026d-4f56-a931-306423fe9b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:32.522616 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-211bc693-026d-4f56-a931-306423fe9b3c None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:58:32.523803 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-211bc693-026d-4f56-a931-306423fe9b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:58:32.611553 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 652/1297] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:58:32 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:58:32.648421 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0205c-141d-497e-b874-c41a6a741724 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:32.758346 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0205c-141d-497e-b874-c41a6a741724 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:32.791644 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5c4b3-c422-42b0-9fcf-bfe188a4e37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:32.792431 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5c4b3-c422-42b0-9fcf-bfe188a4e37a None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:32.792701 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5c4b3-c422-42b0-9fcf-bfe188a4e37a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:32.792965 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5c4b3-c422-42b0-9fcf-bfe188a4e37a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:32.793636 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce5c4b3-c422-42b0-9fcf-bfe188a4e37a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:32.795006 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce5c4b3-c422-42b0-9fcf-bfe188a4e37a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:32.806920 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-7ce5c4b3-c422-42b0-9fcf-bfe188a4e37a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 16 18:58:32.806920 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:58:32.806920 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:58:32.806920 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:58:32.806920 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:58:32.806920 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:58:32.806920 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:58:32.806920 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:58:32.806920 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 18:58:32.806920 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:58:32.806920 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:58:32.806920 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:58:32.806920 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:58:32.806920 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:58:32.806920 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:58:32.806920 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:58:32.806920 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:58:32.808071 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:58:32.808071 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:58:32.808071 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:58:32.808071 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:58:32.808071 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:58:32.808071 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:58:32.808071 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:58:32.808071 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:58:32.808071 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:58:32.808071 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:58:32.808071 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:58:32.808071 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:58:32.808071 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:58:32.808071 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:58:32.808071 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:58:32.808071 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:58:32.809072 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:58:32.809072 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:58:32.809072 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:58:32.809072 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:58:32.809072 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:58:32.809072 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:58:32.809072 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:58:32.809072 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:58:32.809072 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:58:32.809072 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:58:32.809072 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:58:32.809072 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:58:32.809072 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 18:58:32.809072 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:58:32.809072 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 646/1298] 10.222.0.24 () {56 vars in 1117 bytes} [Mon May 16 18:58:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:58:32.819482 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211bc693-026d-4f56-a931-306423fe9b3c None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:32.921559 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211bc693-026d-4f56-a931-306423fe9b3c None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:32.954596 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f129403-050c-43df-be13-2b076b2d7854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:32.955228 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f129403-050c-43df-be13-2b076b2d7854 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:32.955503 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f129403-050c-43df-be13-2b076b2d7854 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:32.955777 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f129403-050c-43df-be13-2b076b2d7854 None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:32.956474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f129403-050c-43df-be13-2b076b2d7854 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:58:32.956777 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f129403-050c-43df-be13-2b076b2d7854 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:32.958213 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f129403-050c-43df-be13-2b076b2d7854 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:32.963205 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 653/1299] 10.222.0.24 () {56 vars in 1116 bytes} [Mon May 16 18:58:32 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:58:32.970117 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5c4b3-c422-42b0-9fcf-bfe188a4e37a None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:33.081507 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5c4b3-c422-42b0-9fcf-bfe188a4e37a None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:33.117656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37519a6-c869-4c05-911d-da4be2cd3c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:33.118317 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37519a6-c869-4c05-911d-da4be2cd3c6c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:33.118595 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37519a6-c869-4c05-911d-da4be2cd3c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:33.118862 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37519a6-c869-4c05-911d-da4be2cd3c6c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:33.119652 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37519a6-c869-4c05-911d-da4be2cd3c6c None admin] RBAC: Adding query filter params (interface=public, service_id=a2d5c8bde05d4dd581b1b5a74d1d15cc, region_id=RegionOne) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:58:33.119958 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37519a6-c869-4c05-911d-da4be2cd3c6c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:33.121336 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37519a6-c869-4c05-911d-da4be2cd3c6c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:33.127499 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 647/1300] 10.222.0.24 () {56 vars in 1251 bytes} [Mon May 16 18:58:32 2022] GET /identity/v3/endpoints?service_id=a2d5c8bde05d4dd581b1b5a74d1d15cc&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:58:33.133436 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f129403-050c-43df-be13-2b076b2d7854 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:33.232706 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f129403-050c-43df-be13-2b076b2d7854 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:33.266486 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b894fd-4944-4cbb-b1bf-73a0900ea93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:33.267143 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b894fd-4944-4cbb-b1bf-73a0900ea93b None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:33.267421 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b894fd-4944-4cbb-b1bf-73a0900ea93b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:33.267694 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b894fd-4944-4cbb-b1bf-73a0900ea93b None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:33.268372 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b894fd-4944-4cbb-b1bf-73a0900ea93b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:33.269785 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b894fd-4944-4cbb-b1bf-73a0900ea93b None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:33.276593 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 654/1301] 10.222.0.24 () {56 vars in 1087 bytes} [Mon May 16 18:58:33 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 18:58:35.448987 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee3349-243b-4202-a55a-4bf3cffff697 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:35.449570 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee3349-243b-4202-a55a-4bf3cffff697 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:35.449570 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee3349-243b-4202-a55a-4bf3cffff697 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:35.450861 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 648/1302] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:58:35.457284 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3c887-c1fe-4f1e-8e38-3a4322265f2c None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:35.458240 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3c887-c1fe-4f1e-8e38-3a4322265f2c None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:35.458240 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3c887-c1fe-4f1e-8e38-3a4322265f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:35.479602 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-18d3c887-c1fe-4f1e-8e38-3a4322265f2c None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:58:35.480767 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-18d3c887-c1fe-4f1e-8e38-3a4322265f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:58:35.546726 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 655/1303] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:58:35 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:58:35.569403 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee3349-243b-4202-a55a-4bf3cffff697 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:35.669874 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee3349-243b-4202-a55a-4bf3cffff697 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:35.703294 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60fbb7-11b2-4b8f-b317-cefd61921631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:35.704015 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60fbb7-11b2-4b8f-b317-cefd61921631 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:35.704292 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60fbb7-11b2-4b8f-b317-cefd61921631 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:35.704558 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60fbb7-11b2-4b8f-b317-cefd61921631 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:35.705201 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60fbb7-11b2-4b8f-b317-cefd61921631 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:35.706598 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60fbb7-11b2-4b8f-b317-cefd61921631 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:35.718581 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-ae60fbb7-11b2-4b8f-b317-cefd61921631 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 16 18:58:35.718581 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:58:35.718581 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:58:35.718581 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:58:35.718581 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:58:35.718581 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:58:35.718581 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:58:35.718581 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:58:35.718581 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 18:58:35.718581 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:58:35.718581 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:58:35.718581 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:58:35.718581 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:58:35.718581 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:58:35.718581 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:58:35.718581 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:58:35.718581 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:58:35.719709 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:58:35.719709 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:58:35.719709 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:58:35.719709 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:58:35.719709 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:58:35.719709 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:58:35.719709 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:58:35.719709 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:58:35.719709 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:58:35.719709 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:58:35.719709 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:58:35.719709 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:58:35.719709 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:58:35.719709 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:58:35.719709 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:58:35.719709 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:58:35.720647 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:58:35.720647 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 16 18:58:35.720647 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:58:35.720647 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 16 18:58:35.720647 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:58:35.720647 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:58:35.720647 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:58:35.720647 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 16 18:58:35.720647 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:58:35.720647 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 16 18:58:35.720647 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:58:35.720647 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:58:35.720647 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 18:58:35.720647 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 16 18:58:35.720647 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 649/1304] 10.222.0.24 () {56 vars in 1117 bytes} [Mon May 16 18:58:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:58:35.726000 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3c887-c1fe-4f1e-8e38-3a4322265f2c None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:35.836973 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3c887-c1fe-4f1e-8e38-3a4322265f2c None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:35.874236 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a21465-72fd-405c-afa6-78d0b94063c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:35.874900 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a21465-72fd-405c-afa6-78d0b94063c1 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:35.875181 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a21465-72fd-405c-afa6-78d0b94063c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:35.875449 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a21465-72fd-405c-afa6-78d0b94063c1 None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:35.876155 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a21465-72fd-405c-afa6-78d0b94063c1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:58:35.876461 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a21465-72fd-405c-afa6-78d0b94063c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:35.877873 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a21465-72fd-405c-afa6-78d0b94063c1 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:35.883282 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 656/1305] 10.222.0.24 () {56 vars in 1116 bytes} [Mon May 16 18:58:35 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:58:35.889485 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60fbb7-11b2-4b8f-b317-cefd61921631 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:35.997028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60fbb7-11b2-4b8f-b317-cefd61921631 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:36.034794 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2bcc8-2811-457e-a155-8f434941ae6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:36.035493 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2bcc8-2811-457e-a155-8f434941ae6a None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:36.035775 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2bcc8-2811-457e-a155-8f434941ae6a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:36.036048 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2bcc8-2811-457e-a155-8f434941ae6a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:36.036834 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2bcc8-2811-457e-a155-8f434941ae6a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:36.038239 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2bcc8-2811-457e-a155-8f434941ae6a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:36.058013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 650/1306] 10.222.0.24 () {60 vars in 1144 bytes} [Mon May 16 18:58:35 2022] POST /identity/v3/endpoints => generated 331 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:59:39.580641 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e7cfd-1d7f-47cb-8e74-26f3c0a3b388 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:59:39.581577 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e7cfd-1d7f-47cb-8e74-26f3c0a3b388 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:59:39.582006 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e7cfd-1d7f-47cb-8e74-26f3c0a3b388 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:59:39.585870 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 657/1307] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:59:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:59:39.588961 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7fbde-1dbe-4114-bc43-e8eeb700c8fe None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:59:39.589833 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7fbde-1dbe-4114-bc43-e8eeb700c8fe None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:59:39.590317 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7fbde-1dbe-4114-bc43-e8eeb700c8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:59:39.688159 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-14e7fbde-1dbe-4114-bc43-e8eeb700c8fe None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:59:39.689707 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-14e7fbde-1dbe-4114-bc43-e8eeb700c8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:59:39.884905 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 651/1308] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:59:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:59:39.950374 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf9f4d-9e29-4424-a02d-dc67c6e90665 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:59:39.951072 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf9f4d-9e29-4424-a02d-dc67c6e90665 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:59:39.951933 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf9f4d-9e29-4424-a02d-dc67c6e90665 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:59:39.956023 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 658/1309] 10.222.0.24 () {54 vars in 964 bytes} [Mon May 16 18:59:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:59:39.963855 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f013c2-90a2-4b78-bf27-1af28f5a318a None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:59:39.964827 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f013c2-90a2-4b78-bf27-1af28f5a318a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:59:39.965656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f013c2-90a2-4b78-bf27-1af28f5a318a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:59:40.065703 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-36f013c2-90a2-4b78-bf27-1af28f5a318a None None] MFA Rules not processed for user `ee9e8d17cf1648e0b650df48b8f9487a`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:59:40.067264 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-36f013c2-90a2-4b78-bf27-1af28f5a318a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:59:40.147018 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 652/1310] 10.222.0.24 () {58 vars in 1061 bytes} [Mon May 16 18:59:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:59:40.156198 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf9f4d-9e29-4424-a02d-dc67c6e90665 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:59:40.158328 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-19bf9f4d-9e29-4424-a02d-dc67c6e90665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:59:40.263549 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf9f4d-9e29-4424-a02d-dc67c6e90665 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:59:40.343838 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313efa9f-6975-4db9-936b-32062c166698 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:59:40.344516 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313efa9f-6975-4db9-936b-32062c166698 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:59:40.344797 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313efa9f-6975-4db9-936b-32062c166698 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:59:40.345086 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313efa9f-6975-4db9-936b-32062c166698 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:59:40.347472 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-313efa9f-6975-4db9-936b-32062c166698 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:59:40.470741 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313efa9f-6975-4db9-936b-32062c166698 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:59:40.472325 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313efa9f-6975-4db9-936b-32062c166698 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:59:40.494178 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 659/1311] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 18:59:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:59:43.044290 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ce11b-6b5e-4bb3-a0eb-260b8a20fb38 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:59:43.044767 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ce11b-6b5e-4bb3-a0eb-260b8a20fb38 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:59:43.045126 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ce11b-6b5e-4bb3-a0eb-260b8a20fb38 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:59:43.046248 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 653/1312] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:59:43.052468 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e2ecb-e1ef-4433-8782-db58f1cecea4 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:59:43.052938 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e2ecb-e1ef-4433-8782-db58f1cecea4 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:59:43.053639 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e2ecb-e1ef-4433-8782-db58f1cecea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:59:43.129422 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-f75e2ecb-e1ef-4433-8782-db58f1cecea4 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:59:43.130785 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f75e2ecb-e1ef-4433-8782-db58f1cecea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:59:43.225054 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 660/1313] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:59:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:59:43.262084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ce11b-6b5e-4bb3-a0eb-260b8a20fb38 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:59:43.263618 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-657ce11b-6b5e-4bb3-a0eb-260b8a20fb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:59:43.369408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ce11b-6b5e-4bb3-a0eb-260b8a20fb38 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:59:43.445314 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d29936-cc29-4c53-9910-5a334f70eb97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:59:43.445912 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d29936-cc29-4c53-9910-5a334f70eb97 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:59:43.446196 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d29936-cc29-4c53-9910-5a334f70eb97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:59:43.446470 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d29936-cc29-4c53-9910-5a334f70eb97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:59:43.448088 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f1d29936-cc29-4c53-9910-5a334f70eb97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:59:43.556176 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d29936-cc29-4c53-9910-5a334f70eb97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:59:43.557568 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d29936-cc29-4c53-9910-5a334f70eb97 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:59:43.575562 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 654/1314] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 18:59:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:59:46.117896 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37bfed5-fe68-4cf7-835a-eeee361a84db None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:59:46.118455 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37bfed5-fe68-4cf7-835a-eeee361a84db None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:59:46.118455 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37bfed5-fe68-4cf7-835a-eeee361a84db None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:59:46.119827 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 661/1315] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:59:46.125489 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cb29d-0509-4638-8eb0-a656a7175188 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:59:46.125957 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cb29d-0509-4638-8eb0-a656a7175188 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:59:46.126067 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cb29d-0509-4638-8eb0-a656a7175188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:59:46.192701 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-7d8cb29d-0509-4638-8eb0-a656a7175188 None None] MFA Rules not processed for user `c200fe70b1474e1d9846532764b494ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:59:46.193932 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7d8cb29d-0509-4638-8eb0-a656a7175188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:59:46.289640 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 655/1316] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:59:46 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:59:46.332612 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37bfed5-fe68-4cf7-835a-eeee361a84db None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:59:46.335118 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a37bfed5-fe68-4cf7-835a-eeee361a84db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:59:46.444458 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37bfed5-fe68-4cf7-835a-eeee361a84db None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:59:46.517129 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9051e0-ff08-416e-8b11-987e6e058c2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:59:46.517792 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9051e0-ff08-416e-8b11-987e6e058c2c service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:59:46.518066 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9051e0-ff08-416e-8b11-987e6e058c2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:59:46.518336 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9051e0-ff08-416e-8b11-987e6e058c2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:59:46.519937 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-dd9051e0-ff08-416e-8b11-987e6e058c2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:59:46.625354 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9051e0-ff08-416e-8b11-987e6e058c2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:59:46.626859 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9051e0-ff08-416e-8b11-987e6e058c2c service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:59:46.645051 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 662/1317] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 18:59:46 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:59:49.381378 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b713a-2914-415a-9814-1c694aed6006 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:59:49.382322 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b713a-2914-415a-9814-1c694aed6006 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:59:49.382322 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b713a-2914-415a-9814-1c694aed6006 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:59:49.384523 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 656/1318] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:59:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:59:49.390027 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5a86d-f173-4f3d-b810-0e2867b187d6 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:59:49.390450 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5a86d-f173-4f3d-b810-0e2867b187d6 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:59:49.390542 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5a86d-f173-4f3d-b810-0e2867b187d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:59:49.455585 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-80f5a86d-f173-4f3d-b810-0e2867b187d6 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:59:49.456687 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-80f5a86d-f173-4f3d-b810-0e2867b187d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:59:49.557395 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 663/1319] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:59:49 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:59:49.618057 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf9c12-5f34-4aac-80da-dd3a6a906ba3 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:59:49.618372 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf9c12-5f34-4aac-80da-dd3a6a906ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:59:49.618673 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf9c12-5f34-4aac-80da-dd3a6a906ba3 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:59:49.620292 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 657/1320] 10.222.0.24 () {54 vars in 964 bytes} [Mon May 16 18:59:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:59:49.627623 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21c887-3bda-4982-9638-b86b66413b9d None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:59:49.628020 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21c887-3bda-4982-9638-b86b66413b9d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:59:49.628439 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21c887-3bda-4982-9638-b86b66413b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:59:49.721122 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-cc21c887-3bda-4982-9638-b86b66413b9d None None] MFA Rules not processed for user `ee9e8d17cf1648e0b650df48b8f9487a`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:59:49.722285 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-cc21c887-3bda-4982-9638-b86b66413b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:59:49.796926 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 664/1321] 10.222.0.24 () {58 vars in 1061 bytes} [Mon May 16 18:59:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:59:49.806940 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf9c12-5f34-4aac-80da-dd3a6a906ba3 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:59:49.809315 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-07bf9c12-5f34-4aac-80da-dd3a6a906ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:59:49.931505 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf9c12-5f34-4aac-80da-dd3a6a906ba3 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:59:50.002983 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e8deeb-bfe4-49ac-93f5-1ece40567e01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:59:50.003548 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8deeb-bfe4-49ac-93f5-1ece40567e01 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:59:50.003824 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8deeb-bfe4-49ac-93f5-1ece40567e01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:59:50.004094 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8deeb-bfe4-49ac-93f5-1ece40567e01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:59:50.005766 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-83e8deeb-bfe4-49ac-93f5-1ece40567e01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:59:50.113147 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e8deeb-bfe4-49ac-93f5-1ece40567e01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:59:50.114613 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e8deeb-bfe4-49ac-93f5-1ece40567e01 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:59:50.132990 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 658/1322] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 18:59:49 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:59:53.428316 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43214c25-2f94-4eeb-8e19-c6b8fbcbde23 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:59:53.428872 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43214c25-2f94-4eeb-8e19-c6b8fbcbde23 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:59:53.428872 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43214c25-2f94-4eeb-8e19-c6b8fbcbde23 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:59:53.430235 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 665/1323] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:59:53.435707 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95ded6-b77a-4b6a-b3da-912415726ae3 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:59:53.436162 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95ded6-b77a-4b6a-b3da-912415726ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:59:53.436272 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95ded6-b77a-4b6a-b3da-912415726ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:59:53.498656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-cd95ded6-b77a-4b6a-b3da-912415726ae3 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:59:53.499837 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-cd95ded6-b77a-4b6a-b3da-912415726ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:59:53.594847 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 659/1324] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:59:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:59:53.630811 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43214c25-2f94-4eeb-8e19-c6b8fbcbde23 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:59:53.632363 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-43214c25-2f94-4eeb-8e19-c6b8fbcbde23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:59:53.744897 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43214c25-2f94-4eeb-8e19-c6b8fbcbde23 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:59:53.818800 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577e76b-4c3a-4c15-9120-557933ec6c68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:59:53.819460 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577e76b-4c3a-4c15-9120-557933ec6c68 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:59:53.819733 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577e76b-4c3a-4c15-9120-557933ec6c68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:59:53.819998 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577e76b-4c3a-4c15-9120-557933ec6c68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:59:53.821660 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-5577e76b-4c3a-4c15-9120-557933ec6c68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:59:53.932343 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577e76b-4c3a-4c15-9120-557933ec6c68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:59:53.933835 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577e76b-4c3a-4c15-9120-557933ec6c68 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:59:53.952921 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 666/1325] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 18:59:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:59:56.227962 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc07f9-abf2-46a8-8dec-967e2d6f05c4 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:59:56.228504 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc07f9-abf2-46a8-8dec-967e2d6f05c4 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:59:56.228673 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc07f9-abf2-46a8-8dec-967e2d6f05c4 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:59:56.230141 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 660/1326] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:59:56.235592 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de828a-b56d-4982-a33c-6b2bf4ab43b3 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:59:56.236024 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de828a-b56d-4982-a33c-6b2bf4ab43b3 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:59:56.236140 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de828a-b56d-4982-a33c-6b2bf4ab43b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:59:56.305444 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-91de828a-b56d-4982-a33c-6b2bf4ab43b3 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:59:56.306689 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-91de828a-b56d-4982-a33c-6b2bf4ab43b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:59:56.403059 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 667/1327] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:59:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:59:56.438402 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc07f9-abf2-46a8-8dec-967e2d6f05c4 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:59:56.439968 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2fcc07f9-abf2-46a8-8dec-967e2d6f05c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:59:56.548084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc07f9-abf2-46a8-8dec-967e2d6f05c4 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:59:56.621714 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7330c82-107e-4371-9581-d976fc4e7add service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:59:56.622456 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7330c82-107e-4371-9581-d976fc4e7add service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:59:56.622802 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7330c82-107e-4371-9581-d976fc4e7add service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:59:56.623076 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7330c82-107e-4371-9581-d976fc4e7add service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:59:56.624724 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c7330c82-107e-4371-9581-d976fc4e7add service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:59:56.736307 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7330c82-107e-4371-9581-d976fc4e7add service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:59:56.737690 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7330c82-107e-4371-9581-d976fc4e7add service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:59:56.756143 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 661/1328] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 18:59:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:59:58.988552 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105950c9-2f93-4ef2-b72a-d3cc543ba666 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:59:58.989456 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105950c9-2f93-4ef2-b72a-d3cc543ba666 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:59:58.989771 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105950c9-2f93-4ef2-b72a-d3cc543ba666 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:59:58.991196 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 668/1329] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 18:59:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:59:58.996758 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a2cb0-73a3-426c-a53a-3a222862a9dd None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:59:58.997160 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a2cb0-73a3-426c-a53a-3a222862a9dd None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:59:58.997337 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a2cb0-73a3-426c-a53a-3a222862a9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:59:59.064965 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-d90a2cb0-73a3-426c-a53a-3a222862a9dd None None] MFA Rules not processed for user `c200fe70b1474e1d9846532764b494ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:59:59.066216 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d90a2cb0-73a3-426c-a53a-3a222862a9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:59:59.163504 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 662/1330] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 18:59:58 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:59:59.200194 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105950c9-2f93-4ef2-b72a-d3cc543ba666 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:59:59.201803 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-105950c9-2f93-4ef2-b72a-d3cc543ba666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:59:59.305633 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105950c9-2f93-4ef2-b72a-d3cc543ba666 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:59:59.379800 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2658156-7b17-4565-aee0-5e147d0dfea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:59:59.380462 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2658156-7b17-4565-aee0-5e147d0dfea1 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:59:59.380752 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2658156-7b17-4565-aee0-5e147d0dfea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:59:59.381038 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2658156-7b17-4565-aee0-5e147d0dfea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:59:59.382701 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f2658156-7b17-4565-aee0-5e147d0dfea1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:59:59.491486 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2658156-7b17-4565-aee0-5e147d0dfea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:59:59.492964 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2658156-7b17-4565-aee0-5e147d0dfea1 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:59:59.511633 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 669/1331] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 18:59:59 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:00:01.989672 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffe470-c3bd-4c30-b284-fec69b0c7d33 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:01.990478 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffe470-c3bd-4c30-b284-fec69b0c7d33 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:01.990478 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffe470-c3bd-4c30-b284-fec69b0c7d33 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:01.992304 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 663/1332] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 19:00:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:00:01.999106 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a106f12-4a84-4852-b354-4a9e982ab7ac None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:01.999554 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a106f12-4a84-4852-b354-4a9e982ab7ac None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:01.999663 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a106f12-4a84-4852-b354-4a9e982ab7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:02.066658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-1a106f12-4a84-4852-b354-4a9e982ab7ac None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:00:02.067715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-1a106f12-4a84-4852-b354-4a9e982ab7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:02.176566 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 670/1333] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 19:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:00:02.214222 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffe470-c3bd-4c30-b284-fec69b0c7d33 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:00:02.215682 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5bffe470-c3bd-4c30-b284-fec69b0c7d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:02.319864 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffe470-c3bd-4c30-b284-fec69b0c7d33 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:00:02.402791 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20db3b-a401-4d4f-96bf-aa871a35c91e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:00:02.403462 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20db3b-a401-4d4f-96bf-aa871a35c91e service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:02.403732 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20db3b-a401-4d4f-96bf-aa871a35c91e service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:02.403982 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20db3b-a401-4d4f-96bf-aa871a35c91e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:02.405696 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-db20db3b-a401-4d4f-96bf-aa871a35c91e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:02.519079 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20db3b-a401-4d4f-96bf-aa871a35c91e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:00:02.520575 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20db3b-a401-4d4f-96bf-aa871a35c91e service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:00:02.540623 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 664/1334] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:00:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:00:04.791909 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e5b65-8d9d-4b68-8e1f-8e63b44a5b82 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:04.792926 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e5b65-8d9d-4b68-8e1f-8e63b44a5b82 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:04.792926 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e5b65-8d9d-4b68-8e1f-8e63b44a5b82 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:04.794117 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 671/1335] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 19:00:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:00:04.800832 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce6471-2f9c-4bf2-8953-4ef69255bf67 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:04.801274 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce6471-2f9c-4bf2-8953-4ef69255bf67 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:04.801367 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce6471-2f9c-4bf2-8953-4ef69255bf67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:04.863689 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-76ce6471-2f9c-4bf2-8953-4ef69255bf67 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:00:04.865441 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-76ce6471-2f9c-4bf2-8953-4ef69255bf67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:04.961646 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 665/1336] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 19:00:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:00:05.003226 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e5b65-8d9d-4b68-8e1f-8e63b44a5b82 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:00:05.004772 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-8f8e5b65-8d9d-4b68-8e1f-8e63b44a5b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:05.131089 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e5b65-8d9d-4b68-8e1f-8e63b44a5b82 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:00:05.208720 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa180f37-ca47-4543-8666-7d3021b316b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:00:05.209368 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa180f37-ca47-4543-8666-7d3021b316b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:05.209685 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa180f37-ca47-4543-8666-7d3021b316b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:05.209952 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa180f37-ca47-4543-8666-7d3021b316b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:05.211572 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-aa180f37-ca47-4543-8666-7d3021b316b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:05.319498 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa180f37-ca47-4543-8666-7d3021b316b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:00:05.320932 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa180f37-ca47-4543-8666-7d3021b316b6 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:00:05.338931 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 672/1337] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:00:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:00:07.988102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3d1f8-633c-41f7-8363-c623552f5b8b None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:07.988665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3d1f8-633c-41f7-8363-c623552f5b8b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:07.988665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3d1f8-633c-41f7-8363-c623552f5b8b None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:07.990092 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 666/1338] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 19:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:00:07.995606 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf110b3-e81e-47e1-9270-00e7aa9101fb None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:07.996011 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf110b3-e81e-47e1-9270-00e7aa9101fb None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:07.996151 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf110b3-e81e-47e1-9270-00e7aa9101fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:08.063424 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-ddf110b3-e81e-47e1-9270-00e7aa9101fb None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:00:08.064649 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-ddf110b3-e81e-47e1-9270-00e7aa9101fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:08.162939 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 673/1339] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 19:00:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:00:08.200514 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3d1f8-633c-41f7-8363-c623552f5b8b None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:00:08.202074 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6ce3d1f8-633c-41f7-8363-c623552f5b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:08.314473 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3d1f8-633c-41f7-8363-c623552f5b8b None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:00:08.387169 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192eaae1-8b49-4896-830a-6447ba962911 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:00:08.387816 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192eaae1-8b49-4896-830a-6447ba962911 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:08.388095 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192eaae1-8b49-4896-830a-6447ba962911 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:08.388365 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192eaae1-8b49-4896-830a-6447ba962911 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:08.390047 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-192eaae1-8b49-4896-830a-6447ba962911 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:08.496273 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192eaae1-8b49-4896-830a-6447ba962911 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:00:08.497760 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192eaae1-8b49-4896-830a-6447ba962911 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:00:08.515994 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 667/1340] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:00:08 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:00:12.896521 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e189da3-39b2-47bc-ad05-6e94acd467f4 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:12.897101 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e189da3-39b2-47bc-ad05-6e94acd467f4 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:12.897101 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e189da3-39b2-47bc-ad05-6e94acd467f4 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:12.898395 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 674/1341] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 19:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:00:12.904243 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d7f37-0294-4410-82fb-b4425afc522b None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:12.904665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d7f37-0294-4410-82fb-b4425afc522b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:12.904838 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d7f37-0294-4410-82fb-b4425afc522b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:13.114093 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-c72d7f37-0294-4410-82fb-b4425afc522b None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:00:13.115306 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c72d7f37-0294-4410-82fb-b4425afc522b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:13.220547 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 668/1342] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 19:00:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:00:13.259217 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e189da3-39b2-47bc-ad05-6e94acd467f4 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:00:13.261549 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-0e189da3-39b2-47bc-ad05-6e94acd467f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:13.359424 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e189da3-39b2-47bc-ad05-6e94acd467f4 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:00:13.363404 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec9af0-de51-427a-af9a-c345a99270df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:00:13.364062 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec9af0-de51-427a-af9a-c345a99270df service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:13.364343 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec9af0-de51-427a-af9a-c345a99270df service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:13.364620 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec9af0-de51-427a-af9a-c345a99270df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:13.373996 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec9af0-de51-427a-af9a-c345a99270df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:00:13.375439 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec9af0-de51-427a-af9a-c345a99270df service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:00:13.385137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 675/1343] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:00:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:00:16.162403 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58f728-f3ab-4460-ac03-0a77cc609596 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:16.162944 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58f728-f3ab-4460-ac03-0a77cc609596 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:16.162944 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58f728-f3ab-4460-ac03-0a77cc609596 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:16.164410 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 669/1344] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 19:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:00:16.169849 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78a9de-db89-4bc0-888a-6f3a385c6b4a None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:16.170298 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78a9de-db89-4bc0-888a-6f3a385c6b4a None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:16.170412 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78a9de-db89-4bc0-888a-6f3a385c6b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:16.198356 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-ba78a9de-db89-4bc0-888a-6f3a385c6b4a None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:00:16.199577 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-ba78a9de-db89-4bc0-888a-6f3a385c6b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:16.275383 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 676/1345] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 19:00:16 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:00:16.312318 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58f728-f3ab-4460-ac03-0a77cc609596 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:00:16.323599 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58f728-f3ab-4460-ac03-0a77cc609596 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:00:16.327337 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a62d9-ad57-44a2-9349-1adba4fbd252 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:00:16.327970 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a62d9-ad57-44a2-9349-1adba4fbd252 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:16.328256 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a62d9-ad57-44a2-9349-1adba4fbd252 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:16.328523 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a62d9-ad57-44a2-9349-1adba4fbd252 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:16.337727 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a62d9-ad57-44a2-9349-1adba4fbd252 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:00:16.339156 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a62d9-ad57-44a2-9349-1adba4fbd252 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:00:16.348567 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 670/1346] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:00:16 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 19:00:20.426960 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760c774-184b-4c04-9896-894a03a2587c None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:20.427485 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760c774-184b-4c04-9896-894a03a2587c None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:20.427485 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760c774-184b-4c04-9896-894a03a2587c None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:20.428899 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 677/1347] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 19:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:00:20.434248 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419295d8-5fa7-4214-af3b-8f7e7ed75590 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:20.434705 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419295d8-5fa7-4214-af3b-8f7e7ed75590 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:20.434809 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419295d8-5fa7-4214-af3b-8f7e7ed75590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:20.453392 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-419295d8-5fa7-4214-af3b-8f7e7ed75590 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:00:20.454630 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-419295d8-5fa7-4214-af3b-8f7e7ed75590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:20.463196 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 671/1348] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 19:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:00:20.500210 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760c774-184b-4c04-9896-894a03a2587c None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:00:20.512553 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760c774-184b-4c04-9896-894a03a2587c None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:00:20.516450 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517e467-2d94-4eb8-9f7a-597d4490b65d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:00:20.517089 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517e467-2d94-4eb8-9f7a-597d4490b65d service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:20.517369 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517e467-2d94-4eb8-9f7a-597d4490b65d service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:20.517689 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517e467-2d94-4eb8-9f7a-597d4490b65d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:20.527117 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9517e467-2d94-4eb8-9f7a-597d4490b65d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:00:20.528562 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9517e467-2d94-4eb8-9f7a-597d4490b65d service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:00:20.537925 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 678/1349] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:00:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:00:25.959325 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb3901-8e59-4f0a-8e8e-acfe4d068403 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:25.960271 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb3901-8e59-4f0a-8e8e-acfe4d068403 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:25.960785 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb3901-8e59-4f0a-8e8e-acfe4d068403 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:25.962777 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 672/1350] 10.222.0.24 () {54 vars in 921 bytes} [Mon May 16 19:00:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:00:25.967738 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b55c9c-e7f9-4c62-a0fa-71fdff20def8 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:25.968585 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b55c9c-e7f9-4c62-a0fa-71fdff20def8 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:25.970748 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b55c9c-e7f9-4c62-a0fa-71fdff20def8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:26.094590 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-51b55c9c-e7f9-4c62-a0fa-71fdff20def8 None None] MFA Rules not processed for user `629742b135b2447898e8291d9a360295`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:00:26.095772 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-51b55c9c-e7f9-4c62-a0fa-71fdff20def8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:26.223885 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 679/1351] 10.222.0.24 () {58 vars in 1018 bytes} [Mon May 16 19:00:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:00:30.287605 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcaf437-ec12-40bb-93d0-987ef1772b85 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:30.288114 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcaf437-ec12-40bb-93d0-987ef1772b85 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:30.288114 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcaf437-ec12-40bb-93d0-987ef1772b85 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:30.289723 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 673/1352] 10.222.0.24 () {54 vars in 921 bytes} [Mon May 16 19:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:00:30.295125 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f296c-f572-4764-a2f8-487d896661d1 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:30.295568 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f296c-f572-4764-a2f8-487d896661d1 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:30.295677 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f296c-f572-4764-a2f8-487d896661d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:30.314816 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-531f296c-f572-4764-a2f8-487d896661d1 None None] MFA Rules not processed for user `629742b135b2447898e8291d9a360295`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:00:30.316149 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-531f296c-f572-4764-a2f8-487d896661d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:30.325161 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 680/1353] 10.222.0.24 () {58 vars in 1018 bytes} [Mon May 16 19:00:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:00:31.732760 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df40a9e-794e-4b38-8ca9-7fe8a304442a None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:31.733307 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df40a9e-794e-4b38-8ca9-7fe8a304442a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:31.733428 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df40a9e-794e-4b38-8ca9-7fe8a304442a None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:31.734856 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 674/1354] 10.222.0.24 () {54 vars in 921 bytes} [Mon May 16 19:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:00:31.740263 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de7436-ddcd-4ac6-ab51-40fb43ead1f1 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:31.740723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de7436-ddcd-4ac6-ab51-40fb43ead1f1 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:31.740818 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de7436-ddcd-4ac6-ab51-40fb43ead1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:31.759317 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-08de7436-ddcd-4ac6-ab51-40fb43ead1f1 None None] MFA Rules not processed for user `629742b135b2447898e8291d9a360295`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:00:31.760636 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-08de7436-ddcd-4ac6-ab51-40fb43ead1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:31.770981 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 681/1355] 10.222.0.24 () {58 vars in 1018 bytes} [Mon May 16 19:00:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:00:35.696363 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a5150-de26-4c22-8daf-266d8c67ae68 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:35.696922 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a5150-de26-4c22-8daf-266d8c67ae68 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:35.696922 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a5150-de26-4c22-8daf-266d8c67ae68 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:35.698171 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 675/1356] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 19:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:00:35.703509 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fce7c4-a0b2-48a2-842f-b9d71c922318 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:35.703944 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fce7c4-a0b2-48a2-842f-b9d71c922318 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:35.704153 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fce7c4-a0b2-48a2-842f-b9d71c922318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:35.721906 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-24fce7c4-a0b2-48a2-842f-b9d71c922318 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:00:35.723141 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-24fce7c4-a0b2-48a2-842f-b9d71c922318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:35.731239 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 682/1357] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 19:00:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:00:35.779948 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985f2c2-e6e2-4d7c-9c04-14ede9f1aaa3 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:35.780289 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985f2c2-e6e2-4d7c-9c04-14ede9f1aaa3 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:35.780771 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985f2c2-e6e2-4d7c-9c04-14ede9f1aaa3 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:35.782439 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 676/1358] 10.222.0.24 () {54 vars in 961 bytes} [Mon May 16 19:00:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:00:35.787958 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280ad60-ecfb-443a-be21-a6adfc9de525 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:35.788245 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280ad60-ecfb-443a-be21-a6adfc9de525 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:35.788531 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280ad60-ecfb-443a-be21-a6adfc9de525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:35.837082 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-3280ad60-ecfb-443a-be21-a6adfc9de525 None None] MFA Rules not processed for user `1f03aa520ee14615b802cdbc3cd4f87d`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:00:35.838653 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-3280ad60-ecfb-443a-be21-a6adfc9de525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:35.939437 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 683/1359] 10.222.0.24 () {58 vars in 1058 bytes} [Mon May 16 19:00:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:00:35.947608 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985f2c2-e6e2-4d7c-9c04-14ede9f1aaa3 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:00:35.961892 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985f2c2-e6e2-4d7c-9c04-14ede9f1aaa3 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:00:35.967689 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f1dab-7a33-412e-ab0c-597f845e2bf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:00:35.968572 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f1dab-7a33-412e-ab0c-597f845e2bf9 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:35.969126 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f1dab-7a33-412e-ab0c-597f845e2bf9 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:35.969739 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f1dab-7a33-412e-ab0c-597f845e2bf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:35.978589 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6f1dab-7a33-412e-ab0c-597f845e2bf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:00:35.980520 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6f1dab-7a33-412e-ab0c-597f845e2bf9 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:00:35.991161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 677/1360] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:00:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:00:38.420029 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca8e74-ec9d-4309-8cbb-50b203c1adba None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:38.420638 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca8e74-ec9d-4309-8cbb-50b203c1adba None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:38.420638 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca8e74-ec9d-4309-8cbb-50b203c1adba None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:38.422196 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 684/1361] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 19:00:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:00:38.427742 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e4b3e-7acd-4cb0-9bea-0a86e300b0b5 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:38.428545 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e4b3e-7acd-4cb0-9bea-0a86e300b0b5 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:38.428835 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e4b3e-7acd-4cb0-9bea-0a86e300b0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:38.447404 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-4d5e4b3e-7acd-4cb0-9bea-0a86e300b0b5 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:00:38.449519 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4d5e4b3e-7acd-4cb0-9bea-0a86e300b0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:38.458088 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 678/1362] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 19:00:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:00:38.502153 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca8e74-ec9d-4309-8cbb-50b203c1adba None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:00:38.517205 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca8e74-ec9d-4309-8cbb-50b203c1adba None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:00:38.523035 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510a383-1429-4216-bc53-00a6526e9972 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:00:38.523688 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510a383-1429-4216-bc53-00a6526e9972 service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:38.523969 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510a383-1429-4216-bc53-00a6526e9972 service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:38.524246 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510a383-1429-4216-bc53-00a6526e9972 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:38.532890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6510a383-1429-4216-bc53-00a6526e9972 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:00:38.534552 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6510a383-1429-4216-bc53-00a6526e9972 service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:00:38.544846 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 685/1363] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:00:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:00:41.050840 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e55c89-7dab-4825-920a-c79c02265f6d None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:41.051829 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e55c89-7dab-4825-920a-c79c02265f6d None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:41.052324 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e55c89-7dab-4825-920a-c79c02265f6d None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:41.059582 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 679/1364] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 19:00:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:00:41.065959 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08fd7f-9886-4585-b88e-db0db352f97b None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:41.066913 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08fd7f-9886-4585-b88e-db0db352f97b None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:41.067391 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08fd7f-9886-4585-b88e-db0db352f97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:41.090857 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-2c08fd7f-9886-4585-b88e-db0db352f97b None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:00:41.092494 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-2c08fd7f-9886-4585-b88e-db0db352f97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:41.100564 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 686/1365] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 19:00:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:00:41.145636 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7964f22-db82-443f-9481-da42465aacfa None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:41.145923 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7964f22-db82-443f-9481-da42465aacfa None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:41.146197 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7964f22-db82-443f-9481-da42465aacfa None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:41.147631 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 680/1366] 10.222.0.24 () {54 vars in 961 bytes} [Mon May 16 19:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:00:41.153476 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222ac49-f444-421e-a81b-b0fd40c9be46 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:41.154368 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222ac49-f444-421e-a81b-b0fd40c9be46 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:41.154649 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222ac49-f444-421e-a81b-b0fd40c9be46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:41.175485 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-8222ac49-f444-421e-a81b-b0fd40c9be46 None None] MFA Rules not processed for user `1f03aa520ee14615b802cdbc3cd4f87d`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:00:41.176688 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-8222ac49-f444-421e-a81b-b0fd40c9be46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:41.187218 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 687/1367] 10.222.0.24 () {58 vars in 1058 bytes} [Mon May 16 19:00:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:00:41.195414 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7964f22-db82-443f-9481-da42465aacfa None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:00:41.210807 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7964f22-db82-443f-9481-da42465aacfa None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:00:41.217020 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace0675-6809-47fc-841b-4a92a29800c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:00:41.217693 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace0675-6809-47fc-841b-4a92a29800c7 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:41.217970 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace0675-6809-47fc-841b-4a92a29800c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:41.218246 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace0675-6809-47fc-841b-4a92a29800c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:41.226537 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace0675-6809-47fc-841b-4a92a29800c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:00:41.228147 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace0675-6809-47fc-841b-4a92a29800c7 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:00:41.237982 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 681/1368] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:00:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:00:43.569501 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c8a31-2c07-4fae-a9e8-7eede1e17ed6 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:43.570155 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c8a31-2c07-4fae-a9e8-7eede1e17ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:43.570155 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c8a31-2c07-4fae-a9e8-7eede1e17ed6 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:43.571667 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 688/1369] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 19:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:00:43.577072 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6605ead-d8d8-4d6a-a37f-96102540bcdf None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:43.577656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6605ead-d8d8-4d6a-a37f-96102540bcdf None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:43.577656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6605ead-d8d8-4d6a-a37f-96102540bcdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:43.598049 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-b6605ead-d8d8-4d6a-a37f-96102540bcdf None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:00:43.599304 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b6605ead-d8d8-4d6a-a37f-96102540bcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:43.608599 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 682/1370] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 19:00:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:00:43.653926 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c8a31-2c07-4fae-a9e8-7eede1e17ed6 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:00:43.668460 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c8a31-2c07-4fae-a9e8-7eede1e17ed6 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:00:43.674173 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38574aa2-749f-4289-b00f-cbb987c75f63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:00:43.675009 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38574aa2-749f-4289-b00f-cbb987c75f63 service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:43.675447 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38574aa2-749f-4289-b00f-cbb987c75f63 service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:43.675938 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38574aa2-749f-4289-b00f-cbb987c75f63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:43.684941 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38574aa2-749f-4289-b00f-cbb987c75f63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:00:43.686830 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38574aa2-749f-4289-b00f-cbb987c75f63 service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:00:43.696936 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 689/1371] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:00:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:00:43.780171 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8d28f-4ed6-401d-8d7b-50a21d8396fb None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:43.780467 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8d28f-4ed6-401d-8d7b-50a21d8396fb None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:43.780744 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8d28f-4ed6-401d-8d7b-50a21d8396fb None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:43.782239 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 683/1372] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 19:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:00:43.788819 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099838c-a509-4795-bc58-4da29af2521d None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:43.789125 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099838c-a509-4795-bc58-4da29af2521d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:43.789654 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099838c-a509-4795-bc58-4da29af2521d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:43.810828 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-8099838c-a509-4795-bc58-4da29af2521d None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:00:43.812486 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-8099838c-a509-4795-bc58-4da29af2521d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:43.830868 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 690/1373] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 19:00:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:00:44.151461 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42233f58-854e-4944-a28f-91865992cd60 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:44.151826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42233f58-854e-4944-a28f-91865992cd60 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:44.152536 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42233f58-854e-4944-a28f-91865992cd60 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:44.154460 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 684/1374] 10.222.0.24 () {54 vars in 963 bytes} [Mon May 16 19:00:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:00:44.163618 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db76256-83b5-421d-acae-696ee9020eaa None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:44.163875 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db76256-83b5-421d-acae-696ee9020eaa None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:44.164332 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db76256-83b5-421d-acae-696ee9020eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:44.213229 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-0db76256-83b5-421d-acae-696ee9020eaa None None] MFA Rules not processed for user `36439df302854b158c85f4fbb5bcb7d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:00:44.214839 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-0db76256-83b5-421d-acae-696ee9020eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:44.276341 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 691/1375] 10.222.0.24 () {58 vars in 1060 bytes} [Mon May 16 19:00:44 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:00:44.284125 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42233f58-854e-4944-a28f-91865992cd60 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:00:44.295165 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42233f58-854e-4944-a28f-91865992cd60 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:00:44.298958 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e77f44a-ceb5-4f71-9127-65e45798ea7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:00:44.299681 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77f44a-ceb5-4f71-9127-65e45798ea7d service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:44.300034 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77f44a-ceb5-4f71-9127-65e45798ea7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:44.300377 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77f44a-ceb5-4f71-9127-65e45798ea7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:44.309831 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e77f44a-ceb5-4f71-9127-65e45798ea7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:00:44.311503 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e77f44a-ceb5-4f71-9127-65e45798ea7d service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:00:44.321341 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 685/1376] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:00:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:00:45.941455 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a45035-9ee6-48d6-bcbd-0afc9aa69677 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:45.942092 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a45035-9ee6-48d6-bcbd-0afc9aa69677 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:45.942092 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a45035-9ee6-48d6-bcbd-0afc9aa69677 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:45.943548 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 692/1377] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 19:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:00:45.949999 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d9b6c-8e14-4a9b-9207-81f1c799ad18 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:45.950564 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d9b6c-8e14-4a9b-9207-81f1c799ad18 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:45.950564 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d9b6c-8e14-4a9b-9207-81f1c799ad18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:45.969108 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-616d9b6c-8e14-4a9b-9207-81f1c799ad18 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:00:45.970364 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-616d9b6c-8e14-4a9b-9207-81f1c799ad18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:45.981285 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 686/1378] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 19:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:00:46.023833 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a45035-9ee6-48d6-bcbd-0afc9aa69677 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:00:46.042283 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a45035-9ee6-48d6-bcbd-0afc9aa69677 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:00:46.049060 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a6524-e94a-4ac0-8055-8c1ce2527138 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:00:46.049882 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a6524-e94a-4ac0-8055-8c1ce2527138 service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:46.050167 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a6524-e94a-4ac0-8055-8c1ce2527138 service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:46.050525 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a6524-e94a-4ac0-8055-8c1ce2527138 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:46.059817 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a6524-e94a-4ac0-8055-8c1ce2527138 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:00:46.061423 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a6524-e94a-4ac0-8055-8c1ce2527138 service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:00:46.071338 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 693/1379] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:00:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:00:48.309196 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf112d21-4f44-40c3-8a16-b7d0f16663a0 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:48.309799 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf112d21-4f44-40c3-8a16-b7d0f16663a0 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:48.309916 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf112d21-4f44-40c3-8a16-b7d0f16663a0 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:48.311470 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 687/1380] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 19:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:00:48.316989 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef66d28-ac1e-446d-989a-7397858128f7 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:48.317442 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef66d28-ac1e-446d-989a-7397858128f7 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:48.317588 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef66d28-ac1e-446d-989a-7397858128f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:48.336153 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-7ef66d28-ac1e-446d-989a-7397858128f7 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:00:48.337379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-7ef66d28-ac1e-446d-989a-7397858128f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:48.346900 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 694/1381] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 19:00:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:00:48.390358 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf112d21-4f44-40c3-8a16-b7d0f16663a0 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:00:48.405501 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf112d21-4f44-40c3-8a16-b7d0f16663a0 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:00:48.411036 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8bbc01-ec2d-440b-80a9-80213cb6483c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:00:48.411777 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bbc01-ec2d-440b-80a9-80213cb6483c service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:48.412057 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bbc01-ec2d-440b-80a9-80213cb6483c service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:48.412505 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bbc01-ec2d-440b-80a9-80213cb6483c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:48.421092 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8bbc01-ec2d-440b-80a9-80213cb6483c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:00:48.422608 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8bbc01-ec2d-440b-80a9-80213cb6483c service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:00:48.432985 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 688/1382] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:00:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:00:50.692253 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f5bf0-6413-428f-ab85-8e6ff6c1feb8 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:50.693178 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f5bf0-6413-428f-ab85-8e6ff6c1feb8 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:50.693428 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f5bf0-6413-428f-ab85-8e6ff6c1feb8 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:50.695016 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 695/1383] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 19:00:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:00:50.700518 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b299c0d-5fd4-4257-a0b4-9a26f8d18676 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:50.700957 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b299c0d-5fd4-4257-a0b4-9a26f8d18676 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:50.701051 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b299c0d-5fd4-4257-a0b4-9a26f8d18676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:50.719071 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-4b299c0d-5fd4-4257-a0b4-9a26f8d18676 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:00:50.720250 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4b299c0d-5fd4-4257-a0b4-9a26f8d18676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:50.728633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 689/1384] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 19:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:00:50.770491 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f5bf0-6413-428f-ab85-8e6ff6c1feb8 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:00:50.786122 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f5bf0-6413-428f-ab85-8e6ff6c1feb8 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:00:50.792030 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c274c-226b-4774-bc06-064b46c50199 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:00:50.792672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c274c-226b-4774-bc06-064b46c50199 service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:50.793051 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c274c-226b-4774-bc06-064b46c50199 service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:50.793325 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c274c-226b-4774-bc06-064b46c50199 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:50.802175 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c274c-226b-4774-bc06-064b46c50199 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:00:50.803788 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c274c-226b-4774-bc06-064b46c50199 service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:00:50.813501 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 696/1385] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:00:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:00:53.039119 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e71386-77a0-42b7-88e8-02ced893495c None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:53.039743 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e71386-77a0-42b7-88e8-02ced893495c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:53.039743 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e71386-77a0-42b7-88e8-02ced893495c None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:53.041127 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 690/1386] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 19:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:00:53.047160 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49106d-66fc-4b7c-9b3f-442756743255 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:53.047576 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49106d-66fc-4b7c-9b3f-442756743255 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:53.048006 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49106d-66fc-4b7c-9b3f-442756743255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:53.072187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-5c49106d-66fc-4b7c-9b3f-442756743255 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:00:53.073439 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-5c49106d-66fc-4b7c-9b3f-442756743255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:53.086010 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 697/1387] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 19:00:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:00:53.131215 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e71386-77a0-42b7-88e8-02ced893495c None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:00:53.148148 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e71386-77a0-42b7-88e8-02ced893495c None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:00:53.155783 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d8144-9fac-45b4-8212-13defc69eb1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:00:53.156702 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d8144-9fac-45b4-8212-13defc69eb1b service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:53.157063 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d8144-9fac-45b4-8212-13defc69eb1b service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:53.157436 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d8144-9fac-45b4-8212-13defc69eb1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:53.169013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d8144-9fac-45b4-8212-13defc69eb1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:00:53.171271 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d8144-9fac-45b4-8212-13defc69eb1b service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:00:53.182581 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 691/1388] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:00:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:00:55.448508 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0473e-0e69-482c-aba1-e5efd5426e8d None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:55.449067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0473e-0e69-482c-aba1-e5efd5426e8d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:55.449427 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0473e-0e69-482c-aba1-e5efd5426e8d None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:55.451728 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 698/1389] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 19:00:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:00:55.460630 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5a226-2297-4430-a42e-2c118b18e61c None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:55.461680 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5a226-2297-4430-a42e-2c118b18e61c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:55.461680 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5a226-2297-4430-a42e-2c118b18e61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:55.487505 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-edf5a226-2297-4430-a42e-2c118b18e61c None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:00:55.489250 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-edf5a226-2297-4430-a42e-2c118b18e61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:55.500350 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 692/1390] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 19:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:00:55.571309 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0473e-0e69-482c-aba1-e5efd5426e8d None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:00:55.588456 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0473e-0e69-482c-aba1-e5efd5426e8d None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:00:55.594382 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce8990-0d2f-4150-81b7-ef9163860eaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:00:55.595140 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce8990-0d2f-4150-81b7-ef9163860eaf service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:55.595405 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce8990-0d2f-4150-81b7-ef9163860eaf service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:55.595603 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce8990-0d2f-4150-81b7-ef9163860eaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:55.608906 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce8990-0d2f-4150-81b7-ef9163860eaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:00:55.611108 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce8990-0d2f-4150-81b7-ef9163860eaf service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:00:55.623842 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 699/1391] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:00:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:00:57.954093 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e6d29-7f6f-4a22-9de5-696ca14f91d1 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:57.954731 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e6d29-7f6f-4a22-9de5-696ca14f91d1 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:57.954731 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e6d29-7f6f-4a22-9de5-696ca14f91d1 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:57.956058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 693/1392] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 19:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:00:57.961728 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39fc1b-91ab-4e37-b8c0-b7158042a9ed None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:57.962192 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39fc1b-91ab-4e37-b8c0-b7158042a9ed None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:57.962292 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39fc1b-91ab-4e37-b8c0-b7158042a9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:57.980285 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-be39fc1b-91ab-4e37-b8c0-b7158042a9ed None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:00:57.981460 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-be39fc1b-91ab-4e37-b8c0-b7158042a9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:57.989747 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 700/1393] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 19:00:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:00:58.033966 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e6d29-7f6f-4a22-9de5-696ca14f91d1 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:00:58.049942 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e6d29-7f6f-4a22-9de5-696ca14f91d1 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:00:58.055595 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c0c66-f42b-4c3b-ab62-5db64892e831 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:00:58.056237 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c0c66-f42b-4c3b-ab62-5db64892e831 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:58.056547 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c0c66-f42b-4c3b-ab62-5db64892e831 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:58.056826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c0c66-f42b-4c3b-ab62-5db64892e831 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:58.065098 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c0c66-f42b-4c3b-ab62-5db64892e831 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:00:58.066742 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c0c66-f42b-4c3b-ab62-5db64892e831 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:00:58.077931 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 694/1394] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:00:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:00:59.843484 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd95ae1-a200-43bf-a187-63428c7bb2f4 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:59.844071 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd95ae1-a200-43bf-a187-63428c7bb2f4 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:59.844071 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd95ae1-a200-43bf-a187-63428c7bb2f4 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:59.845497 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 701/1395] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 19:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:00:59.851470 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16f7f0-59dd-44bc-b1a0-4879a71fe36a None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:59.851945 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16f7f0-59dd-44bc-b1a0-4879a71fe36a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:59.852047 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16f7f0-59dd-44bc-b1a0-4879a71fe36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:59.870470 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-2b16f7f0-59dd-44bc-b1a0-4879a71fe36a None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:00:59.871656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2b16f7f0-59dd-44bc-b1a0-4879a71fe36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:59.881205 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 695/1396] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 19:00:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:00:59.937559 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b9ef2-9c83-4dcc-8824-48dd75f0efb4 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:59.938020 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b9ef2-9c83-4dcc-8824-48dd75f0efb4 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:59.938370 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b9ef2-9c83-4dcc-8824-48dd75f0efb4 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:59.939811 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 702/1397] 10.222.0.24 () {54 vars in 962 bytes} [Mon May 16 19:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:00:59.945114 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf11f3f-ced5-4c61-bffe-38052a2235f6 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:59.945408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf11f3f-ced5-4c61-bffe-38052a2235f6 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:59.945736 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf11f3f-ced5-4c61-bffe-38052a2235f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:59.997997 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-acf11f3f-ced5-4c61-bffe-38052a2235f6 None None] MFA Rules not processed for user `5dfa8e8908804c0e8908e2a8c6b377e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:00:59.999183 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-acf11f3f-ced5-4c61-bffe-38052a2235f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:01:00.060715 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 696/1398] 10.222.0.24 () {58 vars in 1059 bytes} [Mon May 16 19:00:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:01:00.068243 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b9ef2-9c83-4dcc-8824-48dd75f0efb4 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:01:00.079585 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b9ef2-9c83-4dcc-8824-48dd75f0efb4 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:01:00.083303 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ecc284-8145-4379-a8f9-9618e5d403ed service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dfa8e8908804c0e8908e2a8c6b377e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:01:00.083942 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ecc284-8145-4379-a8f9-9618e5d403ed service glance] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:00.084221 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ecc284-8145-4379-a8f9-9618e5d403ed service glance] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:00.084497 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ecc284-8145-4379-a8f9-9618e5d403ed service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:00.093825 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ecc284-8145-4379-a8f9-9618e5d403ed service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:01:00.095278 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ecc284-8145-4379-a8f9-9618e5d403ed service glance] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:01:00.105854 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 703/1399] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:01:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:01:00.290722 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5c1ad-da89-440b-9367-c183af6bf28a None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:00.291024 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5c1ad-da89-440b-9367-c183af6bf28a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:00.291291 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5c1ad-da89-440b-9367-c183af6bf28a None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:00.292724 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 697/1400] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 19:01:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:01:00.298114 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61fa4d-1fe6-4be6-b378-c7e1a4bfae75 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:00.298390 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61fa4d-1fe6-4be6-b378-c7e1a4bfae75 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:00.298668 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61fa4d-1fe6-4be6-b378-c7e1a4bfae75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:00.317486 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-ea61fa4d-1fe6-4be6-b378-c7e1a4bfae75 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:01:00.318733 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-ea61fa4d-1fe6-4be6-b378-c7e1a4bfae75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:01:00.327624 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 704/1401] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 19:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:01:00.371732 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5c1ad-da89-440b-9367-c183af6bf28a None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:01:00.386101 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5c1ad-da89-440b-9367-c183af6bf28a None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:01:00.392894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb82df-36b9-40c6-9487-4736d6a29b1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:01:00.393560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb82df-36b9-40c6-9487-4736d6a29b1a service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:00.393850 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb82df-36b9-40c6-9487-4736d6a29b1a service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:00.394171 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb82df-36b9-40c6-9487-4736d6a29b1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:00.403678 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb82df-36b9-40c6-9487-4736d6a29b1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:01:00.405366 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb82df-36b9-40c6-9487-4736d6a29b1a service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:01:00.414911 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 698/1402] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:01:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:01:00.532906 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e197a-ded7-4be7-9c47-a0a2ba3e9f82 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:00.533189 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e197a-ded7-4be7-9c47-a0a2ba3e9f82 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:00.533454 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e197a-ded7-4be7-9c47-a0a2ba3e9f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:00.586288 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-305e197a-ded7-4be7-9c47-a0a2ba3e9f82 None None] MFA Rules not processed for user `4775e9dd7aea448d95ec7378b4ff3124`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:01:00.587535 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-305e197a-ded7-4be7-9c47-a0a2ba3e9f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:01:00.661384 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 705/1403] 10.222.0.24 () {58 vars in 1009 bytes} [Mon May 16 19:01:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:01:00.703724 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11cf837-d4f3-4eba-bb85-10dbe72a39d8 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:00.704007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11cf837-d4f3-4eba-bb85-10dbe72a39d8 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:00.704277 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11cf837-d4f3-4eba-bb85-10dbe72a39d8 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:00.705773 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 699/1404] 10.222.0.24 () {54 vars in 942 bytes} [Mon May 16 19:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:01:00.711948 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed30d1-0d5a-44c7-b5f3-a51d12c1b237 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:00.712237 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed30d1-0d5a-44c7-b5f3-a51d12c1b237 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:00.712510 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed30d1-0d5a-44c7-b5f3-a51d12c1b237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:00.761223 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-77ed30d1-0d5a-44c7-b5f3-a51d12c1b237 None None] MFA Rules not processed for user `654e435a35c4491eb87943734ce280f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:01:00.762445 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-77ed30d1-0d5a-44c7-b5f3-a51d12c1b237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:01:00.835986 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 706/1405] 10.222.0.24 () {58 vars in 1039 bytes} [Mon May 16 19:01:00 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:01:00.845083 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11cf837-d4f3-4eba-bb85-10dbe72a39d8 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:01:00.858614 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11cf837-d4f3-4eba-bb85-10dbe72a39d8 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:01:00.863898 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329b00e-7924-4901-9ac4-99bebf9aebc1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '654e435a35c4491eb87943734ce280f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:01:00.864534 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329b00e-7924-4901-9ac4-99bebf9aebc1 service swift] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:00.864806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329b00e-7924-4901-9ac4-99bebf9aebc1 service swift] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:00.865057 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329b00e-7924-4901-9ac4-99bebf9aebc1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:00.873317 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329b00e-7924-4901-9ac4-99bebf9aebc1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:01:00.874923 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329b00e-7924-4901-9ac4-99bebf9aebc1 service swift] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:01:00.882837 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 700/1406] 10.222.0.24 () {60 vars in 1384 bytes} [Mon May 16 19:01:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 19:01:02.713355 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363dd94-0c93-4f2c-99a1-8d7c4321a3b1 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:02.714200 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363dd94-0c93-4f2c-99a1-8d7c4321a3b1 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:02.714200 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363dd94-0c93-4f2c-99a1-8d7c4321a3b1 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:02.722074 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a618c4e-6470-43da-889d-96282b51326d None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:02.723158 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a618c4e-6470-43da-889d-96282b51326d None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:02.723642 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a618c4e-6470-43da-889d-96282b51326d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:02.725662 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 707/1407] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 19:01:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:01:02.749031 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-6a618c4e-6470-43da-889d-96282b51326d None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:01:02.750378 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6a618c4e-6470-43da-889d-96282b51326d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:01:02.761101 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 701/1408] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 19:01:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:01:02.804834 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363dd94-0c93-4f2c-99a1-8d7c4321a3b1 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:01:02.819191 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363dd94-0c93-4f2c-99a1-8d7c4321a3b1 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:01:02.827635 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70081740-3b24-4e10-ba99-377d5194de08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:01:02.828301 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70081740-3b24-4e10-ba99-377d5194de08 service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:02.828584 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70081740-3b24-4e10-ba99-377d5194de08 service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:02.828860 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70081740-3b24-4e10-ba99-377d5194de08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:02.837852 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70081740-3b24-4e10-ba99-377d5194de08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:01:02.839487 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70081740-3b24-4e10-ba99-377d5194de08 service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:01:02.848820 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 708/1409] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:01:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:01:24.045848 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1364f2-abec-4782-92e2-b736afe7d71d None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:24.046794 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1364f2-abec-4782-92e2-b736afe7d71d None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:24.046794 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1364f2-abec-4782-92e2-b736afe7d71d None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:24.048720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 702/1410] 10.222.0.24 () {54 vars in 918 bytes} [Mon May 16 19:01:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:01:24.054472 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e607b35-49ed-4836-98c2-c5fe39c025d6 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:24.054934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e607b35-49ed-4836-98c2-c5fe39c025d6 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:24.055065 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e607b35-49ed-4836-98c2-c5fe39c025d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:24.074859 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-1e607b35-49ed-4836-98c2-c5fe39c025d6 None None] MFA Rules not processed for user `629742b135b2447898e8291d9a360295`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:01:24.076054 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-1e607b35-49ed-4836-98c2-c5fe39c025d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:01:24.085431 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 709/1411] 10.222.0.24 () {58 vars in 1015 bytes} [Mon May 16 19:01:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:01:24.100913 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1cbad-bb81-4b4d-b5dc-31ea82e022c3 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:24.101260 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1cbad-bb81-4b4d-b5dc-31ea82e022c3 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:24.101708 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1cbad-bb81-4b4d-b5dc-31ea82e022c3 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:24.103769 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 703/1412] 10.222.0.24 () {54 vars in 918 bytes} [Mon May 16 19:01:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:01:24.108519 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac32256-2a3d-4839-9d7f-d4c4b6b2120b None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:24.108806 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac32256-2a3d-4839-9d7f-d4c4b6b2120b None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:24.109102 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac32256-2a3d-4839-9d7f-d4c4b6b2120b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:24.128074 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-1ac32256-2a3d-4839-9d7f-d4c4b6b2120b None None] MFA Rules not processed for user `1f03aa520ee14615b802cdbc3cd4f87d`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:01:24.129325 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-1ac32256-2a3d-4839-9d7f-d4c4b6b2120b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:01:24.141006 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 710/1413] 10.222.0.24 () {58 vars in 1015 bytes} [Mon May 16 19:01:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:01:26.816402 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30feb67-5718-4190-80ac-f7caa07ad6ef None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:26.817007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30feb67-5718-4190-80ac-f7caa07ad6ef None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:26.817007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30feb67-5718-4190-80ac-f7caa07ad6ef None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:26.818399 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 19:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:01:26.824691 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dba736-e7c8-4614-92f3-2fab7af72ee3 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:26.825288 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dba736-e7c8-4614-92f3-2fab7af72ee3 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:26.825448 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dba736-e7c8-4614-92f3-2fab7af72ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:26.852523 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-06dba736-e7c8-4614-92f3-2fab7af72ee3 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:01:26.853789 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-06dba736-e7c8-4614-92f3-2fab7af72ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:01:26.863178 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 19:01:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:01:26.908828 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30feb67-5718-4190-80ac-f7caa07ad6ef None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:01:26.924528 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30feb67-5718-4190-80ac-f7caa07ad6ef None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:01:26.930745 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd6a0c-ab09-4e3c-9a52-3a6fe2c63830 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:01:26.931379 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd6a0c-ab09-4e3c-9a52-3a6fe2c63830 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:26.931660 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd6a0c-ab09-4e3c-9a52-3a6fe2c63830 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:26.931931 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd6a0c-ab09-4e3c-9a52-3a6fe2c63830 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:26.940578 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd6a0c-ab09-4e3c-9a52-3a6fe2c63830 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:01:26.942208 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd6a0c-ab09-4e3c-9a52-3a6fe2c63830 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:01:26.951567 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 705/1416] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:01:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:01:27.998675 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834af65-e71c-493f-8d5d-a3bf485b2c81 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:27.999576 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834af65-e71c-493f-8d5d-a3bf485b2c81 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:27.999576 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834af65-e71c-493f-8d5d-a3bf485b2c81 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:28.001659 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 19:01:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:01:28.010244 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ae236-47ac-4501-9b9b-cf8786dd1cb8 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:28.010682 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ae236-47ac-4501-9b9b-cf8786dd1cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:28.010818 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ae236-47ac-4501-9b9b-cf8786dd1cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:28.034521 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-098ae236-47ac-4501-9b9b-cf8786dd1cb8 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:01:28.035731 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-098ae236-47ac-4501-9b9b-cf8786dd1cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:01:28.044889 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 19:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:01:28.213109 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834af65-e71c-493f-8d5d-a3bf485b2c81 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:01:28.234532 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834af65-e71c-493f-8d5d-a3bf485b2c81 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:01:28.243723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b736df5-d35a-4150-8410-1b51c5f95829 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:01:28.244369 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b736df5-d35a-4150-8410-1b51c5f95829 service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:28.244651 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b736df5-d35a-4150-8410-1b51c5f95829 service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:28.244918 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b736df5-d35a-4150-8410-1b51c5f95829 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:28.254884 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b736df5-d35a-4150-8410-1b51c5f95829 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:01:28.256582 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b736df5-d35a-4150-8410-1b51c5f95829 service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:01:28.269093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 713/1419] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:01:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:01:29.236840 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb4b17-efca-42af-81d6-7f89d201e968 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:29.237738 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb4b17-efca-42af-81d6-7f89d201e968 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:29.237738 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb4b17-efca-42af-81d6-7f89d201e968 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:29.240544 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 19:01:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:01:29.248142 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f4915-1a41-46ea-a77a-64b66cd692ee None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:29.248626 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f4915-1a41-46ea-a77a-64b66cd692ee None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:29.248728 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f4915-1a41-46ea-a77a-64b66cd692ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:29.269851 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-9e5f4915-1a41-46ea-a77a-64b66cd692ee None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:01:29.271116 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-9e5f4915-1a41-46ea-a77a-64b66cd692ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:01:29.281154 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 19:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:01:29.436941 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb4b17-efca-42af-81d6-7f89d201e968 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:01:29.460383 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb4b17-efca-42af-81d6-7f89d201e968 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:01:29.466602 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e2538b-7072-4fd5-8e13-d5601f91f863 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:01:29.467239 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2538b-7072-4fd5-8e13-d5601f91f863 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:29.467520 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2538b-7072-4fd5-8e13-d5601f91f863 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:29.467790 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2538b-7072-4fd5-8e13-d5601f91f863 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:29.476715 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e2538b-7072-4fd5-8e13-d5601f91f863 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:01:29.478353 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e2538b-7072-4fd5-8e13-d5601f91f863 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:01:29.488529 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 708/1422] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:01:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:01:30.422456 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522aedfb-e51e-4e54-915b-f7feb9c6d6ec None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:30.423281 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522aedfb-e51e-4e54-915b-f7feb9c6d6ec None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:30.423281 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522aedfb-e51e-4e54-915b-f7feb9c6d6ec None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:30.425518 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 19:01:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:01:30.433803 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1742ae-7bf7-4686-a387-b7072ef2bd96 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:30.434550 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1742ae-7bf7-4686-a387-b7072ef2bd96 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:30.434728 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1742ae-7bf7-4686-a387-b7072ef2bd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:30.456923 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-fc1742ae-7bf7-4686-a387-b7072ef2bd96 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:01:30.458152 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-fc1742ae-7bf7-4686-a387-b7072ef2bd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:01:30.467213 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 19:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:01:30.614247 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522aedfb-e51e-4e54-915b-f7feb9c6d6ec None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:01:30.633549 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522aedfb-e51e-4e54-915b-f7feb9c6d6ec None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:01:30.639775 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ef221-0462-42f0-88b1-2f89b7c9b9c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:01:30.640417 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ef221-0462-42f0-88b1-2f89b7c9b9c9 service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:30.640727 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ef221-0462-42f0-88b1-2f89b7c9b9c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:30.640977 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ef221-0462-42f0-88b1-2f89b7c9b9c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:30.649432 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ef221-0462-42f0-88b1-2f89b7c9b9c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:01:30.651059 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ef221-0462-42f0-88b1-2f89b7c9b9c9 service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:01:30.660847 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 716/1425] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:01:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:01:31.580720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3c86d-a096-4437-9947-77bff0a0f0ba None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:31.581263 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3c86d-a096-4437-9947-77bff0a0f0ba None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:31.581263 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3c86d-a096-4437-9947-77bff0a0f0ba None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:31.583491 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 19:01:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:01:31.591525 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584ce8b-b7d2-4bba-a06e-717525cf8646 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:31.592225 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584ce8b-b7d2-4bba-a06e-717525cf8646 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:31.592387 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584ce8b-b7d2-4bba-a06e-717525cf8646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:31.618603 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-a584ce8b-b7d2-4bba-a06e-717525cf8646 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:01:31.619818 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a584ce8b-b7d2-4bba-a06e-717525cf8646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:01:31.628941 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 19:01:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:01:31.783199 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3c86d-a096-4437-9947-77bff0a0f0ba None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:01:31.798309 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3c86d-a096-4437-9947-77bff0a0f0ba None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:01:31.804062 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c57f21-22ed-4e83-87e1-4be312769afb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:01:31.804695 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c57f21-22ed-4e83-87e1-4be312769afb service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:31.804963 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c57f21-22ed-4e83-87e1-4be312769afb service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:31.805230 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c57f21-22ed-4e83-87e1-4be312769afb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:31.813822 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c57f21-22ed-4e83-87e1-4be312769afb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:01:31.815394 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c57f21-22ed-4e83-87e1-4be312769afb service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:01:31.824978 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 711/1428] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:01:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:01:32.684018 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190816f-be23-4431-9443-5857c877034e None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:32.684630 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190816f-be23-4431-9443-5857c877034e None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:32.684630 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190816f-be23-4431-9443-5857c877034e None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:32.685994 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 19:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:01:32.692305 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6340f8-7558-4759-b698-ffdf1d7273b5 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:32.692936 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6340f8-7558-4759-b698-ffdf1d7273b5 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:32.693058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6340f8-7558-4759-b698-ffdf1d7273b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:32.713726 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-1a6340f8-7558-4759-b698-ffdf1d7273b5 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:01:32.714974 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1a6340f8-7558-4759-b698-ffdf1d7273b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:01:32.725262 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 19:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:01:32.876128 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8190816f-be23-4431-9443-5857c877034e None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:01:32.893549 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8190816f-be23-4431-9443-5857c877034e None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:01:32.899531 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0dc4d-af2a-4927-b88f-697fc82e3c08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:01:32.900169 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0dc4d-af2a-4927-b88f-697fc82e3c08 service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:32.900453 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0dc4d-af2a-4927-b88f-697fc82e3c08 service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:32.900723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0dc4d-af2a-4927-b88f-697fc82e3c08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:32.909207 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0dc4d-af2a-4927-b88f-697fc82e3c08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:01:32.910841 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0dc4d-af2a-4927-b88f-697fc82e3c08 service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:01:32.920226 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 719/1431] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:01:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:01:33.790971 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf83bb-6866-4595-acbc-1d921d10d0fa None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:33.791531 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf83bb-6866-4595-acbc-1d921d10d0fa None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:33.791531 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf83bb-6866-4595-acbc-1d921d10d0fa None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:33.792912 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 19:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:01:33.799062 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e175eac-cb0b-440b-a91f-63f7e3cd568d None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:33.799841 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e175eac-cb0b-440b-a91f-63f7e3cd568d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:33.799999 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e175eac-cb0b-440b-a91f-63f7e3cd568d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:33.819235 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-9e175eac-cb0b-440b-a91f-63f7e3cd568d None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:01:33.820421 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-9e175eac-cb0b-440b-a91f-63f7e3cd568d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:01:33.828822 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 19:01:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:01:33.977775 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf83bb-6866-4595-acbc-1d921d10d0fa None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:01:33.996888 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf83bb-6866-4595-acbc-1d921d10d0fa None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:01:34.002427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e15ec-66d3-4035-8a3c-c3b77baba962 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:01:34.003068 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e15ec-66d3-4035-8a3c-c3b77baba962 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:34.003350 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e15ec-66d3-4035-8a3c-c3b77baba962 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:34.003625 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e15ec-66d3-4035-8a3c-c3b77baba962 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:34.011881 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e15ec-66d3-4035-8a3c-c3b77baba962 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:01:34.013481 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e15ec-66d3-4035-8a3c-c3b77baba962 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:01:34.023524 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 714/1434] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:01:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:01:34.879800 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6711e-d0ea-4951-b000-e6e8201d38b8 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:34.880440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6711e-d0ea-4951-b000-e6e8201d38b8 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:34.880440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6711e-d0ea-4951-b000-e6e8201d38b8 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:34.881880 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 19:01:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:01:34.886920 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31c5c1-61ca-4109-8045-16f0e5e627df None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:34.887378 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31c5c1-61ca-4109-8045-16f0e5e627df None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:34.887485 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31c5c1-61ca-4109-8045-16f0e5e627df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:34.906202 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-2c31c5c1-61ca-4109-8045-16f0e5e627df None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:01:34.907397 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2c31c5c1-61ca-4109-8045-16f0e5e627df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:01:34.915859 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 19:01:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:01:35.066014 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6711e-d0ea-4951-b000-e6e8201d38b8 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:01:35.086316 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6711e-d0ea-4951-b000-e6e8201d38b8 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:01:35.094364 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb80577-4e64-4b1b-a215-f4b9cfa33d49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:01:35.094993 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb80577-4e64-4b1b-a215-f4b9cfa33d49 service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:35.095256 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb80577-4e64-4b1b-a215-f4b9cfa33d49 service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:35.095545 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb80577-4e64-4b1b-a215-f4b9cfa33d49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:35.104258 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb80577-4e64-4b1b-a215-f4b9cfa33d49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:01:35.105881 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb80577-4e64-4b1b-a215-f4b9cfa33d49 service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:01:35.116296 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 722/1437] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:01:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:01:35.974537 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb8cff-dc6d-4f7e-9bf4-cf356fb8b674 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:35.975080 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb8cff-dc6d-4f7e-9bf4-cf356fb8b674 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:35.975080 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb8cff-dc6d-4f7e-9bf4-cf356fb8b674 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:35.976361 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 19:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:01:35.982665 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed04d28-27c5-4d95-8a51-554e4f19690c None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:35.983361 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed04d28-27c5-4d95-8a51-554e4f19690c None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:35.983515 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed04d28-27c5-4d95-8a51-554e4f19690c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:36.010314 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-fed04d28-27c5-4d95-8a51-554e4f19690c None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:01:36.011507 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-fed04d28-27c5-4d95-8a51-554e4f19690c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:01:36.020077 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 19:01:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:01:36.177937 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb8cff-dc6d-4f7e-9bf4-cf356fb8b674 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:01:36.197893 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb8cff-dc6d-4f7e-9bf4-cf356fb8b674 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:01:36.203799 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7253d8c8-bd66-4ee4-8b03-fabfa992499f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:01:36.204429 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253d8c8-bd66-4ee4-8b03-fabfa992499f service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:36.204700 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253d8c8-bd66-4ee4-8b03-fabfa992499f service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:36.204966 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253d8c8-bd66-4ee4-8b03-fabfa992499f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:36.213141 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7253d8c8-bd66-4ee4-8b03-fabfa992499f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:01:36.214750 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7253d8c8-bd66-4ee4-8b03-fabfa992499f service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:01:36.223885 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 717/1440] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:01:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:01:38.299955 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb9a1c-41a3-4d28-a1ce-c2b8b892a23e None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:38.301479 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb9a1c-41a3-4d28-a1ce-c2b8b892a23e None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:38.301479 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb9a1c-41a3-4d28-a1ce-c2b8b892a23e None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:38.302810 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 19:01:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:01:38.308696 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da747fb-2ae1-48e4-8686-6bdca953cb6e None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:38.309144 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da747fb-2ae1-48e4-8686-6bdca953cb6e None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:38.309267 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da747fb-2ae1-48e4-8686-6bdca953cb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:38.327762 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-7da747fb-2ae1-48e4-8686-6bdca953cb6e None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:01:38.328889 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7da747fb-2ae1-48e4-8686-6bdca953cb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:01:38.337896 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 19:01:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:01:38.380930 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb9a1c-41a3-4d28-a1ce-c2b8b892a23e None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:01:38.398048 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb9a1c-41a3-4d28-a1ce-c2b8b892a23e None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:01:38.402906 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26175a4a-f746-4310-a311-78fcec44060f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:01:38.403556 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26175a4a-f746-4310-a311-78fcec44060f service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:38.403817 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26175a4a-f746-4310-a311-78fcec44060f service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:38.404098 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26175a4a-f746-4310-a311-78fcec44060f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:38.414004 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26175a4a-f746-4310-a311-78fcec44060f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:01:38.415446 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26175a4a-f746-4310-a311-78fcec44060f service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:01:38.424898 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 725/1443] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:01:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:01:40.743851 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce1b2c-85a0-412e-83c9-0525c7355745 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:40.744771 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce1b2c-85a0-412e-83c9-0525c7355745 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:40.744771 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce1b2c-85a0-412e-83c9-0525c7355745 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:40.746943 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 19:01:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:01:40.753758 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c112871-f131-476d-9075-0300799e1f16 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:40.754453 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c112871-f131-476d-9075-0300799e1f16 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:40.754637 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c112871-f131-476d-9075-0300799e1f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:40.778995 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-9c112871-f131-476d-9075-0300799e1f16 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:01:40.780560 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-9c112871-f131-476d-9075-0300799e1f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:01:40.789682 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 19:01:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:01:40.827168 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce1b2c-85a0-412e-83c9-0525c7355745 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:01:40.841165 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce1b2c-85a0-412e-83c9-0525c7355745 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:01:40.845781 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758ddd5-e4d1-4357-9e47-b9cb7ca8bbfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:01:40.846423 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758ddd5-e4d1-4357-9e47-b9cb7ca8bbfc service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:40.846698 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758ddd5-e4d1-4357-9e47-b9cb7ca8bbfc service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:40.846965 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758ddd5-e4d1-4357-9e47-b9cb7ca8bbfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:40.858267 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f758ddd5-e4d1-4357-9e47-b9cb7ca8bbfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:01:40.859711 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f758ddd5-e4d1-4357-9e47-b9cb7ca8bbfc service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:01:40.869328 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 720/1446] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:01:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:01:43.346007 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231293a-421f-43d7-87d5-cd0e9459cfe2 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:43.346847 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231293a-421f-43d7-87d5-cd0e9459cfe2 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:43.346847 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231293a-421f-43d7-87d5-cd0e9459cfe2 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:43.349024 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 19:01:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:01:43.354708 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ccff1-7032-4a95-8d4c-1b6e093f1541 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:43.355190 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ccff1-7032-4a95-8d4c-1b6e093f1541 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:43.355291 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ccff1-7032-4a95-8d4c-1b6e093f1541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:43.374350 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-c06ccff1-7032-4a95-8d4c-1b6e093f1541 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:01:43.375557 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c06ccff1-7032-4a95-8d4c-1b6e093f1541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:01:43.384518 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 19:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:01:43.423182 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231293a-421f-43d7-87d5-cd0e9459cfe2 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:01:43.435341 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231293a-421f-43d7-87d5-cd0e9459cfe2 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:01:43.439458 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ffcb4-c524-4714-88eb-136cb60cba34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:01:43.440093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ffcb4-c524-4714-88eb-136cb60cba34 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:43.440368 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ffcb4-c524-4714-88eb-136cb60cba34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:43.440636 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ffcb4-c524-4714-88eb-136cb60cba34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:43.450315 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ffcb4-c524-4714-88eb-136cb60cba34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:01:43.451763 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ffcb4-c524-4714-88eb-136cb60cba34 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:01:43.461146 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 728/1449] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:01:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:01:45.811640 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454537b7-1619-4baa-bebc-d5855f825810 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:45.812262 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454537b7-1619-4baa-bebc-d5855f825810 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:45.812262 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454537b7-1619-4baa-bebc-d5855f825810 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:45.814384 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 19:01:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:01:45.822590 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df29a1-4650-4389-b05d-c02895f6c6e2 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:45.823073 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df29a1-4650-4389-b05d-c02895f6c6e2 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:45.823073 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df29a1-4650-4389-b05d-c02895f6c6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:45.843107 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-44df29a1-4650-4389-b05d-c02895f6c6e2 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:01:45.844328 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-44df29a1-4650-4389-b05d-c02895f6c6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:01:45.853655 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 19:01:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:01:45.892162 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454537b7-1619-4baa-bebc-d5855f825810 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:01:45.894264 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-454537b7-1619-4baa-bebc-d5855f825810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:01:45.910731 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454537b7-1619-4baa-bebc-d5855f825810 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:01:45.916427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce93c48-93ac-44ba-9ed7-86cc8e3653b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:01:45.917211 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce93c48-93ac-44ba-9ed7-86cc8e3653b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:45.917651 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce93c48-93ac-44ba-9ed7-86cc8e3653b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:45.917948 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce93c48-93ac-44ba-9ed7-86cc8e3653b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:45.930359 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce93c48-93ac-44ba-9ed7-86cc8e3653b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:01:45.931779 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce93c48-93ac-44ba-9ed7-86cc8e3653b8 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:01:45.940962 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 723/1452] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:01:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:01:48.244261 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdb544-893a-4fae-a3d8-2bf3595671b1 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:48.245141 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdb544-893a-4fae-a3d8-2bf3595671b1 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:48.245141 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdb544-893a-4fae-a3d8-2bf3595671b1 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:48.247440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 19:01:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 19:01:48.253184 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d167c-a23b-4988-81b6-78245a1958b3 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:48.253655 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d167c-a23b-4988-81b6-78245a1958b3 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:48.253760 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d167c-a23b-4988-81b6-78245a1958b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:48.278713 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-833d167c-a23b-4988-81b6-78245a1958b3 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:01:48.279951 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-833d167c-a23b-4988-81b6-78245a1958b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:01:48.289553 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 19:01:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:01:48.326691 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fdb544-893a-4fae-a3d8-2bf3595671b1 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:01:48.341509 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fdb544-893a-4fae-a3d8-2bf3595671b1 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:01:48.348587 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5808bd4a-322c-4665-af4a-2270c7556103 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:01:48.349408 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808bd4a-322c-4665-af4a-2270c7556103 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:48.349707 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808bd4a-322c-4665-af4a-2270c7556103 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:48.349996 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808bd4a-322c-4665-af4a-2270c7556103 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:48.365244 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5808bd4a-322c-4665-af4a-2270c7556103 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:01:48.366706 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5808bd4a-322c-4665-af4a-2270c7556103 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:01:48.382842 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 731/1455] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:01:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:01:50.601367 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae14af4-6598-4acb-af8d-6b82c698ee5a None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:50.601965 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae14af4-6598-4acb-af8d-6b82c698ee5a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:50.601965 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae14af4-6598-4acb-af8d-6b82c698ee5a None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:50.603212 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 19:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:01:50.609717 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baaf907-6ba1-4b63-9280-e8ae43c23240 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:50.610439 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baaf907-6ba1-4b63-9280-e8ae43c23240 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:50.610617 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baaf907-6ba1-4b63-9280-e8ae43c23240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:50.631639 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-4baaf907-6ba1-4b63-9280-e8ae43c23240 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:01:50.632825 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-4baaf907-6ba1-4b63-9280-e8ae43c23240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:01:50.641683 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 19:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:01:50.679503 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae14af4-6598-4acb-af8d-6b82c698ee5a None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:01:50.693040 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae14af4-6598-4acb-af8d-6b82c698ee5a None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:01:50.697219 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a2c96-4aad-4a0e-be81-50b1f31af53c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:01:50.697894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a2c96-4aad-4a0e-be81-50b1f31af53c service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:50.698171 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a2c96-4aad-4a0e-be81-50b1f31af53c service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:50.698441 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a2c96-4aad-4a0e-be81-50b1f31af53c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:50.707391 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a2c96-4aad-4a0e-be81-50b1f31af53c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:01:50.708821 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a2c96-4aad-4a0e-be81-50b1f31af53c service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:01:50.718809 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 726/1458] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:01:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:01:52.977819 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc62dd-76b9-4682-b89a-8fa45300399a None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:52.978740 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc62dd-76b9-4682-b89a-8fa45300399a None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:52.978740 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc62dd-76b9-4682-b89a-8fa45300399a None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:52.980867 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 19:01:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:01:52.989902 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90463877-6f54-4972-8134-85ab0d664d86 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:52.990663 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90463877-6f54-4972-8134-85ab0d664d86 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:52.990937 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90463877-6f54-4972-8134-85ab0d664d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:53.015015 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-90463877-6f54-4972-8134-85ab0d664d86 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:01:53.016192 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-90463877-6f54-4972-8134-85ab0d664d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:01:53.025387 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 19:01:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:01:53.065974 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc62dd-76b9-4682-b89a-8fa45300399a None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:01:53.077632 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc62dd-76b9-4682-b89a-8fa45300399a None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:01:53.081625 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d3246-2462-480c-90ff-f25b6d465dd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:01:53.082254 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d3246-2462-480c-90ff-f25b6d465dd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:53.082526 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d3246-2462-480c-90ff-f25b6d465dd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:53.082793 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d3246-2462-480c-90ff-f25b6d465dd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:53.091887 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d3246-2462-480c-90ff-f25b6d465dd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:01:53.093321 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d3246-2462-480c-90ff-f25b6d465dd3 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:01:53.102529 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 734/1461] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:01:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:01:55.353699 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051d93d-bb1f-4b7f-a770-e82437a44a4b None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:55.354290 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051d93d-bb1f-4b7f-a770-e82437a44a4b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:55.354290 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051d93d-bb1f-4b7f-a770-e82437a44a4b None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:55.355631 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 19:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:01:55.362097 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c93ff-ce4c-4249-ad60-b78f2bd9bb3a None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:55.362868 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c93ff-ce4c-4249-ad60-b78f2bd9bb3a None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:55.363053 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c93ff-ce4c-4249-ad60-b78f2bd9bb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:55.388455 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-605c93ff-ce4c-4249-ad60-b78f2bd9bb3a None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:01:55.389681 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-605c93ff-ce4c-4249-ad60-b78f2bd9bb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:01:55.398548 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 19:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:01:55.436109 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051d93d-bb1f-4b7f-a770-e82437a44a4b None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:01:55.447271 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051d93d-bb1f-4b7f-a770-e82437a44a4b None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:01:55.452215 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb5148-9186-4a27-9844-f045e432842e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:01:55.453157 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb5148-9186-4a27-9844-f045e432842e service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:55.453514 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb5148-9186-4a27-9844-f045e432842e service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:55.453912 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb5148-9186-4a27-9844-f045e432842e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:55.468575 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb5148-9186-4a27-9844-f045e432842e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:01:55.470812 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb5148-9186-4a27-9844-f045e432842e service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:01:55.481816 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 729/1464] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:01:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 19:01:57.666815 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df589e-9a77-45f2-8ec9-7cdf4a1e64b3 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:57.667749 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df589e-9a77-45f2-8ec9-7cdf4a1e64b3 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:57.667749 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df589e-9a77-45f2-8ec9-7cdf4a1e64b3 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:57.670671 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 19:01:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:01:57.678796 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0a84f-8d14-4622-a464-c82b433a4665 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:57.679563 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0a84f-8d14-4622-a464-c82b433a4665 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:57.679713 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0a84f-8d14-4622-a464-c82b433a4665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:57.702771 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-53d0a84f-8d14-4622-a464-c82b433a4665 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:01:57.703966 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-53d0a84f-8d14-4622-a464-c82b433a4665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:01:57.712787 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 19:01:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:01:57.751301 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df589e-9a77-45f2-8ec9-7cdf4a1e64b3 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:01:57.764884 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df589e-9a77-45f2-8ec9-7cdf4a1e64b3 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:01:57.769219 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa3828-3ea9-4be6-9a08-11ed5d12edff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:01:57.769898 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa3828-3ea9-4be6-9a08-11ed5d12edff service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:57.770174 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa3828-3ea9-4be6-9a08-11ed5d12edff service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:57.770442 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa3828-3ea9-4be6-9a08-11ed5d12edff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:57.779711 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aa3828-3ea9-4be6-9a08-11ed5d12edff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:01:57.781517 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aa3828-3ea9-4be6-9a08-11ed5d12edff service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:01:57.790775 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 737/1467] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:01:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:02:00.026228 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84b72e-6750-4aa7-9a57-34c8f60c315c None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:02:00.027082 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84b72e-6750-4aa7-9a57-34c8f60c315c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:02:00.027082 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84b72e-6750-4aa7-9a57-34c8f60c315c None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:02:00.029207 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 19:02:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:02:00.035906 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4297a7-5c2a-4afe-9106-356e57ebf106 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:02:00.036686 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4297a7-5c2a-4afe-9106-356e57ebf106 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:02:00.036856 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4297a7-5c2a-4afe-9106-356e57ebf106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:02:00.057202 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-3e4297a7-5c2a-4afe-9106-356e57ebf106 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:02:00.058416 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-3e4297a7-5c2a-4afe-9106-356e57ebf106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:02:00.066745 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 19:02:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:02:00.106020 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84b72e-6750-4aa7-9a57-34c8f60c315c None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:02:00.120749 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84b72e-6750-4aa7-9a57-34c8f60c315c None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:02:00.124602 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32db661-a7ab-4ccf-bb80-b8cb761ee830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:02:00.125240 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32db661-a7ab-4ccf-bb80-b8cb761ee830 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:02:00.125520 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32db661-a7ab-4ccf-bb80-b8cb761ee830 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:02:00.125827 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32db661-a7ab-4ccf-bb80-b8cb761ee830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:02:00.136254 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32db661-a7ab-4ccf-bb80-b8cb761ee830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:02:00.138534 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32db661-a7ab-4ccf-bb80-b8cb761ee830 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:02:00.151214 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 732/1470] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:02:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:02:32.929492 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8c58c-ec8b-4ed6-aaca-4c4e488e3288 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:02:32.930115 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8c58c-ec8b-4ed6-aaca-4c4e488e3288 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:02:32.930115 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8c58c-ec8b-4ed6-aaca-4c4e488e3288 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:02:32.931464 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 739/1471] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 19:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:02:32.937653 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb66633-cd65-42a2-80b5-2cdf0502eafa None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:02:32.938101 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb66633-cd65-42a2-80b5-2cdf0502eafa None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:02:32.938234 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb66633-cd65-42a2-80b5-2cdf0502eafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:02:32.959015 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-9cb66633-cd65-42a2-80b5-2cdf0502eafa None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:02:32.960194 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9cb66633-cd65-42a2-80b5-2cdf0502eafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:02:32.968492 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 733/1472] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 19:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:02:33.015404 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb28cac-37b4-484c-83dd-bdb79565d07f None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:02:33.015816 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb28cac-37b4-484c-83dd-bdb79565d07f None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:02:33.016309 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb28cac-37b4-484c-83dd-bdb79565d07f None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:02:33.018534 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 740/1473] 10.222.0.24 () {54 vars in 962 bytes} [Mon May 16 19:02:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:02:33.023433 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6823f08-6d36-47c1-be4b-31bdc5994f6e None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:02:33.023717 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6823f08-6d36-47c1-be4b-31bdc5994f6e None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:02:33.023986 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6823f08-6d36-47c1-be4b-31bdc5994f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:02:33.043425 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-c6823f08-6d36-47c1-be4b-31bdc5994f6e None None] MFA Rules not processed for user `5dfa8e8908804c0e8908e2a8c6b377e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:02:33.044604 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c6823f08-6d36-47c1-be4b-31bdc5994f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:02:33.051989 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 734/1474] 10.222.0.24 () {58 vars in 1059 bytes} [Mon May 16 19:02:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:02:33.059375 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb28cac-37b4-484c-83dd-bdb79565d07f None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:02:33.072347 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb28cac-37b4-484c-83dd-bdb79565d07f None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:02:33.076708 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de95857-c7e6-4143-974c-9c1bb6b59d4a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dfa8e8908804c0e8908e2a8c6b377e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:02:33.077341 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de95857-c7e6-4143-974c-9c1bb6b59d4a service glance] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:02:33.077654 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de95857-c7e6-4143-974c-9c1bb6b59d4a service glance] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:02:33.077930 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de95857-c7e6-4143-974c-9c1bb6b59d4a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:02:33.087203 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de95857-c7e6-4143-974c-9c1bb6b59d4a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:02:33.088656 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de95857-c7e6-4143-974c-9c1bb6b59d4a service glance] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:02:33.097890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 741/1475] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:02:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:02:35.399343 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f444ec7-bd82-4bcd-bb49-bd9b69d3e16e None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:02:35.400239 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f444ec7-bd82-4bcd-bb49-bd9b69d3e16e None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:02:35.400239 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f444ec7-bd82-4bcd-bb49-bd9b69d3e16e None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:02:35.402501 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 735/1476] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 19:02:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:02:35.408468 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94c94d-cfe5-404f-9358-5e477720bf34 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:02:35.408918 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94c94d-cfe5-404f-9358-5e477720bf34 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:02:35.409024 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94c94d-cfe5-404f-9358-5e477720bf34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:02:35.428401 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-ef94c94d-cfe5-404f-9358-5e477720bf34 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:02:35.429587 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-ef94c94d-cfe5-404f-9358-5e477720bf34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:02:35.437978 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 742/1477] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 19:02:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:02:35.461193 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f444ec7-bd82-4bcd-bb49-bd9b69d3e16e None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:02:35.475051 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f444ec7-bd82-4bcd-bb49-bd9b69d3e16e None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:02:35.480512 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9cb7a-750b-46ce-8644-1a7fc58b8c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:02:35.481166 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9cb7a-750b-46ce-8644-1a7fc58b8c0e admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:02:35.481448 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9cb7a-750b-46ce-8644-1a7fc58b8c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:02:35.481747 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9cb7a-750b-46ce-8644-1a7fc58b8c0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:02:35.482492 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9cb7a-750b-46ce-8644-1a7fc58b8c0e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:02:35.484235 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: WARNING py.warnings [None req-5ca9cb7a-750b-46ce-8644-1a7fc58b8c0e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 19:02:35.484235 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: warnings.warn(msg) May 16 19:02:35.484235 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: May 16 19:02:35.485408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9cb7a-750b-46ce-8644-1a7fc58b8c0e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:02:35.504689 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 736/1478] 10.222.0.24 () {56 vars in 1108 bytes} [Mon May 16 19:02:35 2022] GET /identity/v3/projects => generated 2553 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:02:37.730361 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07c240-8c61-4d49-baaa-9aeed3167552 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:02:37.730876 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07c240-8c61-4d49-baaa-9aeed3167552 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:02:37.730876 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07c240-8c61-4d49-baaa-9aeed3167552 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:02:37.732302 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 743/1479] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 19:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:02:37.737796 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7803b21-1cb8-47d4-9c21-5d65218421bb None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:02:37.738238 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7803b21-1cb8-47d4-9c21-5d65218421bb None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:02:37.738343 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7803b21-1cb8-47d4-9c21-5d65218421bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:02:37.756905 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-c7803b21-1cb8-47d4-9c21-5d65218421bb None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:02:37.758135 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c7803b21-1cb8-47d4-9c21-5d65218421bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:02:37.766861 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 737/1480] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 19:02:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:02:37.812789 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07c240-8c61-4d49-baaa-9aeed3167552 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:02:37.828776 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07c240-8c61-4d49-baaa-9aeed3167552 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:02:37.835456 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa55c8-ecb7-41ec-8281-bce8489b84cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:02:37.836104 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa55c8-ecb7-41ec-8281-bce8489b84cf service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:02:37.836373 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa55c8-ecb7-41ec-8281-bce8489b84cf service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:02:37.836644 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa55c8-ecb7-41ec-8281-bce8489b84cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:02:37.845458 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa55c8-ecb7-41ec-8281-bce8489b84cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:02:37.847943 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa55c8-ecb7-41ec-8281-bce8489b84cf service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:02:37.863501 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 744/1481] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:02:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:02:40.259708 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef438f8-ab9a-4ed4-954b-246ea19f7881 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:02:40.260309 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef438f8-ab9a-4ed4-954b-246ea19f7881 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:02:40.260309 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef438f8-ab9a-4ed4-954b-246ea19f7881 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:02:40.261707 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 738/1482] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 19:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:02:40.268035 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbade2-417b-4c16-847c-26d6de9a9953 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:02:40.268501 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbade2-417b-4c16-847c-26d6de9a9953 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:02:40.268596 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbade2-417b-4c16-847c-26d6de9a9953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:02:40.293366 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-3fcbade2-417b-4c16-847c-26d6de9a9953 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:02:40.294511 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-3fcbade2-417b-4c16-847c-26d6de9a9953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:02:40.303583 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 745/1483] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 19:02:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:02:40.342729 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef438f8-ab9a-4ed4-954b-246ea19f7881 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:02:40.357729 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef438f8-ab9a-4ed4-954b-246ea19f7881 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:02:40.362506 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645bc5ad-38b2-448e-be80-4d38d689752c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:02:40.363153 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645bc5ad-38b2-448e-be80-4d38d689752c service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:02:40.363429 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645bc5ad-38b2-448e-be80-4d38d689752c service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:02:40.363700 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645bc5ad-38b2-448e-be80-4d38d689752c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:02:40.373962 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645bc5ad-38b2-448e-be80-4d38d689752c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:02:40.375436 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645bc5ad-38b2-448e-be80-4d38d689752c service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:02:40.385369 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 739/1484] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:02:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:02:42.643359 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64130996-cf8c-48fa-b093-6d08f2cf0f2c None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:02:42.644219 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64130996-cf8c-48fa-b093-6d08f2cf0f2c None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:02:42.644219 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64130996-cf8c-48fa-b093-6d08f2cf0f2c None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:02:42.646623 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 746/1485] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 19:02:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:02:42.652800 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501085a9-8563-41be-9fb7-a650fe5703ea None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:02:42.653298 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501085a9-8563-41be-9fb7-a650fe5703ea None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:02:42.653406 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501085a9-8563-41be-9fb7-a650fe5703ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:02:42.674369 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-501085a9-8563-41be-9fb7-a650fe5703ea None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:02:42.675553 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-501085a9-8563-41be-9fb7-a650fe5703ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:02:42.684368 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 740/1486] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 19:02:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:02:42.722049 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64130996-cf8c-48fa-b093-6d08f2cf0f2c None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:02:42.734265 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64130996-cf8c-48fa-b093-6d08f2cf0f2c None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:02:42.738396 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89c4ad-31b1-42e7-9f82-da65a1a137d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:02:42.739030 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89c4ad-31b1-42e7-9f82-da65a1a137d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:02:42.739309 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89c4ad-31b1-42e7-9f82-da65a1a137d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:02:42.739578 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89c4ad-31b1-42e7-9f82-da65a1a137d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:02:42.748999 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c89c4ad-31b1-42e7-9f82-da65a1a137d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:02:42.751320 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c89c4ad-31b1-42e7-9f82-da65a1a137d7 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:02:42.762332 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 747/1487] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:02:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:02:45.086038 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb6daf-1607-4121-ae73-1e61a0108133 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:02:45.086616 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb6daf-1607-4121-ae73-1e61a0108133 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:02:45.086616 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb6daf-1607-4121-ae73-1e61a0108133 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:02:45.087970 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 741/1488] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 19:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:02:45.094340 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eaba36-8853-4142-ae7b-c830c5a5a7c2 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:02:45.095071 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eaba36-8853-4142-ae7b-c830c5a5a7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:02:45.095318 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eaba36-8853-4142-ae7b-c830c5a5a7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:02:45.121268 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-60eaba36-8853-4142-ae7b-c830c5a5a7c2 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:02:45.122505 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-60eaba36-8853-4142-ae7b-c830c5a5a7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:02:45.131614 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 748/1489] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 19:02:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:02:45.172060 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb6daf-1607-4121-ae73-1e61a0108133 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:02:45.183294 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb6daf-1607-4121-ae73-1e61a0108133 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:02:45.187186 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e38985-b5cc-4cc8-9572-fd1cd8bd6de3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:02:45.187833 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e38985-b5cc-4cc8-9572-fd1cd8bd6de3 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:02:45.188093 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e38985-b5cc-4cc8-9572-fd1cd8bd6de3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:02:45.188367 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e38985-b5cc-4cc8-9572-fd1cd8bd6de3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:02:45.197488 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e38985-b5cc-4cc8-9572-fd1cd8bd6de3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:02:45.198951 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e38985-b5cc-4cc8-9572-fd1cd8bd6de3 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:02:45.208350 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 742/1490] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:02:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 19:02:47.607184 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428632e-76c9-4955-8e95-3a2c8c8e3e2c None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:02:47.607755 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428632e-76c9-4955-8e95-3a2c8c8e3e2c None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:02:47.607755 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428632e-76c9-4955-8e95-3a2c8c8e3e2c None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:02:47.609066 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 749/1491] 10.222.0.24 () {54 vars in 926 bytes} [Mon May 16 19:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:02:47.614797 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e38cce-fc13-4f3b-b4ec-1bc06dabb33d None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:02:47.615328 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e38cce-fc13-4f3b-b4ec-1bc06dabb33d None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:02:47.615328 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e38cce-fc13-4f3b-b4ec-1bc06dabb33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:02:47.634292 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-91e38cce-fc13-4f3b-b4ec-1bc06dabb33d None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:02:47.635767 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-91e38cce-fc13-4f3b-b4ec-1bc06dabb33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:02:47.643867 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 743/1492] 10.222.0.24 () {58 vars in 1023 bytes} [Mon May 16 19:02:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:02:47.688319 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428632e-76c9-4955-8e95-3a2c8c8e3e2c None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:02:47.699960 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428632e-76c9-4955-8e95-3a2c8c8e3e2c None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:02:47.703979 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a16ca5a-1b29-45fd-8a92-a5e95430ebae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:02:47.704615 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16ca5a-1b29-45fd-8a92-a5e95430ebae service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:02:47.704890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16ca5a-1b29-45fd-8a92-a5e95430ebae service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:02:47.705156 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16ca5a-1b29-45fd-8a92-a5e95430ebae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:02:47.715083 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a16ca5a-1b29-45fd-8a92-a5e95430ebae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:02:47.716519 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a16ca5a-1b29-45fd-8a92-a5e95430ebae service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:02:47.726236 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 750/1493] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:02:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:04:16.867509 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73778098-3eda-459c-a3a2-75791b1d657b None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:04:16.868153 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73778098-3eda-459c-a3a2-75791b1d657b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:04:16.868153 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73778098-3eda-459c-a3a2-75791b1d657b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:04:16.895042 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-73778098-3eda-459c-a3a2-75791b1d657b None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:04:16.897030 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-73778098-3eda-459c-a3a2-75791b1d657b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:04:16.906323 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 744/1494] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:04:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:04:16.917099 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5550450-c6d1-45fe-b148-0c31628bc09b None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:04:16.917646 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5550450-c6d1-45fe-b148-0c31628bc09b None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:04:16.917749 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5550450-c6d1-45fe-b148-0c31628bc09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:04:16.939710 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-e5550450-c6d1-45fe-b148-0c31628bc09b None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:04:16.940977 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-e5550450-c6d1-45fe-b148-0c31628bc09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:04:16.951764 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 751/1495] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:04:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:04:16.958014 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73778098-3eda-459c-a3a2-75791b1d657b None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:04:16.967967 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73778098-3eda-459c-a3a2-75791b1d657b None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:04:16.973131 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc46f0-263f-4b0b-80f9-305364f30b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:04:16.973795 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc46f0-263f-4b0b-80f9-305364f30b68 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:04:16.974079 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc46f0-263f-4b0b-80f9-305364f30b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:04:16.974342 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc46f0-263f-4b0b-80f9-305364f30b68 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:04:16.975065 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc46f0-263f-4b0b-80f9-305364f30b68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:04:16.975373 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc46f0-263f-4b0b-80f9-305364f30b68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:04:16.976398 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: WARNING py.warnings [None req-b9fc46f0-263f-4b0b-80f9-305364f30b68 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 19:04:16.976398 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: warnings.warn(msg) May 16 19:04:16.976398 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: May 16 19:04:16.977279 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc46f0-263f-4b0b-80f9-305364f30b68 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:04:16.988825 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 745/1496] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:04:16.997028 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5550450-c6d1-45fe-b148-0c31628bc09b None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:04:17.007052 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5550450-c6d1-45fe-b148-0c31628bc09b None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:04:17.012956 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585771a-6bdb-435c-8797-0af436b85349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:04:17.013708 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585771a-6bdb-435c-8797-0af436b85349 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:04:17.013982 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585771a-6bdb-435c-8797-0af436b85349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:04:17.014277 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585771a-6bdb-435c-8797-0af436b85349 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:04:17.014969 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585771a-6bdb-435c-8797-0af436b85349 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:04:17.016754 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: WARNING py.warnings [None req-6585771a-6bdb-435c-8797-0af436b85349 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 19:04:17.016754 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: warnings.warn(msg) May 16 19:04:17.016754 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: May 16 19:04:17.018381 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585771a-6bdb-435c-8797-0af436b85349 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:04:17.062064 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 752/1497] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:04:16 2022] POST /identity/v3/projects => generated 377 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:04:17.066554 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc46f0-263f-4b0b-80f9-305364f30b68 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:04:17.079127 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc46f0-263f-4b0b-80f9-305364f30b68 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:04:17.144652 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7cc71-3aae-4063-98db-5d8e3600e5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:04:17.145236 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7cc71-3aae-4063-98db-5d8e3600e5f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:04:17.145517 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7cc71-3aae-4063-98db-5d8e3600e5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:04:17.145828 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7cc71-3aae-4063-98db-5d8e3600e5f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:04:17.146535 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd7cc71-3aae-4063-98db-5d8e3600e5f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:04:17.147553 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: WARNING py.warnings [None req-bbd7cc71-3aae-4063-98db-5d8e3600e5f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 19:04:17.147553 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: warnings.warn(msg) May 16 19:04:17.147553 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: May 16 19:04:17.148874 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd7cc71-3aae-4063-98db-5d8e3600e5f5 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:04:17.173047 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 746/1498] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:04:17 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:04:17.178448 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585771a-6bdb-435c-8797-0af436b85349 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:04:17.189711 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585771a-6bdb-435c-8797-0af436b85349 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:04:17.195264 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987cc87-8ec6-483e-b78a-4da6b07c9956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:04:17.195970 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987cc87-8ec6-483e-b78a-4da6b07c9956 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:04:17.196245 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987cc87-8ec6-483e-b78a-4da6b07c9956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:04:17.196517 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987cc87-8ec6-483e-b78a-4da6b07c9956 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:04:17.197255 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5987cc87-8ec6-483e-b78a-4da6b07c9956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:04:17.198334 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: WARNING py.warnings [None req-5987cc87-8ec6-483e-b78a-4da6b07c9956 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 19:04:17.198334 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: warnings.warn(msg) May 16 19:04:17.198334 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: May 16 19:04:17.199222 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5987cc87-8ec6-483e-b78a-4da6b07c9956 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:04:17.220537 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 753/1499] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:04:17.225104 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7cc71-3aae-4063-98db-5d8e3600e5f5 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:04:17.235406 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7cc71-3aae-4063-98db-5d8e3600e5f5 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:04:17.240180 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0395df-40d4-4d1a-9b59-f955e8029a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:04:17.240839 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0395df-40d4-4d1a-9b59-f955e8029a58 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:04:17.241117 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0395df-40d4-4d1a-9b59-f955e8029a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:04:17.241387 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0395df-40d4-4d1a-9b59-f955e8029a58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:04:17.242179 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0395df-40d4-4d1a-9b59-f955e8029a58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:04:17.243194 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: WARNING py.warnings [None req-3d0395df-40d4-4d1a-9b59-f955e8029a58 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 19:04:17.243194 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: warnings.warn(msg) May 16 19:04:17.243194 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: May 16 19:04:17.244206 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0395df-40d4-4d1a-9b59-f955e8029a58 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:04:17.257124 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 747/1500] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 19:04:17.261269 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987cc87-8ec6-483e-b78a-4da6b07c9956 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:04:17.271269 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987cc87-8ec6-483e-b78a-4da6b07c9956 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:04:17.276425 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f5eb6-3d4a-4b56-b8dc-91ac5ad54003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:04:17.277306 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f5eb6-3d4a-4b56-b8dc-91ac5ad54003 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:04:17.277606 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f5eb6-3d4a-4b56-b8dc-91ac5ad54003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:04:17.277883 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f5eb6-3d4a-4b56-b8dc-91ac5ad54003 admin admin] PATH_INFO: `/v3/projects/54067f25a0c54f5a8c2896f983e3053b/users/14b6530b136744e881972b3f213953bc/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:04:17.292733 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f5eb6-3d4a-4b56-b8dc-91ac5ad54003 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54067f25a0c54f5a8c2896f983e3053b, user_id=14b6530b136744e881972b3f213953bc, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:04:17.293805 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: WARNING py.warnings [None req-b81f5eb6-3d4a-4b56-b8dc-91ac5ad54003 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 19:04:17.293805 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: warnings.warn(msg) May 16 19:04:17.293805 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: May 16 19:04:17.295770 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f5eb6-3d4a-4b56-b8dc-91ac5ad54003 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:04:17.310916 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 754/1501] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:04:17 2022] PUT /identity/v3/projects/54067f25a0c54f5a8c2896f983e3053b/users/14b6530b136744e881972b3f213953bc/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:04:17.322574 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc422b-24b4-4ba7-a318-f58ec778179a None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:04:17.322887 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc422b-24b4-4ba7-a318-f58ec778179a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:04:17.323200 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc422b-24b4-4ba7-a318-f58ec778179a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:04:17.350046 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-49cc422b-24b4-4ba7-a318-f58ec778179a None None] MFA Rules not processed for user `14b6530b136744e881972b3f213953bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:04:17.351284 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-49cc422b-24b4-4ba7-a318-f58ec778179a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:04:17.421939 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 748/1502] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:04:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:04:17.438467 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce974150-e487-45cc-a80a-144388514477 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:04:17.438844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce974150-e487-45cc-a80a-144388514477 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:04:17.439289 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce974150-e487-45cc-a80a-144388514477 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:04:17.441445 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 755/1503] 10.222.0.24 () {54 vars in 963 bytes} [Mon May 16 19:04:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:04:17.448407 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a842b-27a5-43c1-a60a-a1abad06b738 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:04:17.448741 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a842b-27a5-43c1-a60a-a1abad06b738 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:04:17.449033 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a842b-27a5-43c1-a60a-a1abad06b738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:04:17.470426 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-3a2a842b-27a5-43c1-a60a-a1abad06b738 None None] MFA Rules not processed for user `36439df302854b158c85f4fbb5bcb7d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:04:17.471670 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3a2a842b-27a5-43c1-a60a-a1abad06b738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:04:17.527674 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 749/1504] 10.222.0.24 () {58 vars in 1060 bytes} [Mon May 16 19:04:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:04:17.535814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce974150-e487-45cc-a80a-144388514477 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:04:17.547517 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce974150-e487-45cc-a80a-144388514477 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:04:17.551445 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3241df-5dcc-401a-8509-1847169ebb65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:04:17.552087 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3241df-5dcc-401a-8509-1847169ebb65 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:04:17.552374 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3241df-5dcc-401a-8509-1847169ebb65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:04:17.552645 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3241df-5dcc-401a-8509-1847169ebb65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:04:17.562086 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3241df-5dcc-401a-8509-1847169ebb65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:04:17.563544 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3241df-5dcc-401a-8509-1847169ebb65 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:04:17.572562 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 756/1505] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:04:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:04:17.615080 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f9e5d-0266-48c9-b69f-1f70bcddec03 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:04:17.615363 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f9e5d-0266-48c9-b69f-1f70bcddec03 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:04:17.615642 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f9e5d-0266-48c9-b69f-1f70bcddec03 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:04:17.616975 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 750/1506] 10.222.0.24 () {52 vars in 829 bytes} [Mon May 16 19:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:04:17.621568 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3241df-5dcc-401a-8509-1847169ebb65 service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:04:17.695655 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3241df-5dcc-401a-8509-1847169ebb65 service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:04:17.701638 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7b71c-0874-4eeb-a80a-6262147dfcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:04:17.702520 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7b71c-0874-4eeb-a80a-6262147dfcd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:04:17.702803 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7b71c-0874-4eeb-a80a-6262147dfcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:04:17.703072 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7b71c-0874-4eeb-a80a-6262147dfcd5 admin admin] PATH_INFO: `/v3/users/14b6530b136744e881972b3f213953bc` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:04:17.704367 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b7b71c-0874-4eeb-a80a-6262147dfcd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14b6530b136744e881972b3f213953bc)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:04:17.705408 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: WARNING py.warnings [None req-00b7b71c-0874-4eeb-a80a-6262147dfcd5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 19:04:17.705408 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: warnings.warn(msg) May 16 19:04:17.705408 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: May 16 19:04:17.706646 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b7b71c-0874-4eeb-a80a-6262147dfcd5 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:04:17.780077 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-00b7b71c-0874-4eeb-a80a-6262147dfcd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14b6530b136744e881972b3f213953bc'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:04:17.790936 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-00b7b71c-0874-4eeb-a80a-6262147dfcd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14b6530b136744e881972b3f213953bc'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:04:17.803105 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-00b7b71c-0874-4eeb-a80a-6262147dfcd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14b6530b136744e881972b3f213953bc'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:04:17.803758 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-00b7b71c-0874-4eeb-a80a-6262147dfcd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14b6530b136744e881972b3f213953bc'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:04:17.822154 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-00b7b71c-0874-4eeb-a80a-6262147dfcd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14b6530b136744e881972b3f213953bc'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:04:17.828314 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 757/1507] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:04:17 2022] DELETE /identity/v3/users/14b6530b136744e881972b3f213953bc => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:04:17.833559 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbe6ef-4d00-4536-9c21-a40908c0c181 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:04:17.833901 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbe6ef-4d00-4536-9c21-a40908c0c181 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:04:17.834262 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbe6ef-4d00-4536-9c21-a40908c0c181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:04:17.853193 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-22fbe6ef-4d00-4536-9c21-a40908c0c181 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:04:17.854441 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-22fbe6ef-4d00-4536-9c21-a40908c0c181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:04:17.919892 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 751/1508] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:04:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:04:17.930219 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7b71c-0874-4eeb-a80a-6262147dfcd5 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:04:17.931779 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-00b7b71c-0874-4eeb-a80a-6262147dfcd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:04:17.986277 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7b71c-0874-4eeb-a80a-6262147dfcd5 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:04:17.990372 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ab7a6-beb9-482f-a5e2-311146742b3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:04:17.991006 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ab7a6-beb9-482f-a5e2-311146742b3d service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:04:17.991284 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ab7a6-beb9-482f-a5e2-311146742b3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:04:17.991545 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ab7a6-beb9-482f-a5e2-311146742b3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:04:18.000438 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ab7a6-beb9-482f-a5e2-311146742b3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:04:18.001914 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ab7a6-beb9-482f-a5e2-311146742b3d service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:04:18.012915 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 758/1509] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:04:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:04:18.341573 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbe6ef-4d00-4536-9c21-a40908c0c181 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:04:18.342980 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-22fbe6ef-4d00-4536-9c21-a40908c0c181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:04:18.354605 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbe6ef-4d00-4536-9c21-a40908c0c181 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:04:18.360293 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56eb111-cb77-4b39-a5ee-51ba2da14d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:04:18.361163 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56eb111-cb77-4b39-a5ee-51ba2da14d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:04:18.361436 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56eb111-cb77-4b39-a5ee-51ba2da14d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:04:18.361736 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56eb111-cb77-4b39-a5ee-51ba2da14d64 admin admin] PATH_INFO: `/v3/projects/54067f25a0c54f5a8c2896f983e3053b` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:04:18.362993 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56eb111-cb77-4b39-a5ee-51ba2da14d64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54067f25a0c54f5a8c2896f983e3053b)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:04:18.364023 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: WARNING py.warnings [None req-b56eb111-cb77-4b39-a5ee-51ba2da14d64 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 19:04:18.364023 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: warnings.warn(msg) May 16 19:04:18.364023 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: May 16 19:04:18.365215 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56eb111-cb77-4b39-a5ee-51ba2da14d64 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:04:18.425902 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b56eb111-cb77-4b39-a5ee-51ba2da14d64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54067f25a0c54f5a8c2896f983e3053b', 'request_id': 'req-b56eb111-cb77-4b39-a5ee-51ba2da14d64'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:04:18.438236 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b56eb111-cb77-4b39-a5ee-51ba2da14d64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54067f25a0c54f5a8c2896f983e3053b', 'request_id': 'req-b56eb111-cb77-4b39-a5ee-51ba2da14d64'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:04:18.446467 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b56eb111-cb77-4b39-a5ee-51ba2da14d64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54067f25a0c54f5a8c2896f983e3053b', 'request_id': 'req-b56eb111-cb77-4b39-a5ee-51ba2da14d64'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:04:18.468154 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b56eb111-cb77-4b39-a5ee-51ba2da14d64 admin admin] The token cache is being invalidate because project 54067f25a0c54f5a8c2896f983e3053b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:04:18.468456 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b56eb111-cb77-4b39-a5ee-51ba2da14d64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:04:18.469337 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b56eb111-cb77-4b39-a5ee-51ba2da14d64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:04:18.471138 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 752/1510] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:04:18 2022] DELETE /identity/v3/projects/54067f25a0c54f5a8c2896f983e3053b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:05:58.483145 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc44c32-f7dc-4831-b6c2-b7a89f13eefc None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:05:58.483708 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc44c32-f7dc-4831-b6c2-b7a89f13eefc None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:05:58.483708 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc44c32-f7dc-4831-b6c2-b7a89f13eefc None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:05:58.485837 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 19:05:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:05:58.491378 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce88b5-26a4-4ff1-ab4c-08d17c94b19f None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:05:58.491785 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce88b5-26a4-4ff1-ab4c-08d17c94b19f None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:05:58.491932 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce88b5-26a4-4ff1-ab4c-08d17c94b19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:05:58.512376 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-99ce88b5-26a4-4ff1-ab4c-08d17c94b19f None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:05:58.513625 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-99ce88b5-26a4-4ff1-ab4c-08d17c94b19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:05:58.579429 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 19:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:05:58.749981 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc44c32-f7dc-4831-b6c2-b7a89f13eefc None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:05:58.752635 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-3fc44c32-f7dc-4831-b6c2-b7a89f13eefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:05:58.831086 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc44c32-f7dc-4831-b6c2-b7a89f13eefc None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:05:58.838133 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc1a95-383c-4df6-918d-9bb79275b59c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:05:58.839058 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc1a95-383c-4df6-918d-9bb79275b59c service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:05:58.839414 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc1a95-383c-4df6-918d-9bb79275b59c service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:05:58.839785 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc1a95-383c-4df6-918d-9bb79275b59c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:05:58.850704 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc1a95-383c-4df6-918d-9bb79275b59c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:05:58.852324 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc1a95-383c-4df6-918d-9bb79275b59c service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:05:58.862065 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 760/1513] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:05:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:05:59.171343 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e66488-51d1-4af9-9460-3b4a892c681c None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:05:59.171628 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e66488-51d1-4af9-9460-3b4a892c681c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:05:59.171900 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e66488-51d1-4af9-9460-3b4a892c681c None None] PATH_INFO: `/v3` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:05:59.173257 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 754/1514] 10.222.0.49 () {54 vars in 925 bytes} [Mon May 16 19:05:59 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:05:59.180078 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d1dbc-ce94-462a-9741-ecd53d785f68 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:05:59.180341 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d1dbc-ce94-462a-9741-ecd53d785f68 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:05:59.180665 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d1dbc-ce94-462a-9741-ecd53d785f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:05:59.199988 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-e28d1dbc-ce94-462a-9741-ecd53d785f68 None None] MFA Rules not processed for user `629742b135b2447898e8291d9a360295`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:05:59.201208 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-e28d1dbc-ce94-462a-9741-ecd53d785f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:05:59.264484 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 761/1515] 10.222.0.49 () {58 vars in 1015 bytes} [Mon May 16 19:05:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:05:59.774998 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8dd7d7-6b10-406d-ac8d-479e21e17316 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:05:59.775899 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8dd7d7-6b10-406d-ac8d-479e21e17316 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:05:59.775899 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8dd7d7-6b10-406d-ac8d-479e21e17316 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:05:59.778147 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 755/1516] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 19:05:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:05:59.784420 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2392f0d-b842-42d6-9a16-3d70e504a9ee None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:05:59.785134 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2392f0d-b842-42d6-9a16-3d70e504a9ee None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:05:59.785332 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2392f0d-b842-42d6-9a16-3d70e504a9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:05:59.809367 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-e2392f0d-b842-42d6-9a16-3d70e504a9ee None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:05:59.810595 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-e2392f0d-b842-42d6-9a16-3d70e504a9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:05:59.819679 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 762/1517] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 19:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:05:59.970402 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8dd7d7-6b10-406d-ac8d-479e21e17316 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:05:59.986039 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8dd7d7-6b10-406d-ac8d-479e21e17316 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:05:59.991957 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780992b6-f716-465a-898d-edafdd753898 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:05:59.992599 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780992b6-f716-465a-898d-edafdd753898 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:05:59.992884 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780992b6-f716-465a-898d-edafdd753898 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:05:59.993158 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780992b6-f716-465a-898d-edafdd753898 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:06:00.001707 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780992b6-f716-465a-898d-edafdd753898 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:06:00.003379 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780992b6-f716-465a-898d-edafdd753898 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:06:00.012768 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 756/1518] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:05:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:06:03.148136 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dd925-229a-4647-9b1d-fb9181280001 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:06:03.148711 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dd925-229a-4647-9b1d-fb9181280001 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:06:03.148711 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dd925-229a-4647-9b1d-fb9181280001 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:06:03.150218 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 763/1519] 10.222.0.24 () {54 vars in 960 bytes} [Mon May 16 19:06:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:06:03.155575 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081622f6-d2d8-427c-a78c-62a6cff933d1 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:06:03.156025 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081622f6-d2d8-427c-a78c-62a6cff933d1 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:06:03.156129 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081622f6-d2d8-427c-a78c-62a6cff933d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:06:03.176860 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-081622f6-d2d8-427c-a78c-62a6cff933d1 None None] MFA Rules not processed for user `629742b135b2447898e8291d9a360295`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:06:03.179365 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-081622f6-d2d8-427c-a78c-62a6cff933d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:06:03.188913 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 757/1520] 10.222.0.24 () {58 vars in 1057 bytes} [Mon May 16 19:06:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:06:03.196780 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6dd925-229a-4647-9b1d-fb9181280001 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:06:03.210755 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6dd925-229a-4647-9b1d-fb9181280001 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:06:03.216008 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311ce36-57c3-4496-a0c4-6873f09382a5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '629742b135b2447898e8291d9a360295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:06:03.216642 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311ce36-57c3-4496-a0c4-6873f09382a5 service placement] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:06:03.216918 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311ce36-57c3-4496-a0c4-6873f09382a5 service placement] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:06:03.217183 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311ce36-57c3-4496-a0c4-6873f09382a5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:06:03.225457 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311ce36-57c3-4496-a0c4-6873f09382a5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:06:03.227098 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311ce36-57c3-4496-a0c4-6873f09382a5 service placement] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:06:03.236244 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 764/1521] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:06:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:06:11.357382 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc654dcb-00fa-4ee2-9996-9a4bbac643f6 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:06:11.358275 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc654dcb-00fa-4ee2-9996-9a4bbac643f6 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:06:11.358275 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc654dcb-00fa-4ee2-9996-9a4bbac643f6 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:06:11.360420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 19:06:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:06:11.367830 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fbb653-850a-4b91-9d29-0fa12c85900c None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:06:11.368284 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fbb653-850a-4b91-9d29-0fa12c85900c None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:06:11.368399 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fbb653-850a-4b91-9d29-0fa12c85900c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:06:11.386827 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-a4fbb653-850a-4b91-9d29-0fa12c85900c None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:06:11.388021 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a4fbb653-850a-4b91-9d29-0fa12c85900c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:06:11.396486 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 19:06:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:06:11.550412 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc654dcb-00fa-4ee2-9996-9a4bbac643f6 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:06:11.566405 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc654dcb-00fa-4ee2-9996-9a4bbac643f6 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:06:11.572738 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70927c04-0a6d-496e-a817-dc00cf2e9f60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:06:11.573382 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70927c04-0a6d-496e-a817-dc00cf2e9f60 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:06:11.573697 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70927c04-0a6d-496e-a817-dc00cf2e9f60 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:06:11.573972 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70927c04-0a6d-496e-a817-dc00cf2e9f60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:06:11.582634 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70927c04-0a6d-496e-a817-dc00cf2e9f60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:06:11.584232 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70927c04-0a6d-496e-a817-dc00cf2e9f60 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:06:11.594171 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 759/1524] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:06:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:06:12.476859 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4ca0d-ba0d-4aef-87f9-19dbdc58f29b None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:06:12.477414 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4ca0d-ba0d-4aef-87f9-19dbdc58f29b None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:06:12.477709 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4ca0d-ba0d-4aef-87f9-19dbdc58f29b None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:06:12.479090 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 19:06:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:06:12.486888 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347c6fb-de46-44af-b6e1-60dfc2fd46da None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:06:12.487313 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347c6fb-de46-44af-b6e1-60dfc2fd46da None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:06:12.487454 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347c6fb-de46-44af-b6e1-60dfc2fd46da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:06:12.513710 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-0347c6fb-de46-44af-b6e1-60dfc2fd46da None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:06:12.514936 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0347c6fb-de46-44af-b6e1-60dfc2fd46da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:06:12.523754 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 19:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:06:12.676885 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4ca0d-ba0d-4aef-87f9-19dbdc58f29b None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:06:12.693401 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4ca0d-ba0d-4aef-87f9-19dbdc58f29b None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:06:12.699812 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64c308-c21d-4e1f-b8c0-4c5207f4da21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:06:12.700458 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64c308-c21d-4e1f-b8c0-4c5207f4da21 service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:06:12.700737 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64c308-c21d-4e1f-b8c0-4c5207f4da21 service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:06:12.701007 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64c308-c21d-4e1f-b8c0-4c5207f4da21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:06:12.709627 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64c308-c21d-4e1f-b8c0-4c5207f4da21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:06:12.711341 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64c308-c21d-4e1f-b8c0-4c5207f4da21 service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:06:12.721037 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 767/1527] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:06:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:06:17.142644 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8055a-893e-4715-adea-54acd57eb8b4 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:06:17.143506 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8055a-893e-4715-adea-54acd57eb8b4 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:06:17.143506 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8055a-893e-4715-adea-54acd57eb8b4 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:06:17.145507 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 19:06:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:06:17.150980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24f5c6-4b9e-4634-9345-5d88fd658c77 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:06:17.151409 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24f5c6-4b9e-4634-9345-5d88fd658c77 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:06:17.151528 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24f5c6-4b9e-4634-9345-5d88fd658c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:06:17.170416 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-7c24f5c6-4b9e-4634-9345-5d88fd658c77 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:06:17.171618 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-7c24f5c6-4b9e-4634-9345-5d88fd658c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:06:17.179824 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 19:06:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:06:17.217690 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8055a-893e-4715-adea-54acd57eb8b4 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:06:17.219485 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-83b8055a-893e-4715-adea-54acd57eb8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:06:17.281031 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8055a-893e-4715-adea-54acd57eb8b4 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:06:17.285010 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a6c52-da95-4849-9d9c-c74a91965042 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:06:17.285674 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a6c52-da95-4849-9d9c-c74a91965042 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:06:17.285948 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a6c52-da95-4849-9d9c-c74a91965042 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:06:17.286219 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a6c52-da95-4849-9d9c-c74a91965042 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:06:17.295037 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a6c52-da95-4849-9d9c-c74a91965042 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:06:17.296477 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a6c52-da95-4849-9d9c-c74a91965042 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:06:17.305932 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 762/1530] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:06:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:06:19.519783 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aadee01-a4c7-4667-9f7d-3bbe957ccef4 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:06:19.520321 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aadee01-a4c7-4667-9f7d-3bbe957ccef4 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:06:19.520321 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aadee01-a4c7-4667-9f7d-3bbe957ccef4 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:06:19.522343 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 19:06:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:06:19.529180 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c978d-4117-45d4-8b6a-be4c44b9cfc3 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:06:19.529673 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c978d-4117-45d4-8b6a-be4c44b9cfc3 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:06:19.529788 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c978d-4117-45d4-8b6a-be4c44b9cfc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:06:19.552212 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-de8c978d-4117-45d4-8b6a-be4c44b9cfc3 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:06:19.554108 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-de8c978d-4117-45d4-8b6a-be4c44b9cfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:06:19.564193 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 19:06:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:06:19.606155 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aadee01-a4c7-4667-9f7d-3bbe957ccef4 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:06:19.619005 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aadee01-a4c7-4667-9f7d-3bbe957ccef4 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:06:19.623916 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4006efe-de0c-4b4e-bec7-603925759db0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:06:19.624559 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4006efe-de0c-4b4e-bec7-603925759db0 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:06:19.624837 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4006efe-de0c-4b4e-bec7-603925759db0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:06:19.625109 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4006efe-de0c-4b4e-bec7-603925759db0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:06:19.634531 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4006efe-de0c-4b4e-bec7-603925759db0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:06:19.635980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4006efe-de0c-4b4e-bec7-603925759db0 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:06:19.645796 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 770/1533] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:06:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:06:23.379298 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744bd10-07f0-4687-a3a4-28d3f35bfd09 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:06:23.380253 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744bd10-07f0-4687-a3a4-28d3f35bfd09 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:06:23.380253 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744bd10-07f0-4687-a3a4-28d3f35bfd09 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:06:23.382347 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 19:06:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:06:23.391064 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b813c5-1019-4ffc-b513-6ff2a76d6fde None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:06:23.391513 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b813c5-1019-4ffc-b513-6ff2a76d6fde None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:06:23.391644 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b813c5-1019-4ffc-b513-6ff2a76d6fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:06:23.414163 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-49b813c5-1019-4ffc-b513-6ff2a76d6fde None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:06:23.415289 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-49b813c5-1019-4ffc-b513-6ff2a76d6fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:06:23.424459 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 19:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:06:23.695700 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744bd10-07f0-4687-a3a4-28d3f35bfd09 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:06:23.697768 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2744bd10-07f0-4687-a3a4-28d3f35bfd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:06:23.754666 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744bd10-07f0-4687-a3a4-28d3f35bfd09 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:06:23.758904 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b83db0-2c30-410a-a2c9-9c3811d11af7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:06:23.759693 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b83db0-2c30-410a-a2c9-9c3811d11af7 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:06:23.759969 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b83db0-2c30-410a-a2c9-9c3811d11af7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:06:23.760238 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b83db0-2c30-410a-a2c9-9c3811d11af7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:06:23.770049 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b83db0-2c30-410a-a2c9-9c3811d11af7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:06:23.771466 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b83db0-2c30-410a-a2c9-9c3811d11af7 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:06:23.781349 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 765/1536] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:06:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:06:26.066702 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cfc24-e3d0-4562-a7c6-a1ac272ce26d None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:06:26.067307 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cfc24-e3d0-4562-a7c6-a1ac272ce26d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:06:26.067307 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cfc24-e3d0-4562-a7c6-a1ac272ce26d None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:06:26.068624 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 19:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:06:26.074534 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34c363-8c81-4ddf-b1d3-4237f74c5c74 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:06:26.075001 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34c363-8c81-4ddf-b1d3-4237f74c5c74 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:06:26.075001 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34c363-8c81-4ddf-b1d3-4237f74c5c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:06:26.095646 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-4e34c363-8c81-4ddf-b1d3-4237f74c5c74 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:06:26.096848 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4e34c363-8c81-4ddf-b1d3-4237f74c5c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:06:26.106045 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 19:06:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:06:26.377676 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8cfc24-e3d0-4562-a7c6-a1ac272ce26d None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:06:26.380838 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-0d8cfc24-e3d0-4562-a7c6-a1ac272ce26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:06:26.402209 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8cfc24-e3d0-4562-a7c6-a1ac272ce26d None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:06:26.406257 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe0e56-2248-461d-a31c-29ae9f50377f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:06:26.407260 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe0e56-2248-461d-a31c-29ae9f50377f service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:06:26.407532 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe0e56-2248-461d-a31c-29ae9f50377f service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:06:26.407796 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe0e56-2248-461d-a31c-29ae9f50377f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:06:26.417165 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe0e56-2248-461d-a31c-29ae9f50377f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:06:26.418617 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe0e56-2248-461d-a31c-29ae9f50377f service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:06:26.427779 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 773/1539] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:06:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:07:57.340531 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e2e13-214e-4ee6-9f15-87708af87c96 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:57.341183 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e2e13-214e-4ee6-9f15-87708af87c96 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:57.341183 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e2e13-214e-4ee6-9f15-87708af87c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:57.370205 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-393e2e13-214e-4ee6-9f15-87708af87c96 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:07:57.371414 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-393e2e13-214e-4ee6-9f15-87708af87c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:07:57.380128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 767/1540] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:07:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:07:57.390312 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84738a9c-4bde-4036-a1b7-4602cb966176 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:57.391317 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84738a9c-4bde-4036-a1b7-4602cb966176 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:57.391805 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84738a9c-4bde-4036-a1b7-4602cb966176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:57.423492 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-84738a9c-4bde-4036-a1b7-4602cb966176 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:07:57.425100 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-84738a9c-4bde-4036-a1b7-4602cb966176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:07:57.441652 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 774/1541] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:07:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:07:57.446916 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e2e13-214e-4ee6-9f15-87708af87c96 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:57.460040 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e2e13-214e-4ee6-9f15-87708af87c96 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:57.468908 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62624ade-fd2f-42c3-b66f-26e632adff93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:57.469621 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62624ade-fd2f-42c3-b66f-26e632adff93 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:57.469907 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62624ade-fd2f-42c3-b66f-26e632adff93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:57.470189 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62624ade-fd2f-42c3-b66f-26e632adff93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:57.471091 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62624ade-fd2f-42c3-b66f-26e632adff93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:07:57.471406 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62624ade-fd2f-42c3-b66f-26e632adff93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:57.473044 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62624ade-fd2f-42c3-b66f-26e632adff93 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:57.490101 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 768/1542] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:07:57.498808 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84738a9c-4bde-4036-a1b7-4602cb966176 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:57.518258 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84738a9c-4bde-4036-a1b7-4602cb966176 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:57.523381 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da768558-f64f-4688-a15d-efd6080c7c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:57.524300 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da768558-f64f-4688-a15d-efd6080c7c32 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:57.524797 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da768558-f64f-4688-a15d-efd6080c7c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:57.525275 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da768558-f64f-4688-a15d-efd6080c7c32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:57.526207 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da768558-f64f-4688-a15d-efd6080c7c32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:57.528343 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da768558-f64f-4688-a15d-efd6080c7c32 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:57.576970 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 775/1543] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:07:57 2022] POST /identity/v3/projects => generated 389 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:07:57.581517 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62624ade-fd2f-42c3-b66f-26e632adff93 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:57.594927 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62624ade-fd2f-42c3-b66f-26e632adff93 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:57.694379 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec5e62-3c27-442e-8d5e-db73977b00ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:57.695002 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec5e62-3c27-442e-8d5e-db73977b00ad admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:57.695282 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec5e62-3c27-442e-8d5e-db73977b00ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:57.695556 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec5e62-3c27-442e-8d5e-db73977b00ad admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:57.696267 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec5e62-3c27-442e-8d5e-db73977b00ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:57.698268 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec5e62-3c27-442e-8d5e-db73977b00ad admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:57.731958 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95f2a3-26af-465d-8667-fa622d804ac1 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:57.732623 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95f2a3-26af-465d-8667-fa622d804ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:57.733222 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95f2a3-26af-465d-8667-fa622d804ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:57.744034 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 769/1544] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:07:57 2022] POST /identity/v3/users => generated 295 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:07:57.754267 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec5e62-3c27-442e-8d5e-db73977b00ad admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:57.766342 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-5a95f2a3-26af-465d-8667-fa622d804ac1 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:07:57.767963 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-5a95f2a3-26af-465d-8667-fa622d804ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:07:57.768322 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec5e62-3c27-442e-8d5e-db73977b00ad admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:57.778556 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ea26a-a457-4e75-867f-da3a8ae51363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:57.779391 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ea26a-a457-4e75-867f-da3a8ae51363 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:57.779684 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ea26a-a457-4e75-867f-da3a8ae51363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:57.780360 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ea26a-a457-4e75-867f-da3a8ae51363 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:57.781113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32ea26a-a457-4e75-867f-da3a8ae51363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:57.782948 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32ea26a-a457-4e75-867f-da3a8ae51363 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:57.784504 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 776/1545] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:07:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:07:57.794777 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd606e3a-ad67-4950-b25e-716f3e2a57a6 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:57.795540 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd606e3a-ad67-4950-b25e-716f3e2a57a6 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:57.796043 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd606e3a-ad67-4950-b25e-716f3e2a57a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:57.799098 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 770/1546] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 19:07:57.800427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3c20d-f609-4884-8d23-d4e8f0552552 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:57.800714 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3c20d-f609-4884-8d23-d4e8f0552552 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:57.800989 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3c20d-f609-4884-8d23-d4e8f0552552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:57.837901 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-fd606e3a-ad67-4950-b25e-716f3e2a57a6 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:07:57.839337 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-fd606e3a-ad67-4950-b25e-716f3e2a57a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:07:57.846698 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-91d3c20d-f609-4884-8d23-d4e8f0552552 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:07:57.847925 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-91d3c20d-f609-4884-8d23-d4e8f0552552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:07:57.860705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 777/1547] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:07:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:07:57.862411 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd606e3a-ad67-4950-b25e-716f3e2a57a6 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:57.876978 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 771/1548] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:07:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:07:57.878049 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3c20d-f609-4884-8d23-d4e8f0552552 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:57.889556 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd606e3a-ad67-4950-b25e-716f3e2a57a6 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:57.896922 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3c20d-f609-4884-8d23-d4e8f0552552 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:57.900201 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04276fe-e6ef-448b-82de-ce2e3a8ec7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:57.900908 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04276fe-e6ef-448b-82de-ce2e3a8ec7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:57.901189 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04276fe-e6ef-448b-82de-ce2e3a8ec7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:57.901463 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04276fe-e6ef-448b-82de-ce2e3a8ec7e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:57.902237 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04276fe-e6ef-448b-82de-ce2e3a8ec7e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:57.904786 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04276fe-e6ef-448b-82de-ce2e3a8ec7e6 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:57.922956 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663efd6-f4ce-4f52-a9c6-55f4870a6b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:57.923655 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663efd6-f4ce-4f52-a9c6-55f4870a6b64 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:57.923933 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663efd6-f4ce-4f52-a9c6-55f4870a6b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:57.924328 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663efd6-f4ce-4f52-a9c6-55f4870a6b64 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:57.925076 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e663efd6-f4ce-4f52-a9c6-55f4870a6b64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:07:57.925396 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e663efd6-f4ce-4f52-a9c6-55f4870a6b64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:57.927056 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e663efd6-f4ce-4f52-a9c6-55f4870a6b64 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:57.937377 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 778/1549] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:07:57.938902 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416913c-f54e-4828-b1d1-b23a08ed7b5e None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:57.939195 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416913c-f54e-4828-b1d1-b23a08ed7b5e None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:57.939472 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416913c-f54e-4828-b1d1-b23a08ed7b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:57.951099 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 772/1550] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:07:57.952390 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017bb80-9178-4fb2-9ee1-3583fb268284 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:57.952675 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017bb80-9178-4fb2-9ee1-3583fb268284 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:57.952954 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017bb80-9178-4fb2-9ee1-3583fb268284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:57.989655 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-0416913c-f54e-4828-b1d1-b23a08ed7b5e None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:07:57.990871 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-0416913c-f54e-4828-b1d1-b23a08ed7b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:07:57.998864 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-5017bb80-9178-4fb2-9ee1-3583fb268284 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:07:58.009982 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5017bb80-9178-4fb2-9ee1-3583fb268284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:07:58.019312 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 779/1551] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:07:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:07:58.020256 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416913c-f54e-4828-b1d1-b23a08ed7b5e None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:58.034140 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416913c-f54e-4828-b1d1-b23a08ed7b5e None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:58.034837 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 773/1552] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:07:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:07:58.035905 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017bb80-9178-4fb2-9ee1-3583fb268284 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:58.045922 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288712f-a8fd-4915-941f-48adebf1d8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:58.046847 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288712f-a8fd-4915-941f-48adebf1d8d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:58.047127 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288712f-a8fd-4915-941f-48adebf1d8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:58.047398 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288712f-a8fd-4915-941f-48adebf1d8d9 admin admin] PATH_INFO: `/v3/projects/70432660a05b4b169939f7048c545bfc/users/661228875e4d4c60a558656b46ea650b/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:58.047976 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017bb80-9178-4fb2-9ee1-3583fb268284 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:58.055446 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b0bf2-bad3-411f-baf1-6f6153d0acf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:58.055446 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b0bf2-bad3-411f-baf1-6f6153d0acf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:58.055446 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b0bf2-bad3-411f-baf1-6f6153d0acf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:58.055446 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b0bf2-bad3-411f-baf1-6f6153d0acf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:58.056297 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b0bf2-bad3-411f-baf1-6f6153d0acf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:58.056823 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: WARNING py.warnings [None req-d58b0bf2-bad3-411f-baf1-6f6153d0acf7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 19:07:58.056823 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: warnings.warn(msg) May 16 19:07:58.056823 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: May 16 19:07:58.058158 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b0bf2-bad3-411f-baf1-6f6153d0acf7 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:58.066488 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288712f-a8fd-4915-941f-48adebf1d8d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70432660a05b4b169939f7048c545bfc, user_id=661228875e4d4c60a558656b46ea650b, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:58.069479 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288712f-a8fd-4915-941f-48adebf1d8d9 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:58.087940 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 780/1553] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:07:58 2022] PUT /identity/v3/projects/70432660a05b4b169939f7048c545bfc/users/661228875e4d4c60a558656b46ea650b/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:07:58.088638 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 774/1554] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:07:58 2022] POST /identity/v3/projects => generated 391 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:07:58.089292 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e5cd7-fb96-41e3-b867-4a9a0b55e490 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:58.089771 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e5cd7-fb96-41e3-b867-4a9a0b55e490 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:58.090050 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e5cd7-fb96-41e3-b867-4a9a0b55e490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:58.090226 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6870a16-83c0-4120-8bb7-8c750ccad891 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:58.090460 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6870a16-83c0-4120-8bb7-8c750ccad891 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:58.090742 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6870a16-83c0-4120-8bb7-8c750ccad891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:58.110670 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-a6870a16-83c0-4120-8bb7-8c750ccad891 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:07:58.111226 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-353e5cd7-fb96-41e3-b867-4a9a0b55e490 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:07:58.112052 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a6870a16-83c0-4120-8bb7-8c750ccad891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:07:58.112393 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-353e5cd7-fb96-41e3-b867-4a9a0b55e490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:07:58.183423 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 781/1555] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:07:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:07:58.189006 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edbdd5-b06e-4bb1-9b80-3f39d5619566 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:58.189006 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edbdd5-b06e-4bb1-9b80-3f39d5619566 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:58.189006 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edbdd5-b06e-4bb1-9b80-3f39d5619566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:58.193011 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 775/1556] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:07:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:07:58.193994 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6870a16-83c0-4120-8bb7-8c750ccad891 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:58.203708 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6870a16-83c0-4120-8bb7-8c750ccad891 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:58.206395 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-e1edbdd5-b06e-4bb1-9b80-3f39d5619566 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:07:58.207599 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-e1edbdd5-b06e-4bb1-9b80-3f39d5619566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:07:58.208076 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe488e5-1476-4368-a3f3-dd529e2705bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:58.208731 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe488e5-1476-4368-a3f3-dd529e2705bf admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:58.209005 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe488e5-1476-4368-a3f3-dd529e2705bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:58.209288 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe488e5-1476-4368-a3f3-dd529e2705bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:58.210185 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe488e5-1476-4368-a3f3-dd529e2705bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:07:58.210491 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe488e5-1476-4368-a3f3-dd529e2705bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:58.212091 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe488e5-1476-4368-a3f3-dd529e2705bf admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:58.215471 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 782/1557] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:07:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:07:58.216692 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bc299-c4ce-4824-8123-33e5eab8ef59 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:58.216982 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bc299-c4ce-4824-8123-33e5eab8ef59 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:58.217289 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bc299-c4ce-4824-8123-33e5eab8ef59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:58.226171 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 776/1558] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:07:58.227327 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe488e5-1476-4368-a3f3-dd529e2705bf admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:58.233764 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-a16bc299-c4ce-4824-8123-33e5eab8ef59 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:07:58.234929 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a16bc299-c4ce-4824-8123-33e5eab8ef59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:07:58.237262 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe488e5-1476-4368-a3f3-dd529e2705bf admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:58.241796 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923e54a-2ecf-4408-808d-23ba07b81c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:58.242331 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 783/1559] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:07:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:07:58.242426 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923e54a-2ecf-4408-808d-23ba07b81c88 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:58.242769 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923e54a-2ecf-4408-808d-23ba07b81c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:58.243050 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923e54a-2ecf-4408-808d-23ba07b81c88 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:58.243599 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99d86c-3778-4cde-8f23-5ab923e095d3 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:58.243797 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923e54a-2ecf-4408-808d-23ba07b81c88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:58.243907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99d86c-3778-4cde-8f23-5ab923e095d3 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:58.244144 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99d86c-3778-4cde-8f23-5ab923e095d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:58.245852 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923e54a-2ecf-4408-808d-23ba07b81c88 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:58.263339 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-0d99d86c-3778-4cde-8f23-5ab923e095d3 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:07:58.264606 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-0d99d86c-3778-4cde-8f23-5ab923e095d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:07:58.268957 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 777/1560] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:07:58 2022] POST /identity/v3/users => generated 296 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:07:58.270998 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ea803-003b-4892-8d2c-1d1cce2103a0 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:58.271516 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ea803-003b-4892-8d2c-1d1cce2103a0 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:58.272449 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ea803-003b-4892-8d2c-1d1cce2103a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:58.272687 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 784/1561] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:07:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:07:58.274107 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013e3f7-de23-4b74-a819-e310c07563f9 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:58.274396 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013e3f7-de23-4b74-a819-e310c07563f9 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:58.274672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013e3f7-de23-4b74-a819-e310c07563f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:58.296694 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-a013e3f7-de23-4b74-a819-e310c07563f9 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:07:58.297055 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-012ea803-003b-4892-8d2c-1d1cce2103a0 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:07:58.297956 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a013e3f7-de23-4b74-a819-e310c07563f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:07:58.298241 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-012ea803-003b-4892-8d2c-1d1cce2103a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:07:58.305585 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 785/1562] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:07:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:07:58.309584 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 778/1563] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:07:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:07:58.309584 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ea803-003b-4892-8d2c-1d1cce2103a0 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:58.309841 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239924a-4b5a-48a5-a932-91814174d0fa None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:58.309841 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239924a-4b5a-48a5-a932-91814174d0fa None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:58.309841 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239924a-4b5a-48a5-a932-91814174d0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:58.319299 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ea803-003b-4892-8d2c-1d1cce2103a0 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:58.323799 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44d5ae-0753-41cc-b8c4-99637c987c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:58.324444 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44d5ae-0753-41cc-b8c4-99637c987c78 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:58.324722 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44d5ae-0753-41cc-b8c4-99637c987c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:58.324991 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44d5ae-0753-41cc-b8c4-99637c987c78 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:58.325742 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44d5ae-0753-41cc-b8c4-99637c987c78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:07:58.325971 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-d239924a-4b5a-48a5-a932-91814174d0fa None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:07:58.326089 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44d5ae-0753-41cc-b8c4-99637c987c78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:58.327214 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-d239924a-4b5a-48a5-a932-91814174d0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:07:58.327708 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44d5ae-0753-41cc-b8c4-99637c987c78 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:58.334931 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 786/1564] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:07:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:07:58.337962 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239924a-4b5a-48a5-a932-91814174d0fa None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:58.344198 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 779/1565] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:07:58.345054 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44d5ae-0753-41cc-b8c4-99637c987c78 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:58.350131 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239924a-4b5a-48a5-a932-91814174d0fa None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:58.360594 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9b663-305b-4bb5-84dc-824cafb8e7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:58.361272 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9b663-305b-4bb5-84dc-824cafb8e7ba admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:58.361570 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9b663-305b-4bb5-84dc-824cafb8e7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:58.361853 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9b663-305b-4bb5-84dc-824cafb8e7ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:58.362561 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9b663-305b-4bb5-84dc-824cafb8e7ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:58.364531 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9b663-305b-4bb5-84dc-824cafb8e7ba admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:58.394013 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 787/1566] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:07:58 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:07:58.394013 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9b663-305b-4bb5-84dc-824cafb8e7ba admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:58.402448 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44d5ae-0753-41cc-b8c4-99637c987c78 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:58.451939 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5b29e-b825-41b8-90ea-d0cbfaea9e21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:58.452592 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5b29e-b825-41b8-90ea-d0cbfaea9e21 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:58.452711 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9b663-305b-4bb5-84dc-824cafb8e7ba admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:58.452894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5b29e-b825-41b8-90ea-d0cbfaea9e21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:58.453144 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5b29e-b825-41b8-90ea-d0cbfaea9e21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:58.457922 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca683ab7-63e4-48d1-838b-63e256b02987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:58.458512 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca683ab7-63e4-48d1-838b-63e256b02987 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:58.458792 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca683ab7-63e4-48d1-838b-63e256b02987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:58.459096 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca683ab7-63e4-48d1-838b-63e256b02987 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:58.459857 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca683ab7-63e4-48d1-838b-63e256b02987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:58.461424 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca683ab7-63e4-48d1-838b-63e256b02987 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:58.462592 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd5b29e-b825-41b8-90ea-d0cbfaea9e21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:58.464028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd5b29e-b825-41b8-90ea-d0cbfaea9e21 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:58.471383 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 788/1567] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:07:58.474678 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47c337-45e6-4a46-82e6-4b98e5b31e48 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:58.474678 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47c337-45e6-4a46-82e6-4b98e5b31e48 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:58.474678 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47c337-45e6-4a46-82e6-4b98e5b31e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:58.474934 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 780/1568] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:07:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:07:58.474934 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5b29e-b825-41b8-90ea-d0cbfaea9e21 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:58.484350 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5b29e-b825-41b8-90ea-d0cbfaea9e21 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:58.489625 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cecd21-f498-4dfa-964e-285897d62e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:58.490287 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cecd21-f498-4dfa-964e-285897d62e87 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:58.490552 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cecd21-f498-4dfa-964e-285897d62e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:58.490833 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cecd21-f498-4dfa-964e-285897d62e87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:58.491690 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cecd21-f498-4dfa-964e-285897d62e87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:07:58.491814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-dd47c337-45e6-4a46-82e6-4b98e5b31e48 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:07:58.491900 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cecd21-f498-4dfa-964e-285897d62e87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:58.492814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-dd47c337-45e6-4a46-82e6-4b98e5b31e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:07:58.493679 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cecd21-f498-4dfa-964e-285897d62e87 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:58.501172 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 789/1569] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:07:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:07:58.502586 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4868d-dc6a-44fe-b018-1e3b7143e8d9 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:58.502831 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4868d-dc6a-44fe-b018-1e3b7143e8d9 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:58.503099 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4868d-dc6a-44fe-b018-1e3b7143e8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:58.509032 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 781/1570] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:07:58.510260 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cecd21-f498-4dfa-964e-285897d62e87 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:58.520066 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cecd21-f498-4dfa-964e-285897d62e87 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:58.522266 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-70d4868d-dc6a-44fe-b018-1e3b7143e8d9 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:07:58.523617 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-70d4868d-dc6a-44fe-b018-1e3b7143e8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:07:58.524613 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e295abf-d940-4345-9152-eac8849fa46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:58.525288 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e295abf-d940-4345-9152-eac8849fa46c admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:58.525609 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e295abf-d940-4345-9152-eac8849fa46c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:58.525892 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e295abf-d940-4345-9152-eac8849fa46c admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:58.526640 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e295abf-d940-4345-9152-eac8849fa46c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:07:58.526960 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e295abf-d940-4345-9152-eac8849fa46c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:58.528585 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e295abf-d940-4345-9152-eac8849fa46c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:58.533443 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 790/1571] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:07:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:07:58.534425 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4868d-dc6a-44fe-b018-1e3b7143e8d9 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:58.543383 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 782/1572] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:07:58.544285 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e295abf-d940-4345-9152-eac8849fa46c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:58.553461 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4868d-dc6a-44fe-b018-1e3b7143e8d9 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:58.556987 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e295abf-d940-4345-9152-eac8849fa46c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:58.564603 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870b5f9-7994-4597-b907-2dde89e98187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:58.565363 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870b5f9-7994-4597-b907-2dde89e98187 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:58.565714 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870b5f9-7994-4597-b907-2dde89e98187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:58.565890 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58886ec9-8803-4312-a3e1-bfae399640cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:58.566008 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870b5f9-7994-4597-b907-2dde89e98187 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:58.566695 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58886ec9-8803-4312-a3e1-bfae399640cd admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:58.566695 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58886ec9-8803-4312-a3e1-bfae399640cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:58.567031 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870b5f9-7994-4597-b907-2dde89e98187 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:58.567121 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58886ec9-8803-4312-a3e1-bfae399640cd admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:58.568043 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58886ec9-8803-4312-a3e1-bfae399640cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:58.569154 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870b5f9-7994-4597-b907-2dde89e98187 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:58.570013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58886ec9-8803-4312-a3e1-bfae399640cd admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:58.593449 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 783/1573] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:07:58 2022] POST /identity/v3/users => generated 289 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:07:58.594816 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58886ec9-8803-4312-a3e1-bfae399640cd admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:58.601554 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 791/1574] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:07:58 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:07:58.601554 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870b5f9-7994-4597-b907-2dde89e98187 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:58.608281 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58886ec9-8803-4312-a3e1-bfae399640cd admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:58.664486 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870b5f9-7994-4597-b907-2dde89e98187 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:58.669060 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7c535-3592-42f2-81c7-d77c47a526de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:58.669435 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944bc061-69d8-49a2-844f-cae535fd4ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:58.669751 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7c535-3592-42f2-81c7-d77c47a526de admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:58.670026 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7c535-3592-42f2-81c7-d77c47a526de admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:58.670160 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944bc061-69d8-49a2-844f-cae535fd4ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:58.670294 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7c535-3592-42f2-81c7-d77c47a526de admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:58.670523 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944bc061-69d8-49a2-844f-cae535fd4ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:58.670893 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944bc061-69d8-49a2-844f-cae535fd4ca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:58.671331 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7c535-3592-42f2-81c7-d77c47a526de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:07:58.671658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7c535-3592-42f2-81c7-d77c47a526de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:58.671820 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944bc061-69d8-49a2-844f-cae535fd4ca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:58.672866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: WARNING py.warnings [None req-f5b7c535-3592-42f2-81c7-d77c47a526de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 19:07:58.672866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: warnings.warn(msg) May 16 19:07:58.672866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: May 16 19:07:58.673928 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7c535-3592-42f2-81c7-d77c47a526de admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:58.674213 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944bc061-69d8-49a2-844f-cae535fd4ca2 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:58.696276 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 792/1575] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:07:58.696276 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7c535-3592-42f2-81c7-d77c47a526de admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:58.696585 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 784/1576] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:07:58.697491 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944bc061-69d8-49a2-844f-cae535fd4ca2 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:58.703808 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7c535-3592-42f2-81c7-d77c47a526de admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:58.709962 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944bc061-69d8-49a2-844f-cae535fd4ca2 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:58.710305 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794b058-97cd-49b4-9975-624194b2e63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:58.711766 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794b058-97cd-49b4-9975-624194b2e63b admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:58.712071 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794b058-97cd-49b4-9975-624194b2e63b admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:58.712762 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794b058-97cd-49b4-9975-624194b2e63b admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:58.714584 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794b058-97cd-49b4-9975-624194b2e63b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:58.714957 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202402a-5250-4340-a957-648157c181d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:58.716100 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202402a-5250-4340-a957-648157c181d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:58.716518 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794b058-97cd-49b4-9975-624194b2e63b admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:58.716637 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202402a-5250-4340-a957-648157c181d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:58.717124 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202402a-5250-4340-a957-648157c181d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:58.718506 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202402a-5250-4340-a957-648157c181d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:07:58.718819 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202402a-5250-4340-a957-648157c181d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:58.720425 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202402a-5250-4340-a957-648157c181d8 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:58.734455 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 785/1577] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:07:58.735644 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202402a-5250-4340-a957-648157c181d8 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:58.747286 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202402a-5250-4340-a957-648157c181d8 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:58.752664 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725467f9-72c8-4bf4-9971-09e30b128064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:58.753612 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725467f9-72c8-4bf4-9971-09e30b128064 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:58.754086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725467f9-72c8-4bf4-9971-09e30b128064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:58.754356 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725467f9-72c8-4bf4-9971-09e30b128064 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:58.755192 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725467f9-72c8-4bf4-9971-09e30b128064 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:58.756598 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 793/1578] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:07:58 2022] POST /identity/v3/projects => generated 403 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:07:58.757201 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725467f9-72c8-4bf4-9971-09e30b128064 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:58.758183 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794b058-97cd-49b4-9975-624194b2e63b admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:58.788957 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 786/1579] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:07:58 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:07:58.790007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725467f9-72c8-4bf4-9971-09e30b128064 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:58.836038 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794b058-97cd-49b4-9975-624194b2e63b admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:58.857620 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725467f9-72c8-4bf4-9971-09e30b128064 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:58.863776 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddd50e7-38c1-4fe2-8bde-f37cc5d27562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:58.864592 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd50e7-38c1-4fe2-8bde-f37cc5d27562 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:58.864874 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd50e7-38c1-4fe2-8bde-f37cc5d27562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:58.865145 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd50e7-38c1-4fe2-8bde-f37cc5d27562 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:58.865939 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddd50e7-38c1-4fe2-8bde-f37cc5d27562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:58.868293 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddd50e7-38c1-4fe2-8bde-f37cc5d27562 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:58.898731 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb76c6b-4a7e-408b-bd30-36279ccf8032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:58.899183 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 787/1580] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:07:58 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:07:58.899715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb76c6b-4a7e-408b-bd30-36279ccf8032 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:58.900002 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb76c6b-4a7e-408b-bd30-36279ccf8032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:58.900117 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddd50e7-38c1-4fe2-8bde-f37cc5d27562 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:58.900283 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb76c6b-4a7e-408b-bd30-36279ccf8032 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:58.901010 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb76c6b-4a7e-408b-bd30-36279ccf8032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:58.902736 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb76c6b-4a7e-408b-bd30-36279ccf8032 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:58.914780 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddd50e7-38c1-4fe2-8bde-f37cc5d27562 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:58.916951 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 794/1581] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:07:58.918169 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb76c6b-4a7e-408b-bd30-36279ccf8032 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:58.919894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88122ad7-cf5b-44d1-a042-9d9001f0d210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:58.920875 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88122ad7-cf5b-44d1-a042-9d9001f0d210 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:58.921153 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88122ad7-cf5b-44d1-a042-9d9001f0d210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:58.921424 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88122ad7-cf5b-44d1-a042-9d9001f0d210 admin admin] PATH_INFO: `/v3/projects/ba2c6e5fee5b402fa68833228d12c8e7/users/1673e91c8910435499a5d587f4ef59f9/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:58.932786 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb76c6b-4a7e-408b-bd30-36279ccf8032 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:58.937667 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a9f03-d479-47a6-acef-21cc72ba92f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:58.938374 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a9f03-d479-47a6-acef-21cc72ba92f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:58.938790 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a9f03-d479-47a6-acef-21cc72ba92f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:58.939069 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a9f03-d479-47a6-acef-21cc72ba92f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:58.939773 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a9f03-d479-47a6-acef-21cc72ba92f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:58.940765 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88122ad7-cf5b-44d1-a042-9d9001f0d210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba2c6e5fee5b402fa68833228d12c8e7, user_id=1673e91c8910435499a5d587f4ef59f9, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:58.941874 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: WARNING py.warnings [None req-88122ad7-cf5b-44d1-a042-9d9001f0d210 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 19:07:58.941874 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: warnings.warn(msg) May 16 19:07:58.941874 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: May 16 19:07:58.942172 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a9f03-d479-47a6-acef-21cc72ba92f5 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:58.943876 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88122ad7-cf5b-44d1-a042-9d9001f0d210 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:58.961141 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 788/1582] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:07:58 2022] PUT /identity/v3/projects/ba2c6e5fee5b402fa68833228d12c8e7/users/1673e91c8910435499a5d587f4ef59f9/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:07:58.966035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88122ad7-cf5b-44d1-a042-9d9001f0d210 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:58.972030 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 795/1583] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:07:58 2022] POST /identity/v3/projects => generated 357 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:07:58.972834 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a9f03-d479-47a6-acef-21cc72ba92f5 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:59.032333 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88122ad7-cf5b-44d1-a042-9d9001f0d210 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:59.036601 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a9f03-d479-47a6-acef-21cc72ba92f5 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:59.037110 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb097d-f0ee-4f2c-a31e-5690b44c3a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:59.037889 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb097d-f0ee-4f2c-a31e-5690b44c3a49 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:59.038239 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb097d-f0ee-4f2c-a31e-5690b44c3a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:59.038587 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb097d-f0ee-4f2c-a31e-5690b44c3a49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:59.039365 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eb097d-f0ee-4f2c-a31e-5690b44c3a49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:59.041328 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eb097d-f0ee-4f2c-a31e-5690b44c3a49 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:59.042557 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296b21d-e5b4-4e74-9710-5d3adda654e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:59.043301 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296b21d-e5b4-4e74-9710-5d3adda654e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:59.043585 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296b21d-e5b4-4e74-9710-5d3adda654e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:59.043860 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296b21d-e5b4-4e74-9710-5d3adda654e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:59.044557 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b296b21d-e5b4-4e74-9710-5d3adda654e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:59.045668 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: WARNING py.warnings [None req-b296b21d-e5b4-4e74-9710-5d3adda654e5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 19:07:59.045668 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: warnings.warn(msg) May 16 19:07:59.045668 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: May 16 19:07:59.046870 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b296b21d-e5b4-4e74-9710-5d3adda654e5 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:59.071767 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 789/1584] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:07:58 2022] POST /identity/v3/projects => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:07:59.071995 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 796/1585] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:07:58 2022] POST /identity/v3/users => generated 302 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:07:59.072880 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296b21d-e5b4-4e74-9710-5d3adda654e5 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:59.073380 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb097d-f0ee-4f2c-a31e-5690b44c3a49 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:59.083679 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296b21d-e5b4-4e74-9710-5d3adda654e5 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:59.147869 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb097d-f0ee-4f2c-a31e-5690b44c3a49 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:59.150575 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2f463-2745-4380-931e-1afbb77f4e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:59.154144 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b642b-5e51-4cb8-8a8e-1a74d61b05f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:59.154875 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b642b-5e51-4cb8-8a8e-1a74d61b05f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:59.155559 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b642b-5e51-4cb8-8a8e-1a74d61b05f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:59.155885 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b642b-5e51-4cb8-8a8e-1a74d61b05f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:59.156622 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b642b-5e51-4cb8-8a8e-1a74d61b05f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:59.158734 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2f463-2745-4380-931e-1afbb77f4e86 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:59.159093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2f463-2745-4380-931e-1afbb77f4e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:59.159310 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2f463-2745-4380-931e-1afbb77f4e86 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:59.160246 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2f463-2745-4380-931e-1afbb77f4e86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:59.162018 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b642b-5e51-4cb8-8a8e-1a74d61b05f5 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:59.164846 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2f463-2745-4380-931e-1afbb77f4e86 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:59.181942 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 790/1586] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:07:59.186452 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b642b-5e51-4cb8-8a8e-1a74d61b05f5 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:59.192578 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 797/1587] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:07:59 2022] POST /identity/v3/users => generated 289 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:07:59.196034 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e84cb-16a5-447b-9cf8-5c16b3ae4e82 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:59.196516 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e84cb-16a5-447b-9cf8-5c16b3ae4e82 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:59.197056 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e84cb-16a5-447b-9cf8-5c16b3ae4e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:59.199465 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b642b-5e51-4cb8-8a8e-1a74d61b05f5 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:59.205018 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374ffda-6704-44ed-8c9b-2a151e9660ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:59.206500 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374ffda-6704-44ed-8c9b-2a151e9660ef admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:59.206909 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374ffda-6704-44ed-8c9b-2a151e9660ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:59.207186 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374ffda-6704-44ed-8c9b-2a151e9660ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:59.207928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374ffda-6704-44ed-8c9b-2a151e9660ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:59.209672 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374ffda-6704-44ed-8c9b-2a151e9660ef admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:59.221083 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-d28e84cb-16a5-447b-9cf8-5c16b3ae4e82 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:07:59.223467 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-d28e84cb-16a5-447b-9cf8-5c16b3ae4e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:07:59.226121 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 791/1588] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:07:59.227205 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374ffda-6704-44ed-8c9b-2a151e9660ef admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:59.236052 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 798/1589] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:07:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:07:59.237338 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e84cb-16a5-447b-9cf8-5c16b3ae4e82 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:59.246851 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374ffda-6704-44ed-8c9b-2a151e9660ef admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:59.249645 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e84cb-16a5-447b-9cf8-5c16b3ae4e82 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:59.253306 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c412506-50ef-4974-a92b-cc53a02b1cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:59.254152 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c412506-50ef-4974-a92b-cc53a02b1cd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:59.254504 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c412506-50ef-4974-a92b-cc53a02b1cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:59.254852 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c412506-50ef-4974-a92b-cc53a02b1cd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:59.255740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c412506-50ef-4974-a92b-cc53a02b1cd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:59.256152 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e193a8-ecf9-4d28-9f1f-bf73bf0295a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:59.257094 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e193a8-ecf9-4d28-9f1f-bf73bf0295a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:59.257504 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e193a8-ecf9-4d28-9f1f-bf73bf0295a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:59.257811 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e193a8-ecf9-4d28-9f1f-bf73bf0295a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:59.258510 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e193a8-ecf9-4d28-9f1f-bf73bf0295a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:59.258631 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c412506-50ef-4974-a92b-cc53a02b1cd8 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:59.260442 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e193a8-ecf9-4d28-9f1f-bf73bf0295a4 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:59.286875 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 799/1590] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:07:59 2022] POST /identity/v3/users => generated 284 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:07:59.288131 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 792/1591] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:07:59 2022] POST /identity/v3/users => generated 279 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:07:59.288991 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c412506-50ef-4974-a92b-cc53a02b1cd8 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:59.291532 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e193a8-ecf9-4d28-9f1f-bf73bf0295a4 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:59.303137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e193a8-ecf9-4d28-9f1f-bf73bf0295a4 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:59.308206 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156842a-0745-4f26-b49c-ae1f79f4c12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:59.308888 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156842a-0745-4f26-b49c-ae1f79f4c12e admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:59.309171 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156842a-0745-4f26-b49c-ae1f79f4c12e admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:59.309447 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156842a-0745-4f26-b49c-ae1f79f4c12e admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:59.310232 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156842a-0745-4f26-b49c-ae1f79f4c12e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:59.310590 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c412506-50ef-4974-a92b-cc53a02b1cd8 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:59.312397 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156842a-0745-4f26-b49c-ae1f79f4c12e admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:59.317667 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecda3a9-a175-4c9d-bc5b-474026bbd267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:59.319086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecda3a9-a175-4c9d-bc5b-474026bbd267 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:59.319494 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecda3a9-a175-4c9d-bc5b-474026bbd267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:59.319836 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecda3a9-a175-4c9d-bc5b-474026bbd267 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:59.320932 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecda3a9-a175-4c9d-bc5b-474026bbd267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:59.323336 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecda3a9-a175-4c9d-bc5b-474026bbd267 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:59.326891 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 800/1592] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:07:59.327847 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156842a-0745-4f26-b49c-ae1f79f4c12e admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:59.338894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 793/1593] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:07:59.339732 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156842a-0745-4f26-b49c-ae1f79f4c12e admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:59.341724 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecda3a9-a175-4c9d-bc5b-474026bbd267 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:59.346318 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd19d5f-ca3c-471a-bdee-ff05079221b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:59.347289 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd19d5f-ca3c-471a-bdee-ff05079221b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:59.347738 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd19d5f-ca3c-471a-bdee-ff05079221b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:59.348204 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd19d5f-ca3c-471a-bdee-ff05079221b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:59.349115 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd19d5f-ca3c-471a-bdee-ff05079221b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:59.350978 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd19d5f-ca3c-471a-bdee-ff05079221b3 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:59.356212 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecda3a9-a175-4c9d-bc5b-474026bbd267 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:59.363201 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e989d3e-9a6e-4111-b526-50e3799c85bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:59.364254 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e989d3e-9a6e-4111-b526-50e3799c85bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:59.364599 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e989d3e-9a6e-4111-b526-50e3799c85bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:59.365020 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e989d3e-9a6e-4111-b526-50e3799c85bf admin admin] PATH_INFO: `/v3/projects/6c29e44eba604e6389ecb2ee2b1059a0/users/e6a312fd71b944188c56c42c94e15324/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:59.369128 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 801/1594] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:07:59.369128 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd19d5f-ca3c-471a-bdee-ff05079221b3 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:59.388181 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e989d3e-9a6e-4111-b526-50e3799c85bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c29e44eba604e6389ecb2ee2b1059a0, user_id=e6a312fd71b944188c56c42c94e15324, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:59.391017 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e989d3e-9a6e-4111-b526-50e3799c85bf admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:59.411073 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 794/1595] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:07:59 2022] PUT /identity/v3/projects/6c29e44eba604e6389ecb2ee2b1059a0/users/e6a312fd71b944188c56c42c94e15324/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:07:59.412642 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e989d3e-9a6e-4111-b526-50e3799c85bf admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:59.483507 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e989d3e-9a6e-4111-b526-50e3799c85bf admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:59.489882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001beb6-4d6c-4353-add1-236472b4e697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:59.490973 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001beb6-4d6c-4353-add1-236472b4e697 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:59.491518 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001beb6-4d6c-4353-add1-236472b4e697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:59.491950 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001beb6-4d6c-4353-add1-236472b4e697 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:59.492876 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001beb6-4d6c-4353-add1-236472b4e697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:59.494855 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001beb6-4d6c-4353-add1-236472b4e697 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:59.508795 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 795/1596] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:07:59.510248 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001beb6-4d6c-4353-add1-236472b4e697 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:59.523374 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001beb6-4d6c-4353-add1-236472b4e697 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:59.529884 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c951e2-a40f-4a30-8e50-c887a0b231c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:59.531256 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c951e2-a40f-4a30-8e50-c887a0b231c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:59.531750 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c951e2-a40f-4a30-8e50-c887a0b231c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:59.532212 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c951e2-a40f-4a30-8e50-c887a0b231c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:59.533280 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c951e2-a40f-4a30-8e50-c887a0b231c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:59.535131 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c951e2-a40f-4a30-8e50-c887a0b231c6 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:59.546979 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 796/1597] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:07:59.548349 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c951e2-a40f-4a30-8e50-c887a0b231c6 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:59.560748 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c951e2-a40f-4a30-8e50-c887a0b231c6 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:59.566919 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f38e50-8a2a-4897-8550-1306ce3b7992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:59.567920 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f38e50-8a2a-4897-8550-1306ce3b7992 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:59.568590 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f38e50-8a2a-4897-8550-1306ce3b7992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:59.569094 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f38e50-8a2a-4897-8550-1306ce3b7992 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:59.569206 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd19d5f-ca3c-471a-bdee-ff05079221b3 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:59.570743 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f38e50-8a2a-4897-8550-1306ce3b7992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:59.572719 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f38e50-8a2a-4897-8550-1306ce3b7992 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:59.584069 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 797/1598] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:07:59.585294 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f38e50-8a2a-4897-8550-1306ce3b7992 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:59.595644 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f38e50-8a2a-4897-8550-1306ce3b7992 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:59.600803 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07208496-ec26-4bd8-8270-129165dc8ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:59.601906 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07208496-ec26-4bd8-8270-129165dc8ac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:59.602451 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07208496-ec26-4bd8-8270-129165dc8ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:59.602945 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07208496-ec26-4bd8-8270-129165dc8ac7 admin admin] PATH_INFO: `/v3/projects/dd195af6f92c42a18ed7051eae26dbaa/users/7d3af11e1ffc4ab1a37669f893d2f3be/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:59.618254 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07208496-ec26-4bd8-8270-129165dc8ac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd195af6f92c42a18ed7051eae26dbaa, user_id=7d3af11e1ffc4ab1a37669f893d2f3be, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:59.621340 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07208496-ec26-4bd8-8270-129165dc8ac7 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:59.624780 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e896826-7ddb-416e-a509-e84126aa2875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:59.625490 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e896826-7ddb-416e-a509-e84126aa2875 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:59.625805 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e896826-7ddb-416e-a509-e84126aa2875 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:59.626079 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e896826-7ddb-416e-a509-e84126aa2875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:59.637028 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e896826-7ddb-416e-a509-e84126aa2875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:59.640028 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e896826-7ddb-416e-a509-e84126aa2875 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:59.647930 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 798/1599] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:07:59 2022] PUT /identity/v3/projects/dd195af6f92c42a18ed7051eae26dbaa/users/7d3af11e1ffc4ab1a37669f893d2f3be/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:07:59.648862 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07208496-ec26-4bd8-8270-129165dc8ac7 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:59.653839 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 802/1600] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:07:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:07:59.655940 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8267586-6398-4853-9546-58fc38961cba None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:59.656418 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8267586-6398-4853-9546-58fc38961cba None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:59.656860 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8267586-6398-4853-9546-58fc38961cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:59.679450 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-c8267586-6398-4853-9546-58fc38961cba None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:07:59.680958 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-c8267586-6398-4853-9546-58fc38961cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:07:59.769866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 803/1601] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:07:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:07:59.775559 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8267586-6398-4853-9546-58fc38961cba None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:59.811847 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8267586-6398-4853-9546-58fc38961cba None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:59.814409 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07208496-ec26-4bd8-8270-129165dc8ac7 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:59.825192 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887df11c-ba36-4686-a3f5-0baa79aeebaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:59.826361 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887df11c-ba36-4686-a3f5-0baa79aeebaa admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:59.826814 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887df11c-ba36-4686-a3f5-0baa79aeebaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:59.827187 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887df11c-ba36-4686-a3f5-0baa79aeebaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:59.828140 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887df11c-ba36-4686-a3f5-0baa79aeebaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:59.830123 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887df11c-ba36-4686-a3f5-0baa79aeebaa admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:59.834018 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5523734-b7c6-48a5-b9f0-27b92809f514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:59.834910 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5523734-b7c6-48a5-b9f0-27b92809f514 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:59.835192 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5523734-b7c6-48a5-b9f0-27b92809f514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:59.835885 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5523734-b7c6-48a5-b9f0-27b92809f514 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:59.847701 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5523734-b7c6-48a5-b9f0-27b92809f514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:59.847887 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 799/1602] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:07:59.848883 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887df11c-ba36-4686-a3f5-0baa79aeebaa admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:59.852445 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5523734-b7c6-48a5-b9f0-27b92809f514 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:59.862211 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887df11c-ba36-4686-a3f5-0baa79aeebaa admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:59.866946 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 804/1603] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:07:59.867818 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5523734-b7c6-48a5-b9f0-27b92809f514 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:59.869491 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b319156-24e3-4121-8222-80f4ed4dbee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:59.870429 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b319156-24e3-4121-8222-80f4ed4dbee8 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:59.870825 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b319156-24e3-4121-8222-80f4ed4dbee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:59.871191 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b319156-24e3-4121-8222-80f4ed4dbee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:59.872031 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b319156-24e3-4121-8222-80f4ed4dbee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:59.873904 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b319156-24e3-4121-8222-80f4ed4dbee8 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:59.886199 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5523734-b7c6-48a5-b9f0-27b92809f514 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:07:59.890149 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 800/1604] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:07:59.891776 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53fa94-bb70-41bb-9c42-34ba3cf0f561 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:59.892280 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53fa94-bb70-41bb-9c42-34ba3cf0f561 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:59.892855 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53fa94-bb70-41bb-9c42-34ba3cf0f561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:59.898534 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2e2eb-953c-48ae-a517-6cbf79734473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:07:59.899465 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2e2eb-953c-48ae-a517-6cbf79734473 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:07:59.899741 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2e2eb-953c-48ae-a517-6cbf79734473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:07:59.900012 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2e2eb-953c-48ae-a517-6cbf79734473 admin admin] PATH_INFO: `/v3/projects/2d18856aecf24e25a922f8defce40ea1/users/d07832b36a694a539edbc6b28693ba4f/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:07:59.918652 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-0d53fa94-bb70-41bb-9c42-34ba3cf0f561 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:07:59.921226 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0d53fa94-bb70-41bb-9c42-34ba3cf0f561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:07:59.926884 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d2e2eb-953c-48ae-a517-6cbf79734473 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d18856aecf24e25a922f8defce40ea1, user_id=d07832b36a694a539edbc6b28693ba4f, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:07:59.929843 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d2e2eb-953c-48ae-a517-6cbf79734473 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:07:59.944434 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 801/1605] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:07:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:07:59.953078 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53fa94-bb70-41bb-9c42-34ba3cf0f561 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:07:59.955183 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0d53fa94-bb70-41bb-9c42-34ba3cf0f561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:07:59.957981 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 805/1606] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:07:59 2022] PUT /identity/v3/projects/2d18856aecf24e25a922f8defce40ea1/users/d07832b36a694a539edbc6b28693ba4f/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:07:59.959048 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2e2eb-953c-48ae-a517-6cbf79734473 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:00.031788 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2e2eb-953c-48ae-a517-6cbf79734473 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:00.038067 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53fa94-bb70-41bb-9c42-34ba3cf0f561 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:00.038428 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222fe68-ad0e-4a35-99ca-05d7ae83bb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:00.039836 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222fe68-ad0e-4a35-99ca-05d7ae83bb20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:00.040118 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222fe68-ad0e-4a35-99ca-05d7ae83bb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:00.040390 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222fe68-ad0e-4a35-99ca-05d7ae83bb20 admin admin] PATH_INFO: `/v3/projects/dee1963e977f4ac7b6d1877a6dd740a9/users/a7d2aea046214bfcbbe6d5b3581fc155/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:00.058530 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222fe68-ad0e-4a35-99ca-05d7ae83bb20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dee1963e977f4ac7b6d1877a6dd740a9, user_id=a7d2aea046214bfcbbe6d5b3581fc155, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:00.063151 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222fe68-ad0e-4a35-99ca-05d7ae83bb20 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:00.105777 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 806/1607] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:07:59 2022] PUT /identity/v3/projects/dee1963e977f4ac7b6d1877a6dd740a9/users/a7d2aea046214bfcbbe6d5b3581fc155/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:00.107427 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222fe68-ad0e-4a35-99ca-05d7ae83bb20 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:00.110242 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abac90f-baac-4e8c-a301-dff1aa2a3758 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:00.110970 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abac90f-baac-4e8c-a301-dff1aa2a3758 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:00.111251 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abac90f-baac-4e8c-a301-dff1aa2a3758 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:00.111911 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abac90f-baac-4e8c-a301-dff1aa2a3758 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:00.134874 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abac90f-baac-4e8c-a301-dff1aa2a3758 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:00.137243 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abac90f-baac-4e8c-a301-dff1aa2a3758 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:00.150078 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 802/1608] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:07:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:08:00.151459 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abac90f-baac-4e8c-a301-dff1aa2a3758 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:00.171728 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abac90f-baac-4e8c-a301-dff1aa2a3758 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:00.221972 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222fe68-ad0e-4a35-99ca-05d7ae83bb20 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:00.227159 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43b103-25d9-419f-94bb-1e16d54295db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:00.228334 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43b103-25d9-419f-94bb-1e16d54295db admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:00.228707 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43b103-25d9-419f-94bb-1e16d54295db admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:00.229073 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43b103-25d9-419f-94bb-1e16d54295db admin admin] PATH_INFO: `/v3/projects/f4deb4cba3c84184aa376704901213e7/users/44e4283ec17a4ae78bd06ceed2db7a9f/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:00.247754 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43b103-25d9-419f-94bb-1e16d54295db admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4deb4cba3c84184aa376704901213e7, user_id=44e4283ec17a4ae78bd06ceed2db7a9f, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:00.251209 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43b103-25d9-419f-94bb-1e16d54295db admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:00.288291 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 807/1609] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:08:00 2022] PUT /identity/v3/projects/f4deb4cba3c84184aa376704901213e7/users/44e4283ec17a4ae78bd06ceed2db7a9f/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:00.290807 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364f363-e268-4feb-9a5f-fa19bfc69911 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:00.291366 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364f363-e268-4feb-9a5f-fa19bfc69911 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:00.291714 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364f363-e268-4feb-9a5f-fa19bfc69911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:00.293993 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a9e69-b5b6-4c3d-8ed3-48d793576ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:00.295908 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a9e69-b5b6-4c3d-8ed3-48d793576ff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:00.296292 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a9e69-b5b6-4c3d-8ed3-48d793576ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:00.296521 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a9e69-b5b6-4c3d-8ed3-48d793576ff3 admin admin] PATH_INFO: `/v3/projects/9b5fedd101704ee990f6d714cb7caf3b/users/813d537705194247af940253912bd46f/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:00.322478 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-a364f363-e268-4feb-9a5f-fa19bfc69911 None None] MFA Rules not processed for user `d07832b36a694a539edbc6b28693ba4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:00.325257 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a364f363-e268-4feb-9a5f-fa19bfc69911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:00.339150 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178a9e69-b5b6-4c3d-8ed3-48d793576ff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b5fedd101704ee990f6d714cb7caf3b, user_id=813d537705194247af940253912bd46f, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:00.342326 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178a9e69-b5b6-4c3d-8ed3-48d793576ff3 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:00.370186 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 803/1610] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:08:00 2022] PUT /identity/v3/projects/9b5fedd101704ee990f6d714cb7caf3b/users/813d537705194247af940253912bd46f/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:00.375724 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a9e69-b5b6-4c3d-8ed3-48d793576ff3 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:00.447563 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 808/1611] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:00.450139 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c7d7c-9116-42cf-98fb-ea070d79ce56 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:00.450524 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c7d7c-9116-42cf-98fb-ea070d79ce56 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:00.451438 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c7d7c-9116-42cf-98fb-ea070d79ce56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:00.471224 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a9e69-b5b6-4c3d-8ed3-48d793576ff3 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:00.473202 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-681c7d7c-9116-42cf-98fb-ea070d79ce56 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:00.474533 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-681c7d7c-9116-42cf-98fb-ea070d79ce56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:00.475528 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5d6d1-4db1-46e6-9e2c-a5668bd34f31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:00.476194 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5d6d1-4db1-46e6-9e2c-a5668bd34f31 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:00.476817 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5d6d1-4db1-46e6-9e2c-a5668bd34f31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:00.476817 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5d6d1-4db1-46e6-9e2c-a5668bd34f31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:00.541003 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 809/1612] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:00.542110 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa2b7d-d042-4fbf-b31a-f5ad71720cc8 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:00.542417 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa2b7d-d042-4fbf-b31a-f5ad71720cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:00.544930 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa2b7d-d042-4fbf-b31a-f5ad71720cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:00.569471 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb5d6d1-4db1-46e6-9e2c-a5668bd34f31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:00.571091 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb5d6d1-4db1-46e6-9e2c-a5668bd34f31 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:00.581560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 804/1613] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:08:00.582848 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe723770-0adf-4296-9057-7839984b38c3 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:00.583229 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe723770-0adf-4296-9057-7839984b38c3 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:00.584182 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe723770-0adf-4296-9057-7839984b38c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:00.584598 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-19aa2b7d-d042-4fbf-b31a-f5ad71720cc8 None None] MFA Rules not processed for user `44e4283ec17a4ae78bd06ceed2db7a9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:00.586128 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-19aa2b7d-d042-4fbf-b31a-f5ad71720cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:00.615349 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-fe723770-0adf-4296-9057-7839984b38c3 None None] MFA Rules not processed for user `813d537705194247af940253912bd46f`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:00.616700 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-fe723770-0adf-4296-9057-7839984b38c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:00.679421 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 810/1614] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:00 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:00.681781 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa2b7d-d042-4fbf-b31a-f5ad71720cc8 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:00.700602 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa2b7d-d042-4fbf-b31a-f5ad71720cc8 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:00.708460 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d164fd-3109-4d99-8971-f09870340467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:00.710963 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d164fd-3109-4d99-8971-f09870340467 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:00.711552 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d164fd-3109-4d99-8971-f09870340467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:00.712025 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d164fd-3109-4d99-8971-f09870340467 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:00.713837 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d164fd-3109-4d99-8971-f09870340467 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:00.715787 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d164fd-3109-4d99-8971-f09870340467 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:00.728337 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 805/1615] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:00 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:00.729293 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe723770-0adf-4296-9057-7839984b38c3 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:00.752267 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe723770-0adf-4296-9057-7839984b38c3 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:00.757414 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000cbbae-a964-4ab5-8257-87e32d23bc08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:00.758270 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cbbae-a964-4ab5-8257-87e32d23bc08 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:00.758631 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cbbae-a964-4ab5-8257-87e32d23bc08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:00.758973 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cbbae-a964-4ab5-8257-87e32d23bc08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:00.767065 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 811/1616] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:08:00 2022] POST /identity/v3/projects => generated 405 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:08:00.767859 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d164fd-3109-4d99-8971-f09870340467 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:00.772320 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000cbbae-a964-4ab5-8257-87e32d23bc08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:00.774792 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000cbbae-a964-4ab5-8257-87e32d23bc08 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:00.787249 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 806/1617] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:08:00.788642 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000cbbae-a964-4ab5-8257-87e32d23bc08 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:00.800777 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000cbbae-a964-4ab5-8257-87e32d23bc08 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:00.859133 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d164fd-3109-4d99-8971-f09870340467 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:00.863824 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fffd19-a36c-4438-b25b-0edafe7ab44d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:00.864495 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fffd19-a36c-4438-b25b-0edafe7ab44d service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:00.864772 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fffd19-a36c-4438-b25b-0edafe7ab44d service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:00.865184 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fffd19-a36c-4438-b25b-0edafe7ab44d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:00.927017 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d03606-f371-4f63-8771-a92f0614a079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:00.929505 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d03606-f371-4f63-8771-a92f0614a079 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:00.930221 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d03606-f371-4f63-8771-a92f0614a079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:00.930663 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d03606-f371-4f63-8771-a92f0614a079 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:00.938286 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d03606-f371-4f63-8771-a92f0614a079 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:00.941757 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d03606-f371-4f63-8771-a92f0614a079 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:00.950960 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fffd19-a36c-4438-b25b-0edafe7ab44d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:00.955735 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fffd19-a36c-4438-b25b-0edafe7ab44d service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:00.971317 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 812/1618] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:00 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:08:00.975112 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fffd19-a36c-4438-b25b-0edafe7ab44d service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:00.985830 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 807/1619] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:08:00 2022] POST /identity/v3/projects => generated 355 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:08:00.989572 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d03606-f371-4f63-8771-a92f0614a079 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:01.005694 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fffd19-a36c-4438-b25b-0edafe7ab44d service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:01.111709 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb226bb-1d88-4a82-a265-1e9f80c87db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:01.113051 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb226bb-1d88-4a82-a265-1e9f80c87db9 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:01.113725 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb226bb-1d88-4a82-a265-1e9f80c87db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:01.114870 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb226bb-1d88-4a82-a265-1e9f80c87db9 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:01.119209 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d03606-f371-4f63-8771-a92f0614a079 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:01.120099 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb226bb-1d88-4a82-a265-1e9f80c87db9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:01.124962 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb226bb-1d88-4a82-a265-1e9f80c87db9 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:01.135566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ff314-e16a-438c-b5f7-a9628db6d17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:01.136310 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ff314-e16a-438c-b5f7-a9628db6d17e admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:01.136529 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ff314-e16a-438c-b5f7-a9628db6d17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:01.136802 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ff314-e16a-438c-b5f7-a9628db6d17e admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:01.137517 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ff314-e16a-438c-b5f7-a9628db6d17e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:01.139855 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ff314-e16a-438c-b5f7-a9628db6d17e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:01.168106 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 813/1620] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:08:00 2022] POST /identity/v3/users => generated 309 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:08:01.172378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb226bb-1d88-4a82-a265-1e9f80c87db9 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:01.182394 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 808/1621] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:08:00 2022] POST /identity/v3/users => generated 284 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:08:01.185920 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ff314-e16a-438c-b5f7-a9628db6d17e admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:01.187840 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb226bb-1d88-4a82-a265-1e9f80c87db9 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:01.195546 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2572b-fc2d-4769-bf2f-a0871966c810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:01.196656 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2572b-fc2d-4769-bf2f-a0871966c810 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:01.197240 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2572b-fc2d-4769-bf2f-a0871966c810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:01.198367 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2572b-fc2d-4769-bf2f-a0871966c810 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:01.199496 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa2572b-fc2d-4769-bf2f-a0871966c810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:01.201484 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ff314-e16a-438c-b5f7-a9628db6d17e admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:01.204663 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa2572b-fc2d-4769-bf2f-a0871966c810 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:01.213877 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3b7e4-b831-4e88-b658-88adf300646c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:01.214573 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3b7e4-b831-4e88-b658-88adf300646c admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:01.214853 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3b7e4-b831-4e88-b658-88adf300646c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:01.215160 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3b7e4-b831-4e88-b658-88adf300646c admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:01.215848 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe3b7e4-b831-4e88-b658-88adf300646c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:01.217492 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe3b7e4-b831-4e88-b658-88adf300646c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:01.224612 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 814/1622] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:08:01.228582 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2572b-fc2d-4769-bf2f-a0871966c810 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:01.242420 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2572b-fc2d-4769-bf2f-a0871966c810 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:01.242965 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 809/1623] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 19:08:01.246817 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3b7e4-b831-4e88-b658-88adf300646c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:01.250694 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1eac2b-f270-4308-9493-fef23b1643fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:01.251892 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1eac2b-f270-4308-9493-fef23b1643fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:01.252390 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1eac2b-f270-4308-9493-fef23b1643fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:01.252823 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1eac2b-f270-4308-9493-fef23b1643fe admin admin] PATH_INFO: `/v3/projects/13c79ec718a344acb4480711d6d1e34b/users/5eedb8f3420e4782ad897fab5b0a0f7c/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:01.266656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3b7e4-b831-4e88-b658-88adf300646c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:01.274341 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1eac2b-f270-4308-9493-fef23b1643fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=13c79ec718a344acb4480711d6d1e34b, user_id=5eedb8f3420e4782ad897fab5b0a0f7c, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:01.279544 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1eac2b-f270-4308-9493-fef23b1643fe admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:01.284699 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0bff0-bffb-4e70-95d8-8021759bad54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:01.287361 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0bff0-bffb-4e70-95d8-8021759bad54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:01.287881 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0bff0-bffb-4e70-95d8-8021759bad54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:01.288324 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0bff0-bffb-4e70-95d8-8021759bad54 admin admin] PATH_INFO: `/v3/projects/546864d6f3224ae5bf44a0a46e619dfb/users/8083625bc3f34021997b798c2d39b830/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:01.321442 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 815/1624] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:08:01 2022] PUT /identity/v3/projects/13c79ec718a344acb4480711d6d1e34b/users/5eedb8f3420e4782ad897fab5b0a0f7c/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:08:01.323303 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1eac2b-f270-4308-9493-fef23b1643fe admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:01.339396 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0bff0-bffb-4e70-95d8-8021759bad54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=546864d6f3224ae5bf44a0a46e619dfb, user_id=8083625bc3f34021997b798c2d39b830, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:01.345864 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0bff0-bffb-4e70-95d8-8021759bad54 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:01.383705 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 810/1625] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:08:01 2022] PUT /identity/v3/projects/546864d6f3224ae5bf44a0a46e619dfb/users/8083625bc3f34021997b798c2d39b830/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:08:01.388727 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0bff0-bffb-4e70-95d8-8021759bad54 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:01.478931 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1eac2b-f270-4308-9493-fef23b1643fe admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:01.526066 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0bff0-bffb-4e70-95d8-8021759bad54 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:01.537482 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd4774-344d-40e7-b951-aae3644e2db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:01.539211 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd4774-344d-40e7-b951-aae3644e2db7 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:01.540203 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd4774-344d-40e7-b951-aae3644e2db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:01.542143 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd4774-344d-40e7-b951-aae3644e2db7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:01.547113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd4774-344d-40e7-b951-aae3644e2db7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:01.547840 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64332b-e84a-4745-b475-483271f27ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:01.548550 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64332b-e84a-4745-b475-483271f27ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:01.548827 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64332b-e84a-4745-b475-483271f27ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:01.549482 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64332b-e84a-4745-b475-483271f27ff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:01.549915 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64332b-e84a-4745-b475-483271f27ff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:01.551868 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd4774-344d-40e7-b951-aae3644e2db7 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:01.552432 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64332b-e84a-4745-b475-483271f27ff9 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:01.567928 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 816/1626] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:08:01.568675 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64332b-e84a-4745-b475-483271f27ff9 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:01.578092 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 811/1627] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:08:01.583155 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd4774-344d-40e7-b951-aae3644e2db7 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:01.596162 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd4774-344d-40e7-b951-aae3644e2db7 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:01.597914 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64332b-e84a-4745-b475-483271f27ff9 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:01.608709 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4861c04-7eab-46f9-8b16-31a3e4f84aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:01.608970 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07fc45-fef8-4845-91b4-f7bce2870eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:01.609800 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07fc45-fef8-4845-91b4-f7bce2870eda admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:01.610064 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07fc45-fef8-4845-91b4-f7bce2870eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:01.610337 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07fc45-fef8-4845-91b4-f7bce2870eda admin admin] PATH_INFO: `/v3/projects/13c79ec718a344acb4480711d6d1e34b/users/5eedb8f3420e4782ad897fab5b0a0f7c/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:01.610911 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4861c04-7eab-46f9-8b16-31a3e4f84aab admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:01.611366 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4861c04-7eab-46f9-8b16-31a3e4f84aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:01.611806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4861c04-7eab-46f9-8b16-31a3e4f84aab admin admin] PATH_INFO: `/v3/projects/546864d6f3224ae5bf44a0a46e619dfb/users/8083625bc3f34021997b798c2d39b830/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:01.613937 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c07fc45-fef8-4845-91b4-f7bce2870eda admin admin] RBAC: Authorizing `identity:create_grant(project_id=13c79ec718a344acb4480711d6d1e34b, user_id=5eedb8f3420e4782ad897fab5b0a0f7c, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:01.615513 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4861c04-7eab-46f9-8b16-31a3e4f84aab admin admin] RBAC: Authorizing `identity:create_grant(project_id=546864d6f3224ae5bf44a0a46e619dfb, user_id=8083625bc3f34021997b798c2d39b830, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:01.617871 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c07fc45-fef8-4845-91b4-f7bce2870eda admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:01.620232 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4861c04-7eab-46f9-8b16-31a3e4f84aab admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:01.635159 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 812/1628] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:08:01 2022] PUT /identity/v3/projects/546864d6f3224ae5bf44a0a46e619dfb/users/8083625bc3f34021997b798c2d39b830/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:01.646763 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a7368-db65-4caa-9492-3db1b8fe5d32 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:01.647465 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a7368-db65-4caa-9492-3db1b8fe5d32 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:01.647912 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a7368-db65-4caa-9492-3db1b8fe5d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:01.668939 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 817/1629] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:08:01 2022] PUT /identity/v3/projects/13c79ec718a344acb4480711d6d1e34b/users/5eedb8f3420e4782ad897fab5b0a0f7c/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:01.672545 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4899d-9130-4b57-805e-8f3acbca8e28 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:01.672873 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4899d-9130-4b57-805e-8f3acbca8e28 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:01.673163 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4899d-9130-4b57-805e-8f3acbca8e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:01.729482 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-435a7368-db65-4caa-9492-3db1b8fe5d32 None None] MFA Rules not processed for user `8083625bc3f34021997b798c2d39b830`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:01.731045 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-435a7368-db65-4caa-9492-3db1b8fe5d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:01.738162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-f0b4899d-9130-4b57-805e-8f3acbca8e28 None None] MFA Rules not processed for user `5eedb8f3420e4782ad897fab5b0a0f7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:01.739388 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f0b4899d-9130-4b57-805e-8f3acbca8e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:01.878438 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 813/1630] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:01 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:01.892554 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a7368-db65-4caa-9492-3db1b8fe5d32 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:01.907018 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 818/1631] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:01 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:01.968411 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a7368-db65-4caa-9492-3db1b8fe5d32 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:01.973240 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b6f26-1f15-43f0-ac70-b1cf8b104f4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:01.974400 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b6f26-1f15-43f0-ac70-b1cf8b104f4e service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:01.974686 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b6f26-1f15-43f0-ac70-b1cf8b104f4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:01.975050 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b6f26-1f15-43f0-ac70-b1cf8b104f4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:02.001449 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b6f26-1f15-43f0-ac70-b1cf8b104f4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:02.004403 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b6f26-1f15-43f0-ac70-b1cf8b104f4e service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:02.047789 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 814/1632] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:01 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:08:02.103742 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4899d-9130-4b57-805e-8f3acbca8e28 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:02.120927 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4899d-9130-4b57-805e-8f3acbca8e28 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:02.130238 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc3f4d-6048-4a5a-bab4-a969c7a274e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:02.131004 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc3f4d-6048-4a5a-bab4-a969c7a274e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:02.131358 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc3f4d-6048-4a5a-bab4-a969c7a274e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:02.131693 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc3f4d-6048-4a5a-bab4-a969c7a274e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:02.150482 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc3f4d-6048-4a5a-bab4-a969c7a274e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:02.152052 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc3f4d-6048-4a5a-bab4-a969c7a274e1 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:02.198479 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 819/1633] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:02 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:08:02.583708 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b6f26-1f15-43f0-ac70-b1cf8b104f4e service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:02.594442 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b6f26-1f15-43f0-ac70-b1cf8b104f4e service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:02.600515 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0f826-9fbc-4d5b-bdd5-23bbe3bc4265 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:02.619497 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0f826-9fbc-4d5b-bdd5-23bbe3bc4265 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:02.620991 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0f826-9fbc-4d5b-bdd5-23bbe3bc4265 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:02.621604 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0f826-9fbc-4d5b-bdd5-23bbe3bc4265 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:02.736767 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0f826-9fbc-4d5b-bdd5-23bbe3bc4265 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:02.738333 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0f826-9fbc-4d5b-bdd5-23bbe3bc4265 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:02.759086 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc3f4d-6048-4a5a-bab4-a969c7a274e1 service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:02.772300 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 815/1634] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:02 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:08:02.871238 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc3f4d-6048-4a5a-bab4-a969c7a274e1 service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:02.887708 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46980668-2b86-402c-9041-69b0a30e6504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:02.888896 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46980668-2b86-402c-9041-69b0a30e6504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:02.889638 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46980668-2b86-402c-9041-69b0a30e6504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:02.890073 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46980668-2b86-402c-9041-69b0a30e6504 admin admin] PATH_INFO: `/v3/users/d07832b36a694a539edbc6b28693ba4f` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:02.893476 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46980668-2b86-402c-9041-69b0a30e6504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d07832b36a694a539edbc6b28693ba4f)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:02.896094 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46980668-2b86-402c-9041-69b0a30e6504 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:02.988450 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-46980668-2b86-402c-9041-69b0a30e6504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd07832b36a694a539edbc6b28693ba4f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:03.003778 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-46980668-2b86-402c-9041-69b0a30e6504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd07832b36a694a539edbc6b28693ba4f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:03.013585 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-46980668-2b86-402c-9041-69b0a30e6504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd07832b36a694a539edbc6b28693ba4f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:03.014652 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-46980668-2b86-402c-9041-69b0a30e6504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd07832b36a694a539edbc6b28693ba4f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:03.040163 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-46980668-2b86-402c-9041-69b0a30e6504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd07832b36a694a539edbc6b28693ba4f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:03.056911 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 820/1635] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:08:02 2022] DELETE /identity/v3/users/d07832b36a694a539edbc6b28693ba4f => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:03.061174 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4751d0-55e1-43d8-bdce-21eac83dc00a None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:03.061673 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4751d0-55e1-43d8-bdce-21eac83dc00a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:03.062066 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4751d0-55e1-43d8-bdce-21eac83dc00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:03.091132 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-2d4751d0-55e1-43d8-bdce-21eac83dc00a None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:03.092660 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2d4751d0-55e1-43d8-bdce-21eac83dc00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:03.141199 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1adc84-5058-40d6-963b-0dea98016a65 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:03.141199 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1adc84-5058-40d6-963b-0dea98016a65 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:03.142903 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1adc84-5058-40d6-963b-0dea98016a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:03.245711 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-4f1adc84-5058-40d6-963b-0dea98016a65 None None] MFA Rules not processed for user `e6a312fd71b944188c56c42c94e15324`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:03.251084 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-4f1adc84-5058-40d6-963b-0dea98016a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:03.303571 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 816/1636] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:03.329286 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4751d0-55e1-43d8-bdce-21eac83dc00a None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:03.334610 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2d4751d0-55e1-43d8-bdce-21eac83dc00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:03.415721 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 821/1637] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:08:03.427627 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a22ab8-22fd-49a3-83a4-41422ff86162 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:03.427897 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a22ab8-22fd-49a3-83a4-41422ff86162 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:03.428175 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a22ab8-22fd-49a3-83a4-41422ff86162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:03.463525 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-15a22ab8-22fd-49a3-83a4-41422ff86162 None None] MFA Rules not processed for user `e6a312fd71b944188c56c42c94e15324`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:03.466046 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4751d0-55e1-43d8-bdce-21eac83dc00a None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:03.467665 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-15a22ab8-22fd-49a3-83a4-41422ff86162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:03.473356 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede3436-3e2c-4fb4-aaad-cc9749b093d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:03.475149 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede3436-3e2c-4fb4-aaad-cc9749b093d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:03.475445 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede3436-3e2c-4fb4-aaad-cc9749b093d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:03.475724 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede3436-3e2c-4fb4-aaad-cc9749b093d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:03.487744 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 822/1638] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:08:03.503367 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede3436-3e2c-4fb4-aaad-cc9749b093d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:03.504907 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede3436-3e2c-4fb4-aaad-cc9749b093d7 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:03.511267 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f2c4d-b2bc-4123-ab4a-4d71e494a910 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:03.512270 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f2c4d-b2bc-4123-ab4a-4d71e494a910 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:03.512776 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f2c4d-b2bc-4123-ab4a-4d71e494a910 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:03.514832 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 823/1639] 10.222.0.24 () {54 vars in 961 bytes} [Mon May 16 19:08:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 19:08:03.521672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301f1de-543f-4a83-8253-e9d753a454b7 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:03.522389 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301f1de-543f-4a83-8253-e9d753a454b7 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:03.522961 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301f1de-543f-4a83-8253-e9d753a454b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:03.527268 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 817/1640] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 19:08:03.575132 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-b301f1de-543f-4a83-8253-e9d753a454b7 None None] MFA Rules not processed for user `1f03aa520ee14615b802cdbc3cd4f87d`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:03.577968 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-b301f1de-543f-4a83-8253-e9d753a454b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:03.683005 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 824/1641] 10.222.0.24 () {58 vars in 1058 bytes} [Mon May 16 19:08:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:08:03.690595 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede3436-3e2c-4fb4-aaad-cc9749b093d7 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:03.711791 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede3436-3e2c-4fb4-aaad-cc9749b093d7 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:03.719591 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d67969-1811-44fe-8d6e-cd878371b4b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:03.720321 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d67969-1811-44fe-8d6e-cd878371b4b5 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:03.720607 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d67969-1811-44fe-8d6e-cd878371b4b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:03.720882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d67969-1811-44fe-8d6e-cd878371b4b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:03.740393 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d67969-1811-44fe-8d6e-cd878371b4b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:03.742055 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d67969-1811-44fe-8d6e-cd878371b4b5 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:03.763027 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 818/1642] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:08:04.006250 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcde223-1b85-47b9-9920-96931c54bb22 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:04.007376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcde223-1b85-47b9-9920-96931c54bb22 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:04.007811 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcde223-1b85-47b9-9920-96931c54bb22 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:04.010627 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 825/1643] 10.222.0.24 () {54 vars in 961 bytes} [Mon May 16 19:08:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:08:04.018394 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fc488-72f1-4b85-a4cb-ebaa41a3c5c3 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:04.019040 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fc488-72f1-4b85-a4cb-ebaa41a3c5c3 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:04.019722 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fc488-72f1-4b85-a4cb-ebaa41a3c5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:04.046243 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-b69fc488-72f1-4b85-a4cb-ebaa41a3c5c3 None None] MFA Rules not processed for user `1f03aa520ee14615b802cdbc3cd4f87d`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:04.047753 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b69fc488-72f1-4b85-a4cb-ebaa41a3c5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:04.075007 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9078a0e-c656-4034-b65d-ae225661a7b3 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:04.075630 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9078a0e-c656-4034-b65d-ae225661a7b3 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:04.076620 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9078a0e-c656-4034-b65d-ae225661a7b3 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:04.078904 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 826/1644] 10.222.0.24 () {54 vars in 912 bytes} [Mon May 16 19:08:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:08:04.085826 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada23130-b4cc-4338-9800-39cf3f28d89b None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:04.086378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada23130-b4cc-4338-9800-39cf3f28d89b None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:04.086823 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada23130-b4cc-4338-9800-39cf3f28d89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:04.090032 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 819/1645] 10.222.0.24 () {58 vars in 1058 bytes} [Mon May 16 19:08:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:04.111643 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-ada23130-b4cc-4338-9800-39cf3f28d89b None None] MFA Rules not processed for user `1f03aa520ee14615b802cdbc3cd4f87d`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:04.113357 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-ada23130-b4cc-4338-9800-39cf3f28d89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:04.153167 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 827/1646] 10.222.0.24 () {58 vars in 1009 bytes} [Mon May 16 19:08:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:08:04.168101 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fc488-72f1-4b85-a4cb-ebaa41a3c5c3 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:04.169945 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b69fc488-72f1-4b85-a4cb-ebaa41a3c5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:04.243440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dbe26f-4c74-43bf-b0f7-f32423ddd8fe None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:04.243612 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dbe26f-4c74-43bf-b0f7-f32423ddd8fe None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:04.243871 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dbe26f-4c74-43bf-b0f7-f32423ddd8fe None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:04.245719 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 828/1647] 10.222.0.24 () {54 vars in 912 bytes} [Mon May 16 19:08:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 19:08:04.252261 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0642583-5973-4790-95f0-76de2c762ee3 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:04.253628 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0642583-5973-4790-95f0-76de2c762ee3 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:04.254100 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0642583-5973-4790-95f0-76de2c762ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:04.277100 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-f0642583-5973-4790-95f0-76de2c762ee3 None None] MFA Rules not processed for user `1f03aa520ee14615b802cdbc3cd4f87d`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:04.279180 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f0642583-5973-4790-95f0-76de2c762ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:04.294295 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 829/1648] 10.222.0.24 () {58 vars in 1009 bytes} [Mon May 16 19:08:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:08:04.311260 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fc488-72f1-4b85-a4cb-ebaa41a3c5c3 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:04.313565 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0642583-5973-4790-95f0-76de2c762ee3 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:04.315431 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f0642583-5973-4790-95f0-76de2c762ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:04.324102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ebae8-5b82-4744-9a3b-84b5105233a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:04.324859 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ebae8-5b82-4744-9a3b-84b5105233a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:04.325039 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ebae8-5b82-4744-9a3b-84b5105233a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:04.325306 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ebae8-5b82-4744-9a3b-84b5105233a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:04.350781 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ebae8-5b82-4744-9a3b-84b5105233a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:04.353980 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ebae8-5b82-4744-9a3b-84b5105233a7 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:04.383544 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 820/1649] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:08:04.449017 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0642583-5973-4790-95f0-76de2c762ee3 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:04.457220 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa98291-2f91-4e6e-bc5a-d0593a8e9586 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dfa8e8908804c0e8908e2a8c6b377e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:04.458649 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa98291-2f91-4e6e-bc5a-d0593a8e9586 service glance] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:04.459961 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa98291-2f91-4e6e-bc5a-d0593a8e9586 service glance] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:04.461087 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa98291-2f91-4e6e-bc5a-d0593a8e9586 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:04.486375 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa98291-2f91-4e6e-bc5a-d0593a8e9586 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:04.489205 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa98291-2f91-4e6e-bc5a-d0593a8e9586 service glance] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:04.507717 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ebae8-5b82-4744-9a3b-84b5105233a7 service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:04.509353 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b44ebae8-5b82-4744-9a3b-84b5105233a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:04.532281 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 830/1650] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:08:04.533778 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ebae8-5b82-4744-9a3b-84b5105233a7 service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:04.548836 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2bfb7-0a2b-4400-8c36-2393076a53a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:04.552691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2bfb7-0a2b-4400-8c36-2393076a53a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:04.552994 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2bfb7-0a2b-4400-8c36-2393076a53a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:04.553279 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2bfb7-0a2b-4400-8c36-2393076a53a7 admin admin] PATH_INFO: `/v3/projects/2d18856aecf24e25a922f8defce40ea1` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:04.557270 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2bfb7-0a2b-4400-8c36-2393076a53a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d18856aecf24e25a922f8defce40ea1)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:04.599938 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2bfb7-0a2b-4400-8c36-2393076a53a7 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:04.698590 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-bce2bfb7-0a2b-4400-8c36-2393076a53a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d18856aecf24e25a922f8defce40ea1', 'request_id': 'req-bce2bfb7-0a2b-4400-8c36-2393076a53a7'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:04.719106 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-bce2bfb7-0a2b-4400-8c36-2393076a53a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d18856aecf24e25a922f8defce40ea1', 'request_id': 'req-bce2bfb7-0a2b-4400-8c36-2393076a53a7'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:04.730097 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-bce2bfb7-0a2b-4400-8c36-2393076a53a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d18856aecf24e25a922f8defce40ea1', 'request_id': 'req-bce2bfb7-0a2b-4400-8c36-2393076a53a7'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:04.755144 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-bce2bfb7-0a2b-4400-8c36-2393076a53a7 admin admin] The token cache is being invalidate because project 2d18856aecf24e25a922f8defce40ea1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:08:04.756914 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-bce2bfb7-0a2b-4400-8c36-2393076a53a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:04.759461 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-bce2bfb7-0a2b-4400-8c36-2393076a53a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:04.765993 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 821/1651] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:08:04 2022] DELETE /identity/v3/projects/2d18856aecf24e25a922f8defce40ea1 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:08:04.767257 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa98291-2f91-4e6e-bc5a-d0593a8e9586 service glance] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:04.786223 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa98291-2f91-4e6e-bc5a-d0593a8e9586 service glance] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:04.913675 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d50590-bb24-49a6-8066-ea461312dfa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:04.914643 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d50590-bb24-49a6-8066-ea461312dfa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:04.914931 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d50590-bb24-49a6-8066-ea461312dfa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:04.915208 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d50590-bb24-49a6-8066-ea461312dfa7 admin admin] PATH_INFO: `/v3/users/5eedb8f3420e4782ad897fab5b0a0f7c` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:04.918723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d50590-bb24-49a6-8066-ea461312dfa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eedb8f3420e4782ad897fab5b0a0f7c)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:04.923861 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d50590-bb24-49a6-8066-ea461312dfa7 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:05.039539 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f1d50590-bb24-49a6-8066-ea461312dfa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eedb8f3420e4782ad897fab5b0a0f7c'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:05.063970 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f1d50590-bb24-49a6-8066-ea461312dfa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eedb8f3420e4782ad897fab5b0a0f7c'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:05.071718 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f1d50590-bb24-49a6-8066-ea461312dfa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eedb8f3420e4782ad897fab5b0a0f7c'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:05.073326 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f1d50590-bb24-49a6-8066-ea461312dfa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eedb8f3420e4782ad897fab5b0a0f7c'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:05.111468 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f1d50590-bb24-49a6-8066-ea461312dfa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eedb8f3420e4782ad897fab5b0a0f7c'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:05.125468 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 831/1652] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:08:04 2022] DELETE /identity/v3/users/5eedb8f3420e4782ad897fab5b0a0f7c => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:05.717174 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b8348-5b9a-402a-bd0a-a25f95c571f3 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:05.717997 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b8348-5b9a-402a-bd0a-a25f95c571f3 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:05.718279 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b8348-5b9a-402a-bd0a-a25f95c571f3 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:05.719955 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 822/1653] 10.222.0.24 () {54 vars in 912 bytes} [Mon May 16 19:08:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:08:05.728625 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacd886-e405-4d92-be4b-9dd329ec70e2 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:05.728908 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacd886-e405-4d92-be4b-9dd329ec70e2 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:05.729173 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacd886-e405-4d92-be4b-9dd329ec70e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:05.768321 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-0dacd886-e405-4d92-be4b-9dd329ec70e2 None None] MFA Rules not processed for user `ee9e8d17cf1648e0b650df48b8f9487a`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:05.769619 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-0dacd886-e405-4d92-be4b-9dd329ec70e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:05.912474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 832/1654] 10.222.0.24 () {58 vars in 1009 bytes} [Mon May 16 19:08:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:06.005833 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b8348-5b9a-402a-bd0a-a25f95c571f3 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:06.008371 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2e1b8348-5b9a-402a-bd0a-a25f95c571f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:06.046259 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b8348-5b9a-402a-bd0a-a25f95c571f3 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:06.059847 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2dfd7-2ee1-4f44-a400-07e15164dc5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:06.068956 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2dfd7-2ee1-4f44-a400-07e15164dc5c service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:06.072021 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2dfd7-2ee1-4f44-a400-07e15164dc5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:06.072860 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2dfd7-2ee1-4f44-a400-07e15164dc5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:06.126080 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2dfd7-2ee1-4f44-a400-07e15164dc5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:06.127559 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2dfd7-2ee1-4f44-a400-07e15164dc5c service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:06.145579 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dacd886-e405-4d92-be4b-9dd329ec70e2 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:06.147579 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-0dacd886-e405-4d92-be4b-9dd329ec70e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:06.176128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 823/1655] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:08:06.436208 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dacd886-e405-4d92-be4b-9dd329ec70e2 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:06.469915 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36efab-f4c7-40f5-92bb-63f3f6fc933b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:06.470904 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36efab-f4c7-40f5-92bb-63f3f6fc933b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:06.475926 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36efab-f4c7-40f5-92bb-63f3f6fc933b admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:06.477010 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36efab-f4c7-40f5-92bb-63f3f6fc933b admin admin] PATH_INFO: `/v3/projects/13c79ec718a344acb4480711d6d1e34b` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:06.488091 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de36efab-f4c7-40f5-92bb-63f3f6fc933b admin admin] RBAC: Authorizing `identity:delete_project(project_id=13c79ec718a344acb4480711d6d1e34b)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:06.492119 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: WARNING py.warnings [None req-de36efab-f4c7-40f5-92bb-63f3f6fc933b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 19:08:06.492119 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: warnings.warn(msg) May 16 19:08:06.492119 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: May 16 19:08:06.500452 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de36efab-f4c7-40f5-92bb-63f3f6fc933b admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:06.675271 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-de36efab-f4c7-40f5-92bb-63f3f6fc933b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13c79ec718a344acb4480711d6d1e34b', 'request_id': 'req-de36efab-f4c7-40f5-92bb-63f3f6fc933b'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:06.716121 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-de36efab-f4c7-40f5-92bb-63f3f6fc933b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13c79ec718a344acb4480711d6d1e34b', 'request_id': 'req-de36efab-f4c7-40f5-92bb-63f3f6fc933b'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:06.803747 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-de36efab-f4c7-40f5-92bb-63f3f6fc933b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13c79ec718a344acb4480711d6d1e34b', 'request_id': 'req-de36efab-f4c7-40f5-92bb-63f3f6fc933b'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:06.842873 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-de36efab-f4c7-40f5-92bb-63f3f6fc933b admin admin] The token cache is being invalidate because project 13c79ec718a344acb4480711d6d1e34b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:08:06.844535 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-de36efab-f4c7-40f5-92bb-63f3f6fc933b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:06.845662 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-de36efab-f4c7-40f5-92bb-63f3f6fc933b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:06.852097 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 833/1656] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:08:06 2022] DELETE /identity/v3/projects/13c79ec718a344acb4480711d6d1e34b => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:08:06.857234 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8d365-93e0-47db-930c-3dfad1d5b690 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:06.858559 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8d365-93e0-47db-930c-3dfad1d5b690 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:06.859282 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8d365-93e0-47db-930c-3dfad1d5b690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:06.898730 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-50d8d365-93e0-47db-930c-3dfad1d5b690 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:06.899990 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-50d8d365-93e0-47db-930c-3dfad1d5b690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:07.083964 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b12ebf-70e4-452d-aaf9-ea53689985cd None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:07.083964 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b12ebf-70e4-452d-aaf9-ea53689985cd None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:07.084206 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b12ebf-70e4-452d-aaf9-ea53689985cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:07.110577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 824/1657] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:07.143347 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-61b12ebf-70e4-452d-aaf9-ea53689985cd None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:07.148022 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-61b12ebf-70e4-452d-aaf9-ea53689985cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:07.173270 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 834/1658] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:07.177790 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8d365-93e0-47db-930c-3dfad1d5b690 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:07.191339 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8d365-93e0-47db-930c-3dfad1d5b690 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:07.220133 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0178f81-755e-4340-a927-3362c16063d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:07.222971 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0178f81-755e-4340-a927-3362c16063d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:07.223472 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0178f81-755e-4340-a927-3362c16063d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:07.223940 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0178f81-755e-4340-a927-3362c16063d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:07.225725 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0178f81-755e-4340-a927-3362c16063d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:08:07.226362 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0178f81-755e-4340-a927-3362c16063d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:07.228527 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0178f81-755e-4340-a927-3362c16063d7 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:07.267592 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 825/1659] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:08:07.271896 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b12ebf-70e4-452d-aaf9-ea53689985cd None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:07.289958 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b12ebf-70e4-452d-aaf9-ea53689985cd None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:07.310428 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766b8b2-aca4-46d7-b3eb-eb8a05cbe8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:07.311426 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766b8b2-aca4-46d7-b3eb-eb8a05cbe8e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:07.318144 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766b8b2-aca4-46d7-b3eb-eb8a05cbe8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:07.318651 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766b8b2-aca4-46d7-b3eb-eb8a05cbe8e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:07.319545 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9766b8b2-aca4-46d7-b3eb-eb8a05cbe8e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:07.322686 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9766b8b2-aca4-46d7-b3eb-eb8a05cbe8e9 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:07.429381 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 835/1660] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:08:07 2022] POST /identity/v3/projects => generated 365 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:08:07.433290 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0178f81-755e-4340-a927-3362c16063d7 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:07.470022 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0178f81-755e-4340-a927-3362c16063d7 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:07.575303 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d4ace-c048-4568-8532-a94ea5249ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:07.576881 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d4ace-c048-4568-8532-a94ea5249ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:07.580145 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d4ace-c048-4568-8532-a94ea5249ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:07.580649 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d4ace-c048-4568-8532-a94ea5249ca5 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:07.582704 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d4ace-c048-4568-8532-a94ea5249ca5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:07.585931 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d4ace-c048-4568-8532-a94ea5249ca5 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:07.653711 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 826/1661] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:08:07 2022] POST /identity/v3/users => generated 283 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:08:07.658998 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766b8b2-aca4-46d7-b3eb-eb8a05cbe8e9 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:07.693697 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766b8b2-aca4-46d7-b3eb-eb8a05cbe8e9 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:07.700606 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc8ba6d-dd9e-4b7b-b630-ec7e38e1faa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:07.701566 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8ba6d-dd9e-4b7b-b630-ec7e38e1faa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:07.702334 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8ba6d-dd9e-4b7b-b630-ec7e38e1faa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:07.702909 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8ba6d-dd9e-4b7b-b630-ec7e38e1faa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:07.703658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc8ba6d-dd9e-4b7b-b630-ec7e38e1faa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:07.705327 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc8ba6d-dd9e-4b7b-b630-ec7e38e1faa5 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:07.722953 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 836/1662] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:08:07.730414 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d4ace-c048-4568-8532-a94ea5249ca5 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:07.741647 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d4ace-c048-4568-8532-a94ea5249ca5 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:07.760257 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a039a3-0b25-4e11-97d4-96bc7d94eefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:07.761182 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a039a3-0b25-4e11-97d4-96bc7d94eefb admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:07.761574 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a039a3-0b25-4e11-97d4-96bc7d94eefb admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:07.761948 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a039a3-0b25-4e11-97d4-96bc7d94eefb admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:07.762796 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a039a3-0b25-4e11-97d4-96bc7d94eefb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:07.767084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a039a3-0b25-4e11-97d4-96bc7d94eefb admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:07.791021 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 827/1663] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:08:07.795731 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc8ba6d-dd9e-4b7b-b630-ec7e38e1faa5 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:07.815316 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc8ba6d-dd9e-4b7b-b630-ec7e38e1faa5 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:07.823272 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15abe799-f732-4575-8ab3-db107a02674c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:07.824285 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abe799-f732-4575-8ab3-db107a02674c admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:07.824565 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abe799-f732-4575-8ab3-db107a02674c admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:07.824837 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abe799-f732-4575-8ab3-db107a02674c admin admin] PATH_INFO: `/v3/projects/3ff1eb2e4a2c4fea9216e735035fc47f/users/5492947c8cd146089b5891aa9e20e871/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:07.845215 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15abe799-f732-4575-8ab3-db107a02674c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ff1eb2e4a2c4fea9216e735035fc47f, user_id=5492947c8cd146089b5891aa9e20e871, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:07.850722 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15abe799-f732-4575-8ab3-db107a02674c admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:07.901751 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 837/1664] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:08:07 2022] PUT /identity/v3/projects/3ff1eb2e4a2c4fea9216e735035fc47f/users/5492947c8cd146089b5891aa9e20e871/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:07.902694 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef5eaa-43df-485d-843c-6d99fd3ba19f None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:07.903155 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef5eaa-43df-485d-843c-6d99fd3ba19f None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:07.903419 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef5eaa-43df-485d-843c-6d99fd3ba19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:07.958447 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-fcef5eaa-43df-485d-843c-6d99fd3ba19f None None] MFA Rules not processed for user `5492947c8cd146089b5891aa9e20e871`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:07.962178 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-fcef5eaa-43df-485d-843c-6d99fd3ba19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:08.126683 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15abe799-f732-4575-8ab3-db107a02674c admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:08.127107 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 828/1665] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:07 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:08:08.349608 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15abe799-f732-4575-8ab3-db107a02674c admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:08.359881 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d396341-fbd4-421f-94ee-d5f4623bda6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:08.360577 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d396341-fbd4-421f-94ee-d5f4623bda6b admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:08.360859 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d396341-fbd4-421f-94ee-d5f4623bda6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:08.361274 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d396341-fbd4-421f-94ee-d5f4623bda6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:08.362042 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d396341-fbd4-421f-94ee-d5f4623bda6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:08.363930 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d396341-fbd4-421f-94ee-d5f4623bda6b admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:08.460498 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 838/1666] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:08:08 2022] POST /identity/v3/projects => generated 363 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:08:08.464712 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef5eaa-43df-485d-843c-6d99fd3ba19f None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:08.480788 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef5eaa-43df-485d-843c-6d99fd3ba19f None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:08.693305 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9c895-eede-40af-b2cd-4c9952db0e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:08.694641 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9c895-eede-40af-b2cd-4c9952db0e77 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:08.694922 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9c895-eede-40af-b2cd-4c9952db0e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:08.695196 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9c895-eede-40af-b2cd-4c9952db0e77 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:08.695919 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9c895-eede-40af-b2cd-4c9952db0e77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:08.727283 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9c895-eede-40af-b2cd-4c9952db0e77 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:08.788323 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 829/1667] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:08:08 2022] POST /identity/v3/users => generated 288 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:08:08.788628 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d396341-fbd4-421f-94ee-d5f4623bda6b admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:08.807187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d396341-fbd4-421f-94ee-d5f4623bda6b admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:08.830517 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4496fae-4475-4707-a590-778fb59a314b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:08.831235 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4496fae-4475-4707-a590-778fb59a314b admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:08.831522 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4496fae-4475-4707-a590-778fb59a314b admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:08.831802 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4496fae-4475-4707-a590-778fb59a314b admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:08.832556 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4496fae-4475-4707-a590-778fb59a314b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:08.834399 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4496fae-4475-4707-a590-778fb59a314b admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:08.905793 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 839/1668] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:08:08.907739 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9c895-eede-40af-b2cd-4c9952db0e77 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:08.934852 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9c895-eede-40af-b2cd-4c9952db0e77 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:08.949183 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a1347-a0c3-4189-8d7b-a56516506966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:08.953953 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a1347-a0c3-4189-8d7b-a56516506966 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:08.954466 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a1347-a0c3-4189-8d7b-a56516506966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:08.957058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a1347-a0c3-4189-8d7b-a56516506966 admin admin] PATH_INFO: `/v3/projects/712b981d79f44c2a9ed2e7712ad99c44/users/5e469054aa1b47ab9eb209d21b587068/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:08.999210 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a1347-a0c3-4189-8d7b-a56516506966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=712b981d79f44c2a9ed2e7712ad99c44, user_id=5e469054aa1b47ab9eb209d21b587068, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:09.002517 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a1347-a0c3-4189-8d7b-a56516506966 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:09.040294 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 830/1669] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:08:08 2022] PUT /identity/v3/projects/712b981d79f44c2a9ed2e7712ad99c44/users/5e469054aa1b47ab9eb209d21b587068/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:09.044202 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4496fae-4475-4707-a590-778fb59a314b admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:09.058440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4496fae-4475-4707-a590-778fb59a314b admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:09.362631 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e361b96-1307-4a4f-a09a-8513236a57ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:09.363783 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b362d96-8d96-4c88-a4d0-d96b94298c54 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:09.364236 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b362d96-8d96-4c88-a4d0-d96b94298c54 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:09.364698 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b362d96-8d96-4c88-a4d0-d96b94298c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:09.367018 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e361b96-1307-4a4f-a09a-8513236a57ea admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:09.367397 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e361b96-1307-4a4f-a09a-8513236a57ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:09.367749 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e361b96-1307-4a4f-a09a-8513236a57ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:09.369827 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e361b96-1307-4a4f-a09a-8513236a57ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:09.373183 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e361b96-1307-4a4f-a09a-8513236a57ea admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:09.398420 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 840/1670] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:08:09.402690 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e361b96-1307-4a4f-a09a-8513236a57ea admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:09.430547 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e361b96-1307-4a4f-a09a-8513236a57ea admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:09.446353 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-2b362d96-8d96-4c88-a4d0-d96b94298c54 None None] MFA Rules not processed for user `a7d2aea046214bfcbbe6d5b3581fc155`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:09.447730 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2b362d96-8d96-4c88-a4d0-d96b94298c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:09.448548 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d5d9b-ea4d-428a-8b46-82038257557b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:09.453882 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d5d9b-ea4d-428a-8b46-82038257557b admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:09.454170 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d5d9b-ea4d-428a-8b46-82038257557b admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:09.454449 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d5d9b-ea4d-428a-8b46-82038257557b admin admin] PATH_INFO: `/v3/projects/712b981d79f44c2a9ed2e7712ad99c44/users/5e469054aa1b47ab9eb209d21b587068/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:09.478448 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d5d9b-ea4d-428a-8b46-82038257557b admin admin] RBAC: Authorizing `identity:create_grant(project_id=712b981d79f44c2a9ed2e7712ad99c44, user_id=5e469054aa1b47ab9eb209d21b587068, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:09.484950 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d5d9b-ea4d-428a-8b46-82038257557b admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:09.549597 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 841/1671] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:08:09 2022] PUT /identity/v3/projects/712b981d79f44c2a9ed2e7712ad99c44/users/5e469054aa1b47ab9eb209d21b587068/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:09.562842 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197156d-e03e-4d05-9735-347a023559d2 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:09.563458 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197156d-e03e-4d05-9735-347a023559d2 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:09.564435 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197156d-e03e-4d05-9735-347a023559d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:09.703548 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-d197156d-e03e-4d05-9735-347a023559d2 None None] MFA Rules not processed for user `5e469054aa1b47ab9eb209d21b587068`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:09.704810 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-d197156d-e03e-4d05-9735-347a023559d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:09.747211 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 831/1672] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:08:09.747211 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920565d-9949-4eca-a133-a03cc8261c62 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:09.747211 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920565d-9949-4eca-a133-a03cc8261c62 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:09.747211 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920565d-9949-4eca-a133-a03cc8261c62 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:09.747211 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 832/1673] 10.222.0.24 () {54 vars in 960 bytes} [Mon May 16 19:08:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:08:09.758972 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e88d82-7754-417d-aab2-b0ef9be5a5d5 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:09.759269 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e88d82-7754-417d-aab2-b0ef9be5a5d5 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:09.759552 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e88d82-7754-417d-aab2-b0ef9be5a5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:09.786927 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-13e88d82-7754-417d-aab2-b0ef9be5a5d5 None None] MFA Rules not processed for user `629742b135b2447898e8291d9a360295`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:09.788318 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-13e88d82-7754-417d-aab2-b0ef9be5a5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:09.906812 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 842/1674] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:09 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:09.911256 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197156d-e03e-4d05-9735-347a023559d2 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:09.920079 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-d197156d-e03e-4d05-9735-347a023559d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:09.930079 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 833/1675] 10.222.0.24 () {58 vars in 1057 bytes} [Mon May 16 19:08:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:09.932369 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e88d82-7754-417d-aab2-b0ef9be5a5d5 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:09.934499 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-13e88d82-7754-417d-aab2-b0ef9be5a5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:10.097497 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197156d-e03e-4d05-9735-347a023559d2 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:10.107722 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1eca84-9cc6-4491-b2d0-630ec83460fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:10.108759 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1eca84-9cc6-4491-b2d0-630ec83460fa service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:10.109310 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1eca84-9cc6-4491-b2d0-630ec83460fa service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:10.109827 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1eca84-9cc6-4491-b2d0-630ec83460fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:10.143587 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e88d82-7754-417d-aab2-b0ef9be5a5d5 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:10.153053 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf05a11-743c-49e3-a5c5-54dd11d6dbbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:10.154585 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf05a11-743c-49e3-a5c5-54dd11d6dbbf service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:10.155351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf05a11-743c-49e3-a5c5-54dd11d6dbbf service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:10.156162 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf05a11-743c-49e3-a5c5-54dd11d6dbbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:10.177310 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf05a11-743c-49e3-a5c5-54dd11d6dbbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:10.178976 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf05a11-743c-49e3-a5c5-54dd11d6dbbf service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:10.192998 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 834/1676] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:09 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:08:10.194670 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf05a11-743c-49e3-a5c5-54dd11d6dbbf service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:10.195417 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1eca84-9cc6-4491-b2d0-630ec83460fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:10.197323 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1eca84-9cc6-4491-b2d0-630ec83460fa service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:10.212755 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf05a11-743c-49e3-a5c5-54dd11d6dbbf service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:10.214531 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 843/1677] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 19:08:10.218841 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b3e69-da7f-4e85-b8ec-cf32798f19e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '629742b135b2447898e8291d9a360295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:10.219633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b3e69-da7f-4e85-b8ec-cf32798f19e3 service placement] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:10.220029 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b3e69-da7f-4e85-b8ec-cf32798f19e3 service placement] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:10.220400 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b3e69-da7f-4e85-b8ec-cf32798f19e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:10.222374 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f42b3e69-da7f-4e85-b8ec-cf32798f19e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:10.235338 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b3e69-da7f-4e85-b8ec-cf32798f19e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:10.237520 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b3e69-da7f-4e85-b8ec-cf32798f19e3 service placement] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:10.258504 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 835/1678] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:08:10.364838 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1eca84-9cc6-4491-b2d0-630ec83460fa service nova] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:10.366435 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-fa1eca84-9cc6-4491-b2d0-630ec83460fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:10.383922 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1eca84-9cc6-4491-b2d0-630ec83460fa service nova] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:10.390129 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72dba4-2847-489d-bb43-d1987131d484 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:10.390911 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72dba4-2847-489d-bb43-d1987131d484 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:10.391206 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72dba4-2847-489d-bb43-d1987131d484 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:10.391469 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72dba4-2847-489d-bb43-d1987131d484 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:10.522182 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72dba4-2847-489d-bb43-d1987131d484 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:10.524012 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72dba4-2847-489d-bb43-d1987131d484 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:10.540551 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 844/1679] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:10 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:08:13.539830 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed60612-fe19-4c92-bbd2-4a0a2e3e8209 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:13.540318 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed60612-fe19-4c92-bbd2-4a0a2e3e8209 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:13.541234 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed60612-fe19-4c92-bbd2-4a0a2e3e8209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:13.662346 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-bed60612-fe19-4c92-bbd2-4a0a2e3e8209 None None] MFA Rules not processed for user `4775e9dd7aea448d95ec7378b4ff3124`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:13.665653 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-bed60612-fe19-4c92-bbd2-4a0a2e3e8209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:13.854157 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 836/1680] 10.222.0.24 () {58 vars in 1009 bytes} [Mon May 16 19:08:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:14.174333 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72dba4-2847-489d-bb43-d1987131d484 service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:14.176991 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-9b72dba4-2847-489d-bb43-d1987131d484 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:14.311259 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed60612-fe19-4c92-bbd2-4a0a2e3e8209 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:14.314150 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72dba4-2847-489d-bb43-d1987131d484 service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:14.328635 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb90df6-d3e0-451f-bab6-6e2647fc535e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '654e435a35c4491eb87943734ce280f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:14.329862 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb90df6-d3e0-451f-bab6-6e2647fc535e service swift] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:14.330357 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb90df6-d3e0-451f-bab6-6e2647fc535e service swift] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:14.330838 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb90df6-d3e0-451f-bab6-6e2647fc535e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:14.346655 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb90df6-d3e0-451f-bab6-6e2647fc535e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:14.351918 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb90df6-d3e0-451f-bab6-6e2647fc535e service swift] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:14.372088 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 845/1681] 10.222.0.24 () {60 vars in 1384 bytes} [Mon May 16 19:08:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 19:08:14.450875 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd407fb-eae6-45a5-ac62-5ec13d99fc07 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:14.451739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd407fb-eae6-45a5-ac62-5ec13d99fc07 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:14.453578 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd407fb-eae6-45a5-ac62-5ec13d99fc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:14.533806 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-fdd407fb-eae6-45a5-ac62-5ec13d99fc07 None None] MFA Rules not processed for user `a7d2aea046214bfcbbe6d5b3581fc155`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:14.540450 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed60612-fe19-4c92-bbd2-4a0a2e3e8209 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:14.550627 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-fdd407fb-eae6-45a5-ac62-5ec13d99fc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:14.554357 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e40b4d-4de1-4ffa-9e76-04a6037efbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:14.555501 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e40b4d-4de1-4ffa-9e76-04a6037efbd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:14.555990 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e40b4d-4de1-4ffa-9e76-04a6037efbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:14.556491 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e40b4d-4de1-4ffa-9e76-04a6037efbd3 admin admin] PATH_INFO: `/v3/users/5492947c8cd146089b5891aa9e20e871` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:14.558158 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e40b4d-4de1-4ffa-9e76-04a6037efbd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5492947c8cd146089b5891aa9e20e871)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:14.559452 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: WARNING py.warnings [None req-11e40b4d-4de1-4ffa-9e76-04a6037efbd3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 19:08:14.559452 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: warnings.warn(msg) May 16 19:08:14.559452 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: May 16 19:08:14.561150 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e40b4d-4de1-4ffa-9e76-04a6037efbd3 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:14.597719 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 846/1682] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:14.597719 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd407fb-eae6-45a5-ac62-5ec13d99fc07 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:14.599412 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-fdd407fb-eae6-45a5-ac62-5ec13d99fc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:14.630746 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd407fb-eae6-45a5-ac62-5ec13d99fc07 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:14.643042 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bac4b-7054-4189-b99b-4a5435b20367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:14.644176 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bac4b-7054-4189-b99b-4a5435b20367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:14.644545 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bac4b-7054-4189-b99b-4a5435b20367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:14.644825 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bac4b-7054-4189-b99b-4a5435b20367 admin admin] PATH_INFO: `/v3/users/44e4283ec17a4ae78bd06ceed2db7a9f` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:14.651525 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6bac4b-7054-4189-b99b-4a5435b20367 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44e4283ec17a4ae78bd06ceed2db7a9f)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:14.662377 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6bac4b-7054-4189-b99b-4a5435b20367 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:14.793610 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-11e40b4d-4de1-4ffa-9e76-04a6037efbd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5492947c8cd146089b5891aa9e20e871'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:14.847381 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-11e40b4d-4de1-4ffa-9e76-04a6037efbd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5492947c8cd146089b5891aa9e20e871'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:14.878935 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-11e40b4d-4de1-4ffa-9e76-04a6037efbd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5492947c8cd146089b5891aa9e20e871'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:14.951135 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-11e40b4d-4de1-4ffa-9e76-04a6037efbd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5492947c8cd146089b5891aa9e20e871'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:14.954000 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-11e40b4d-4de1-4ffa-9e76-04a6037efbd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5492947c8cd146089b5891aa9e20e871'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:14.958584 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ee6bac4b-7054-4189-b99b-4a5435b20367 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44e4283ec17a4ae78bd06ceed2db7a9f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:14.974633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 837/1683] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:08:14 2022] DELETE /identity/v3/users/5492947c8cd146089b5891aa9e20e871 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:14.976877 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd21e9-16f1-4fc4-979c-fe4def72812f None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:14.978328 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd21e9-16f1-4fc4-979c-fe4def72812f None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:14.983732 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd21e9-16f1-4fc4-979c-fe4def72812f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:15.007010 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ee6bac4b-7054-4189-b99b-4a5435b20367 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44e4283ec17a4ae78bd06ceed2db7a9f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:15.055061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ee6bac4b-7054-4189-b99b-4a5435b20367 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44e4283ec17a4ae78bd06ceed2db7a9f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:15.059206 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ee6bac4b-7054-4189-b99b-4a5435b20367 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44e4283ec17a4ae78bd06ceed2db7a9f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:15.099153 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-b4cd21e9-16f1-4fc4-979c-fe4def72812f None None] MFA Rules not processed for user `661228875e4d4c60a558656b46ea650b`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:15.112129 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b4cd21e9-16f1-4fc4-979c-fe4def72812f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:15.143020 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ee6bac4b-7054-4189-b99b-4a5435b20367 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44e4283ec17a4ae78bd06ceed2db7a9f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:15.151249 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 847/1684] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:08:14 2022] DELETE /identity/v3/users/44e4283ec17a4ae78bd06ceed2db7a9f => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:15.152860 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1346f-6310-4769-81de-5940fb31c901 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:15.153351 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1346f-6310-4769-81de-5940fb31c901 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:15.153945 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1346f-6310-4769-81de-5940fb31c901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:15.210657 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-44b1346f-6310-4769-81de-5940fb31c901 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:15.212712 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-44b1346f-6310-4769-81de-5940fb31c901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:15.402167 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 848/1685] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:15.403749 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd451e-b8a8-4219-8b85-1f2e62848e7f None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:15.412111 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd451e-b8a8-4219-8b85-1f2e62848e7f None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:15.412722 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd451e-b8a8-4219-8b85-1f2e62848e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:15.421282 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 838/1686] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 446 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:15.441928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd21e9-16f1-4fc4-979c-fe4def72812f None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:15.441928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b4cd21e9-16f1-4fc4-979c-fe4def72812f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:15.515815 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-aebd451e-b8a8-4219-8b85-1f2e62848e7f None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:15.515815 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-aebd451e-b8a8-4219-8b85-1f2e62848e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:15.573935 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 849/1687] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:15.582892 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd451e-b8a8-4219-8b85-1f2e62848e7f None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:15.595159 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-aebd451e-b8a8-4219-8b85-1f2e62848e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:15.809521 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd21e9-16f1-4fc4-979c-fe4def72812f None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:16.083166 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd451e-b8a8-4219-8b85-1f2e62848e7f None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:16.106711 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5bdf65-8a74-4c6d-8049-a0a64b7024ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:16.110894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716dc29-0277-494d-83ef-01d25e2a3d85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:16.112074 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716dc29-0277-494d-83ef-01d25e2a3d85 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:16.113937 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716dc29-0277-494d-83ef-01d25e2a3d85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:16.114387 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716dc29-0277-494d-83ef-01d25e2a3d85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:16.118712 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5bdf65-8a74-4c6d-8049-a0a64b7024ab service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:16.121293 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5bdf65-8a74-4c6d-8049-a0a64b7024ab service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:16.121628 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5bdf65-8a74-4c6d-8049-a0a64b7024ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:16.148957 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3716dc29-0277-494d-83ef-01d25e2a3d85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:16.150905 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3716dc29-0277-494d-83ef-01d25e2a3d85 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:16.176865 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 839/1688] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 741 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:08:16.182742 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716dc29-0277-494d-83ef-01d25e2a3d85 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:16.185141 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3716dc29-0277-494d-83ef-01d25e2a3d85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:16.230402 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716dc29-0277-494d-83ef-01d25e2a3d85 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:16.259641 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8dc9f-0e39-43f3-85cb-1b290e494049 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:16.260617 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8dc9f-0e39-43f3-85cb-1b290e494049 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:16.261130 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8dc9f-0e39-43f3-85cb-1b290e494049 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:16.261599 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8dc9f-0e39-43f3-85cb-1b290e494049 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:16.277260 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8dc9f-0e39-43f3-85cb-1b290e494049 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:16.280183 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8dc9f-0e39-43f3-85cb-1b290e494049 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:16.296418 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 840/1689] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:08:16.420888 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5bdf65-8a74-4c6d-8049-a0a64b7024ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:16.426348 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5bdf65-8a74-4c6d-8049-a0a64b7024ab service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:16.472871 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 850/1690] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 898 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:08:18.149252 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8dc9f-0e39-43f3-85cb-1b290e494049 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:18.151553 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a1d8dc9f-0e39-43f3-85cb-1b290e494049 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:18.175109 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8dc9f-0e39-43f3-85cb-1b290e494049 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:18.197997 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34953de3-d99a-4559-ac9d-d6864a64749a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:18.201266 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34953de3-d99a-4559-ac9d-d6864a64749a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:18.201858 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34953de3-d99a-4559-ac9d-d6864a64749a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:18.202388 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34953de3-d99a-4559-ac9d-d6864a64749a admin admin] PATH_INFO: `/v3/projects/f4deb4cba3c84184aa376704901213e7` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:18.203899 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34953de3-d99a-4559-ac9d-d6864a64749a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4deb4cba3c84184aa376704901213e7)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:18.206313 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34953de3-d99a-4559-ac9d-d6864a64749a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:18.417889 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-34953de3-d99a-4559-ac9d-d6864a64749a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4deb4cba3c84184aa376704901213e7', 'request_id': 'req-34953de3-d99a-4559-ac9d-d6864a64749a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:18.449782 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-34953de3-d99a-4559-ac9d-d6864a64749a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4deb4cba3c84184aa376704901213e7', 'request_id': 'req-34953de3-d99a-4559-ac9d-d6864a64749a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:18.500233 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-34953de3-d99a-4559-ac9d-d6864a64749a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4deb4cba3c84184aa376704901213e7', 'request_id': 'req-34953de3-d99a-4559-ac9d-d6864a64749a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:18.560878 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-34953de3-d99a-4559-ac9d-d6864a64749a admin admin] The token cache is being invalidate because project f4deb4cba3c84184aa376704901213e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:08:18.561760 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-34953de3-d99a-4559-ac9d-d6864a64749a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:18.566641 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-34953de3-d99a-4559-ac9d-d6864a64749a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:18.581269 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 841/1691] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:08:18 2022] DELETE /identity/v3/projects/f4deb4cba3c84184aa376704901213e7 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:18.586302 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb6e29-c459-4dfe-a79a-a2a4fa6782d8 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:18.587134 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb6e29-c459-4dfe-a79a-a2a4fa6782d8 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:18.587693 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb6e29-c459-4dfe-a79a-a2a4fa6782d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:18.654083 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-2bdb6e29-c459-4dfe-a79a-a2a4fa6782d8 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:18.658690 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-2bdb6e29-c459-4dfe-a79a-a2a4fa6782d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:18.861352 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 851/1692] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:18.869657 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f486c33-628b-4054-af3f-fad6b2001ef7 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:18.871456 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f486c33-628b-4054-af3f-fad6b2001ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:18.872073 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f486c33-628b-4054-af3f-fad6b2001ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:18.942916 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-4f486c33-628b-4054-af3f-fad6b2001ef7 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:18.957238 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4f486c33-628b-4054-af3f-fad6b2001ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:19.004952 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 842/1693] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:19.008443 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb6e29-c459-4dfe-a79a-a2a4fa6782d8 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:19.026868 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb6e29-c459-4dfe-a79a-a2a4fa6782d8 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:19.048658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20252b-f22b-40cc-b33c-c0f3efa5e84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:19.051286 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20252b-f22b-40cc-b33c-c0f3efa5e84b admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:19.052251 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20252b-f22b-40cc-b33c-c0f3efa5e84b admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:19.052758 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20252b-f22b-40cc-b33c-c0f3efa5e84b admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:19.054058 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20252b-f22b-40cc-b33c-c0f3efa5e84b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:08:19.054523 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20252b-f22b-40cc-b33c-c0f3efa5e84b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:19.067786 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20252b-f22b-40cc-b33c-c0f3efa5e84b admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:19.096251 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 852/1694] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:08:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:08:19.097997 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f486c33-628b-4054-af3f-fad6b2001ef7 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:19.133958 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f486c33-628b-4054-af3f-fad6b2001ef7 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:19.157851 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cedb62-a2e4-41cd-90ff-4b8438a87892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:19.158599 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cedb62-a2e4-41cd-90ff-4b8438a87892 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:19.158824 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cedb62-a2e4-41cd-90ff-4b8438a87892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:19.170025 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cedb62-a2e4-41cd-90ff-4b8438a87892 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:19.175449 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cedb62-a2e4-41cd-90ff-4b8438a87892 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:19.182965 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cedb62-a2e4-41cd-90ff-4b8438a87892 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:19.313720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 843/1695] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:08:19 2022] POST /identity/v3/projects => generated 371 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:08:19.318117 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20252b-f22b-40cc-b33c-c0f3efa5e84b admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:19.340615 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20252b-f22b-40cc-b33c-c0f3efa5e84b admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:19.508418 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc4d37-6c9c-4e08-8079-8eb063ff073e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:19.509154 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc4d37-6c9c-4e08-8079-8eb063ff073e admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:19.509389 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc4d37-6c9c-4e08-8079-8eb063ff073e admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:19.509868 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc4d37-6c9c-4e08-8079-8eb063ff073e admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:19.510751 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc4d37-6c9c-4e08-8079-8eb063ff073e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:19.518314 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc4d37-6c9c-4e08-8079-8eb063ff073e admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:19.570643 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 853/1696] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:08:19 2022] POST /identity/v3/users => generated 286 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:08:19.573079 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cedb62-a2e4-41cd-90ff-4b8438a87892 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:19.593237 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cedb62-a2e4-41cd-90ff-4b8438a87892 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:19.613585 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4f617-0b76-4f7e-b2fa-d3c28765d4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:19.614332 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4f617-0b76-4f7e-b2fa-d3c28765d4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:19.615890 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4f617-0b76-4f7e-b2fa-d3c28765d4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:19.616344 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4f617-0b76-4f7e-b2fa-d3c28765d4c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:19.620755 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4f617-0b76-4f7e-b2fa-d3c28765d4c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:19.629148 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4f617-0b76-4f7e-b2fa-d3c28765d4c9 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:19.668202 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 844/1697] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 19:08:19.669676 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc4d37-6c9c-4e08-8079-8eb063ff073e admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:19.683872 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc4d37-6c9c-4e08-8079-8eb063ff073e admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:19.701441 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8b92d-5e46-45f0-928a-dfa437e58d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:19.702592 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8b92d-5e46-45f0-928a-dfa437e58d61 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:19.703380 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8b92d-5e46-45f0-928a-dfa437e58d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:19.704376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8b92d-5e46-45f0-928a-dfa437e58d61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:19.706884 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c8b92d-5e46-45f0-928a-dfa437e58d61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:19.712133 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c8b92d-5e46-45f0-928a-dfa437e58d61 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:19.752495 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 854/1698] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:08:19.752778 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4f617-0b76-4f7e-b2fa-d3c28765d4c9 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:19.772267 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4f617-0b76-4f7e-b2fa-d3c28765d4c9 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:19.788822 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93e0a9-70d5-4e2a-92f9-b99b3f4e5ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:19.790331 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93e0a9-70d5-4e2a-92f9-b99b3f4e5ad8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:19.790791 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93e0a9-70d5-4e2a-92f9-b99b3f4e5ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:19.793984 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93e0a9-70d5-4e2a-92f9-b99b3f4e5ad8 admin admin] PATH_INFO: `/v3/projects/ef4e4538396b4304b280b2a867b69d86/users/33efe1275b474b3da24bd0db02d9e389/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:19.833564 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93e0a9-70d5-4e2a-92f9-b99b3f4e5ad8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef4e4538396b4304b280b2a867b69d86, user_id=33efe1275b474b3da24bd0db02d9e389, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:19.841547 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93e0a9-70d5-4e2a-92f9-b99b3f4e5ad8 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:19.876583 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 845/1699] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:08:19 2022] PUT /identity/v3/projects/ef4e4538396b4304b280b2a867b69d86/users/33efe1275b474b3da24bd0db02d9e389/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:08:19.887370 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abe2c1-4903-4cda-bfd4-1a39fc04fb1a None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:19.887660 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abe2c1-4903-4cda-bfd4-1a39fc04fb1a None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:19.887917 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abe2c1-4903-4cda-bfd4-1a39fc04fb1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:19.915738 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93e0a9-70d5-4e2a-92f9-b99b3f4e5ad8 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:19.918671 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ba93e0a9-70d5-4e2a-92f9-b99b3f4e5ad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:19.950342 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-79abe2c1-4903-4cda-bfd4-1a39fc04fb1a None None] MFA Rules not processed for user `33efe1275b474b3da24bd0db02d9e389`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:19.951774 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-79abe2c1-4903-4cda-bfd4-1a39fc04fb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:20.077063 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93e0a9-70d5-4e2a-92f9-b99b3f4e5ad8 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:20.082985 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281f18e-f190-4a20-ab52-0c5ce99c38e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:20.084677 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281f18e-f190-4a20-ab52-0c5ce99c38e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:20.084977 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281f18e-f190-4a20-ab52-0c5ce99c38e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:20.085581 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281f18e-f190-4a20-ab52-0c5ce99c38e5 admin admin] PATH_INFO: `/v3/projects/3ff1eb2e4a2c4fea9216e735035fc47f` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:20.087155 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a281f18e-f190-4a20-ab52-0c5ce99c38e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ff1eb2e4a2c4fea9216e735035fc47f)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:20.089468 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a281f18e-f190-4a20-ab52-0c5ce99c38e5 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:20.135142 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 855/1700] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:20.145257 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be12986-340e-479c-b1af-b063b6fc395d None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:20.149098 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be12986-340e-479c-b1af-b063b6fc395d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:20.149339 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be12986-340e-479c-b1af-b063b6fc395d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:20.237752 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a281f18e-f190-4a20-ab52-0c5ce99c38e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ff1eb2e4a2c4fea9216e735035fc47f', 'request_id': 'req-a281f18e-f190-4a20-ab52-0c5ce99c38e5'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:20.262966 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a281f18e-f190-4a20-ab52-0c5ce99c38e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ff1eb2e4a2c4fea9216e735035fc47f', 'request_id': 'req-a281f18e-f190-4a20-ab52-0c5ce99c38e5'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:20.272799 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a281f18e-f190-4a20-ab52-0c5ce99c38e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ff1eb2e4a2c4fea9216e735035fc47f', 'request_id': 'req-a281f18e-f190-4a20-ab52-0c5ce99c38e5'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:20.278296 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-0be12986-340e-479c-b1af-b063b6fc395d None None] MFA Rules not processed for user `7d3af11e1ffc4ab1a37669f893d2f3be`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:20.284804 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-0be12986-340e-479c-b1af-b063b6fc395d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:20.292114 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a281f18e-f190-4a20-ab52-0c5ce99c38e5 admin admin] The token cache is being invalidate because project 3ff1eb2e4a2c4fea9216e735035fc47f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:08:20.292643 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a281f18e-f190-4a20-ab52-0c5ce99c38e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:20.293920 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a281f18e-f190-4a20-ab52-0c5ce99c38e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:20.303609 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 846/1701] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:08:19 2022] DELETE /identity/v3/projects/3ff1eb2e4a2c4fea9216e735035fc47f => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:20.305964 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281f18e-f190-4a20-ab52-0c5ce99c38e5 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:20.314455 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a281f18e-f190-4a20-ab52-0c5ce99c38e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:20.480140 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 856/1702] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:20.481597 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be12986-340e-479c-b1af-b063b6fc395d None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:20.484983 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-0be12986-340e-479c-b1af-b063b6fc395d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:20.559933 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281f18e-f190-4a20-ab52-0c5ce99c38e5 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:20.580765 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b97cb-6c93-41c6-a73e-a377ce4c4d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:20.581459 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b97cb-6c93-41c6-a73e-a377ce4c4d64 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:20.581901 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b97cb-6c93-41c6-a73e-a377ce4c4d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:20.582133 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b97cb-6c93-41c6-a73e-a377ce4c4d64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:20.582896 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b97cb-6c93-41c6-a73e-a377ce4c4d64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:20.584807 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b97cb-6c93-41c6-a73e-a377ce4c4d64 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:20.671233 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 847/1703] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:08:20 2022] POST /identity/v3/projects => generated 373 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:08:20.672141 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b97cb-6c93-41c6-a73e-a377ce4c4d64 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:20.675691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-760b97cb-6c93-41c6-a73e-a377ce4c4d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:20.684833 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be12986-340e-479c-b1af-b063b6fc395d None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:20.845463 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365221ca-4054-47b5-90ea-51461da7547a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:20.848416 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365221ca-4054-47b5-90ea-51461da7547a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:20.849270 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365221ca-4054-47b5-90ea-51461da7547a admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:20.849270 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365221ca-4054-47b5-90ea-51461da7547a admin admin] PATH_INFO: `/v3/users/5e469054aa1b47ab9eb209d21b587068` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:20.852361 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365221ca-4054-47b5-90ea-51461da7547a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e469054aa1b47ab9eb209d21b587068)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:20.868672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365221ca-4054-47b5-90ea-51461da7547a admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:20.894284 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b97cb-6c93-41c6-a73e-a377ce4c4d64 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:20.918400 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c10b27-b66b-465a-8b39-c265337a534a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:20.919362 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c10b27-b66b-465a-8b39-c265337a534a service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:20.919998 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c10b27-b66b-465a-8b39-c265337a534a service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:20.920429 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c10b27-b66b-465a-8b39-c265337a534a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:21.014755 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-365221ca-4054-47b5-90ea-51461da7547a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e469054aa1b47ab9eb209d21b587068'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:21.029250 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-365221ca-4054-47b5-90ea-51461da7547a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e469054aa1b47ab9eb209d21b587068'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:21.080816 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-365221ca-4054-47b5-90ea-51461da7547a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e469054aa1b47ab9eb209d21b587068'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:21.086119 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-365221ca-4054-47b5-90ea-51461da7547a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e469054aa1b47ab9eb209d21b587068'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:21.104204 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c10b27-b66b-465a-8b39-c265337a534a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:21.105885 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c10b27-b66b-465a-8b39-c265337a534a service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:21.124542 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-365221ca-4054-47b5-90ea-51461da7547a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e469054aa1b47ab9eb209d21b587068'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:21.143556 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 848/1704] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:08:21.144517 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c10b27-b66b-465a-8b39-c265337a534a service nova] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:21.151645 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 857/1705] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:08:20 2022] DELETE /identity/v3/users/5e469054aa1b47ab9eb209d21b587068 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:21.217654 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c10b27-b66b-465a-8b39-c265337a534a service nova] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:21.547288 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cadca5-3196-4d8f-82c5-9df0720dcf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:21.548276 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cadca5-3196-4d8f-82c5-9df0720dcf60 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:21.548492 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cadca5-3196-4d8f-82c5-9df0720dcf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:21.548763 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cadca5-3196-4d8f-82c5-9df0720dcf60 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:21.549594 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cadca5-3196-4d8f-82c5-9df0720dcf60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:21.551898 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cadca5-3196-4d8f-82c5-9df0720dcf60 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:21.594096 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 849/1706] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:08:21 2022] POST /identity/v3/users => generated 293 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:08:21.598296 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365221ca-4054-47b5-90ea-51461da7547a admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:21.604681 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-365221ca-4054-47b5-90ea-51461da7547a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:21.632370 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365221ca-4054-47b5-90ea-51461da7547a admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:21.641743 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70992ffb-0bba-4da0-b9ae-6d212c4b1a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:21.642067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70992ffb-0bba-4da0-b9ae-6d212c4b1a69 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:21.642218 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70992ffb-0bba-4da0-b9ae-6d212c4b1a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:21.642374 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70992ffb-0bba-4da0-b9ae-6d212c4b1a69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:21.645185 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70992ffb-0bba-4da0-b9ae-6d212c4b1a69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:21.648058 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70992ffb-0bba-4da0-b9ae-6d212c4b1a69 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:21.665855 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 858/1707] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:08:21.670928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cadca5-3196-4d8f-82c5-9df0720dcf60 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:21.691324 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cadca5-3196-4d8f-82c5-9df0720dcf60 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:21.703182 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed6943-c277-4d34-9ee0-7a755d5b57dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:21.703182 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed6943-c277-4d34-9ee0-7a755d5b57dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:21.703182 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed6943-c277-4d34-9ee0-7a755d5b57dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:21.703182 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed6943-c277-4d34-9ee0-7a755d5b57dc admin admin] PATH_INFO: `/v3/projects/4c0bdfbffe9e43aabe8468a23b075d65/users/114a35eeef824c269b3e9ff6861bd6cc/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:21.729486 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d11df5-6fee-4f54-8437-29ca4ee2966a None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:21.730062 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d11df5-6fee-4f54-8437-29ca4ee2966a None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:21.730803 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d11df5-6fee-4f54-8437-29ca4ee2966a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:21.734758 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed6943-c277-4d34-9ee0-7a755d5b57dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c0bdfbffe9e43aabe8468a23b075d65, user_id=114a35eeef824c269b3e9ff6861bd6cc, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:21.744913 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed6943-c277-4d34-9ee0-7a755d5b57dc admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:21.789873 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 850/1708] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:08:21 2022] PUT /identity/v3/projects/4c0bdfbffe9e43aabe8468a23b075d65/users/114a35eeef824c269b3e9ff6861bd6cc/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:21.794669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed6943-c277-4d34-9ee0-7a755d5b57dc admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:21.813096 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-a2d11df5-6fee-4f54-8437-29ca4ee2966a None None] MFA Rules not processed for user `ee9e8d17cf1648e0b650df48b8f9487a`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:21.815671 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a2d11df5-6fee-4f54-8437-29ca4ee2966a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:22.010755 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed6943-c277-4d34-9ee0-7a755d5b57dc admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:22.014968 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 859/1709] 10.222.0.49 () {58 vars in 1015 bytes} [Mon May 16 19:08:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:22.033068 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec747384-908b-4fb7-ac46-0463349f6ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:22.033863 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec747384-908b-4fb7-ac46-0463349f6ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:22.034518 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec747384-908b-4fb7-ac46-0463349f6ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:22.034793 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec747384-908b-4fb7-ac46-0463349f6ac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:22.036201 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec747384-908b-4fb7-ac46-0463349f6ac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:22.037879 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec747384-908b-4fb7-ac46-0463349f6ac8 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:22.058185 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d11df5-6fee-4f54-8437-29ca4ee2966a None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:22.082512 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 851/1710] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:08:22.087169 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d11df5-6fee-4f54-8437-29ca4ee2966a None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:22.092391 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa95c13-2826-47bf-abb3-00ef20dc1657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:22.093443 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa95c13-2826-47bf-abb3-00ef20dc1657 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:22.093906 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa95c13-2826-47bf-abb3-00ef20dc1657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:22.094277 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa95c13-2826-47bf-abb3-00ef20dc1657 admin admin] PATH_INFO: `/v3/projects/4c0bdfbffe9e43aabe8468a23b075d65/users/114a35eeef824c269b3e9ff6861bd6cc/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:22.096643 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa95c13-2826-47bf-abb3-00ef20dc1657 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c0bdfbffe9e43aabe8468a23b075d65, user_id=114a35eeef824c269b3e9ff6861bd6cc, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:22.115538 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa95c13-2826-47bf-abb3-00ef20dc1657 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:22.164839 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184c96a-965c-4acd-9979-f47a4d1a47b0 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:22.165348 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184c96a-965c-4acd-9979-f47a4d1a47b0 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:22.165775 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184c96a-965c-4acd-9979-f47a4d1a47b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:22.167463 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 860/1711] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:08:22 2022] PUT /identity/v3/projects/4c0bdfbffe9e43aabe8468a23b075d65/users/114a35eeef824c269b3e9ff6861bd6cc/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:22.204594 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa95c13-2826-47bf-abb3-00ef20dc1657 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:22.207527 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-4aa95c13-2826-47bf-abb3-00ef20dc1657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:22.283065 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-e184c96a-965c-4acd-9979-f47a4d1a47b0 None None] MFA Rules not processed for user `114a35eeef824c269b3e9ff6861bd6cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:22.286104 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e184c96a-965c-4acd-9979-f47a4d1a47b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:22.496196 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa95c13-2826-47bf-abb3-00ef20dc1657 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:22.498229 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 852/1712] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:22 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:22.499558 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184c96a-965c-4acd-9979-f47a4d1a47b0 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:22.500634 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e184c96a-965c-4acd-9979-f47a4d1a47b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:22.502006 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e8347-d1c8-4458-b72d-dfd94fe441a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:22.502796 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e8347-d1c8-4458-b72d-dfd94fe441a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:22.503220 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e8347-d1c8-4458-b72d-dfd94fe441a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:22.503805 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e8347-d1c8-4458-b72d-dfd94fe441a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:22.514140 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e8347-d1c8-4458-b72d-dfd94fe441a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:22.515837 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e8347-d1c8-4458-b72d-dfd94fe441a5 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:22.529975 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 861/1713] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 19:08:22.531296 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e8347-d1c8-4458-b72d-dfd94fe441a5 service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:22.532844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-ce0e8347-d1c8-4458-b72d-dfd94fe441a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:22.653571 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184c96a-965c-4acd-9979-f47a4d1a47b0 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:22.662020 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14ef74-537a-4066-9699-ecef0716a680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:22.664139 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14ef74-537a-4066-9699-ecef0716a680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:22.664717 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14ef74-537a-4066-9699-ecef0716a680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:22.670512 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14ef74-537a-4066-9699-ecef0716a680 admin admin] PATH_INFO: `/v3/projects/712b981d79f44c2a9ed2e7712ad99c44` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:22.672782 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14ef74-537a-4066-9699-ecef0716a680 admin admin] RBAC: Authorizing `identity:delete_project(project_id=712b981d79f44c2a9ed2e7712ad99c44)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:22.676101 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14ef74-537a-4066-9699-ecef0716a680 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:22.712064 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e8347-d1c8-4458-b72d-dfd94fe441a5 service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:22.721468 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577677e7-bf28-4620-90a8-d59f8e08a01a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:22.722226 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577677e7-bf28-4620-90a8-d59f8e08a01a service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:22.722769 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577677e7-bf28-4620-90a8-d59f8e08a01a service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:22.722769 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577677e7-bf28-4620-90a8-d59f8e08a01a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:22.758594 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577677e7-bf28-4620-90a8-d59f8e08a01a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:22.763954 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577677e7-bf28-4620-90a8-d59f8e08a01a service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:22.784527 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1a14ef74-537a-4066-9699-ecef0716a680 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '712b981d79f44c2a9ed2e7712ad99c44', 'request_id': 'req-1a14ef74-537a-4066-9699-ecef0716a680'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:22.801871 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 862/1714] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:22 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:08:22.805739 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1a14ef74-537a-4066-9699-ecef0716a680 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '712b981d79f44c2a9ed2e7712ad99c44', 'request_id': 'req-1a14ef74-537a-4066-9699-ecef0716a680'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:22.816360 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1a14ef74-537a-4066-9699-ecef0716a680 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '712b981d79f44c2a9ed2e7712ad99c44', 'request_id': 'req-1a14ef74-537a-4066-9699-ecef0716a680'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:22.837668 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1a14ef74-537a-4066-9699-ecef0716a680 admin admin] The token cache is being invalidate because project 712b981d79f44c2a9ed2e7712ad99c44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:08:22.838274 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1a14ef74-537a-4066-9699-ecef0716a680 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:22.839234 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1a14ef74-537a-4066-9699-ecef0716a680 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:22.855392 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 853/1715] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:08:22 2022] DELETE /identity/v3/projects/712b981d79f44c2a9ed2e7712ad99c44 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:22.860450 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f462a-9f80-42cd-94bf-46af1ab0a476 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:22.860825 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f462a-9f80-42cd-94bf-46af1ab0a476 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:22.861167 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f462a-9f80-42cd-94bf-46af1ab0a476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:22.905233 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-772f462a-9f80-42cd-94bf-46af1ab0a476 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:22.914238 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-772f462a-9f80-42cd-94bf-46af1ab0a476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:22.997886 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14ef74-537a-4066-9699-ecef0716a680 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:23.000816 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1a14ef74-537a-4066-9699-ecef0716a680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:23.128991 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 863/1716] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:23.135170 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461fcfcd-24fc-49dd-8dc3-e96e643ac6fe None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:23.135773 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461fcfcd-24fc-49dd-8dc3-e96e643ac6fe None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:23.136240 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461fcfcd-24fc-49dd-8dc3-e96e643ac6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:23.176869 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-461fcfcd-24fc-49dd-8dc3-e96e643ac6fe None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:23.178707 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-461fcfcd-24fc-49dd-8dc3-e96e643ac6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:23.192605 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 864/1717] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:23.193740 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461fcfcd-24fc-49dd-8dc3-e96e643ac6fe None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:23.207420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14ef74-537a-4066-9699-ecef0716a680 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:23.214691 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461fcfcd-24fc-49dd-8dc3-e96e643ac6fe None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:23.224437 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95b39e-8eaf-4a43-a880-aea396225ad7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:23.225135 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95b39e-8eaf-4a43-a880-aea396225ad7 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:23.229296 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95b39e-8eaf-4a43-a880-aea396225ad7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:23.229593 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95b39e-8eaf-4a43-a880-aea396225ad7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:23.232236 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d532463a-8175-4c7b-afcd-4183aecc5713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:23.237385 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2a95b39e-8eaf-4a43-a880-aea396225ad7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:23.237581 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532463a-8175-4c7b-afcd-4183aecc5713 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:23.237873 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532463a-8175-4c7b-afcd-4183aecc5713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:23.238154 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532463a-8175-4c7b-afcd-4183aecc5713 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:23.243151 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d532463a-8175-4c7b-afcd-4183aecc5713 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:08:23.243780 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d532463a-8175-4c7b-afcd-4183aecc5713 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:23.248095 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d532463a-8175-4c7b-afcd-4183aecc5713 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:23.285753 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 865/1718] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:08:23.287996 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d532463a-8175-4c7b-afcd-4183aecc5713 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:23.309026 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d532463a-8175-4c7b-afcd-4183aecc5713 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:23.339234 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd523f0-c781-464a-bfeb-52c1f55d7bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:23.344139 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd523f0-c781-464a-bfeb-52c1f55d7bb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:23.346204 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd523f0-c781-464a-bfeb-52c1f55d7bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:23.346648 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd523f0-c781-464a-bfeb-52c1f55d7bb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:23.349130 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd523f0-c781-464a-bfeb-52c1f55d7bb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:23.372098 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd523f0-c781-464a-bfeb-52c1f55d7bb8 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:23.461041 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95b39e-8eaf-4a43-a880-aea396225ad7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:23.466510 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95b39e-8eaf-4a43-a880-aea396225ad7 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:23.491052 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 854/1719] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:08:23.512200 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95b39e-8eaf-4a43-a880-aea396225ad7 service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:23.518115 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 866/1720] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:08:23 2022] POST /identity/v3/projects => generated 385 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:08:23.546278 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95b39e-8eaf-4a43-a880-aea396225ad7 service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:23.751554 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87005b-61e0-4b0f-9f8b-cf7f96810205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:23.753137 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87005b-61e0-4b0f-9f8b-cf7f96810205 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:23.753420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87005b-61e0-4b0f-9f8b-cf7f96810205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:23.753723 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87005b-61e0-4b0f-9f8b-cf7f96810205 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:23.755723 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b87005b-61e0-4b0f-9f8b-cf7f96810205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:23.768625 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b87005b-61e0-4b0f-9f8b-cf7f96810205 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:23.867787 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 855/1721] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:08:23 2022] POST /identity/v3/users => generated 293 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:08:23.872050 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd523f0-c781-464a-bfeb-52c1f55d7bb8 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:23.912713 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd523f0-c781-464a-bfeb-52c1f55d7bb8 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:23.924744 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba0109-70b8-4ebc-b567-746571331d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:23.926803 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba0109-70b8-4ebc-b567-746571331d6b admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:23.927394 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba0109-70b8-4ebc-b567-746571331d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:23.927969 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba0109-70b8-4ebc-b567-746571331d6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:23.928868 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba0109-70b8-4ebc-b567-746571331d6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:23.931266 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba0109-70b8-4ebc-b567-746571331d6b admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:23.962477 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87005b-61e0-4b0f-9f8b-cf7f96810205 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:23.962995 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 867/1722] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:08:23.993059 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87005b-61e0-4b0f-9f8b-cf7f96810205 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:24.015606 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6daeb3a-63d1-4a5e-806a-3b33ff6a82df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:24.016337 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6daeb3a-63d1-4a5e-806a-3b33ff6a82df admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:24.016614 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6daeb3a-63d1-4a5e-806a-3b33ff6a82df admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:24.016886 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6daeb3a-63d1-4a5e-806a-3b33ff6a82df admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:24.017661 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6daeb3a-63d1-4a5e-806a-3b33ff6a82df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:24.019327 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6daeb3a-63d1-4a5e-806a-3b33ff6a82df admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:24.062844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba0109-70b8-4ebc-b567-746571331d6b admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:24.075459 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 856/1723] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:08:24.082650 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba0109-70b8-4ebc-b567-746571331d6b admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:24.106780 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3cb792-ddbb-4441-ac54-ffe41b291370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:24.111622 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cb792-ddbb-4441-ac54-ffe41b291370 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:24.113498 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cb792-ddbb-4441-ac54-ffe41b291370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:24.114104 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cb792-ddbb-4441-ac54-ffe41b291370 admin admin] PATH_INFO: `/v3/projects/ff72967a59dc47be981a964c166f96a0/users/6ae049512d6745a7b9ba3399a7f2b94c/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:24.147399 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3cb792-ddbb-4441-ac54-ffe41b291370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff72967a59dc47be981a964c166f96a0, user_id=6ae049512d6745a7b9ba3399a7f2b94c, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:24.152204 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3cb792-ddbb-4441-ac54-ffe41b291370 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:24.206014 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 868/1724] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:08:24 2022] PUT /identity/v3/projects/ff72967a59dc47be981a964c166f96a0/users/6ae049512d6745a7b9ba3399a7f2b94c/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:08:24.214830 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f521e-21a8-4f15-bf50-a72c045c3b0e None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:24.215121 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f521e-21a8-4f15-bf50-a72c045c3b0e None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:24.215631 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f521e-21a8-4f15-bf50-a72c045c3b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:24.283292 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-121f521e-21a8-4f15-bf50-a72c045c3b0e None None] MFA Rules not processed for user `6ae049512d6745a7b9ba3399a7f2b94c`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:24.284965 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-121f521e-21a8-4f15-bf50-a72c045c3b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:24.561385 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 857/1725] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:24.563727 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3cb792-ddbb-4441-ac54-ffe41b291370 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:24.757114 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3cb792-ddbb-4441-ac54-ffe41b291370 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:24.762707 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c0681-60b6-4e66-ac50-612e8bf7707d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:24.764849 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c0681-60b6-4e66-ac50-612e8bf7707d admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:24.765478 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c0681-60b6-4e66-ac50-612e8bf7707d admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:24.765960 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c0681-60b6-4e66-ac50-612e8bf7707d admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:24.766862 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c0681-60b6-4e66-ac50-612e8bf7707d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:24.769521 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c0681-60b6-4e66-ac50-612e8bf7707d admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:24.864950 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 869/1726] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:08:24 2022] POST /identity/v3/projects => generated 385 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:08:24.867276 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f521e-21a8-4f15-bf50-a72c045c3b0e None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:24.889651 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f521e-21a8-4f15-bf50-a72c045c3b0e None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:25.054275 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1589ba-757e-4f7d-8cd4-0bc2f436499b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:25.055299 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1589ba-757e-4f7d-8cd4-0bc2f436499b admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:25.055583 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1589ba-757e-4f7d-8cd4-0bc2f436499b admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:25.055856 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1589ba-757e-4f7d-8cd4-0bc2f436499b admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:25.056573 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1589ba-757e-4f7d-8cd4-0bc2f436499b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:25.070474 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1589ba-757e-4f7d-8cd4-0bc2f436499b admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:25.133135 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c0681-60b6-4e66-ac50-612e8bf7707d admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:25.133799 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 858/1727] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:08:24 2022] POST /identity/v3/users => generated 299 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:08:25.149378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c0681-60b6-4e66-ac50-612e8bf7707d admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:25.180780 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b951f9-3192-4bda-a355-23cd11a2548d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:25.181660 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b951f9-3192-4bda-a355-23cd11a2548d admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:25.182127 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b951f9-3192-4bda-a355-23cd11a2548d admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:25.182615 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b951f9-3192-4bda-a355-23cd11a2548d admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:25.183704 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b951f9-3192-4bda-a355-23cd11a2548d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:25.188069 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b951f9-3192-4bda-a355-23cd11a2548d admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:25.203818 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 870/1728] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:25 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:08:25.209967 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1589ba-757e-4f7d-8cd4-0bc2f436499b admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:25.242243 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1589ba-757e-4f7d-8cd4-0bc2f436499b admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:25.263105 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e619e-a4b5-430e-b585-6b77a1d15346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:25.269080 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e619e-a4b5-430e-b585-6b77a1d15346 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:25.269669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e619e-a4b5-430e-b585-6b77a1d15346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:25.270452 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e619e-a4b5-430e-b585-6b77a1d15346 admin admin] PATH_INFO: `/v3/projects/86af0e7549534a90b229a1c6af55dda8/users/42739433c0bd4fe08d2af6ea19686776/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:25.373211 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e619e-a4b5-430e-b585-6b77a1d15346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86af0e7549534a90b229a1c6af55dda8, user_id=42739433c0bd4fe08d2af6ea19686776, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:25.381705 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e619e-a4b5-430e-b585-6b77a1d15346 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:25.453057 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 859/1729] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:08:25 2022] PUT /identity/v3/projects/86af0e7549534a90b229a1c6af55dda8/users/42739433c0bd4fe08d2af6ea19686776/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:25.456499 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b951f9-3192-4bda-a355-23cd11a2548d admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:25.472775 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b951f9-3192-4bda-a355-23cd11a2548d admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:25.624422 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100da997-2b3e-417a-baa3-68af9248a685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:25.625726 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100da997-2b3e-417a-baa3-68af9248a685 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:25.626171 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100da997-2b3e-417a-baa3-68af9248a685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:25.626607 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100da997-2b3e-417a-baa3-68af9248a685 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:25.627488 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100da997-2b3e-417a-baa3-68af9248a685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:25.629501 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100da997-2b3e-417a-baa3-68af9248a685 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:25.664242 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 871/1730] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:25 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:08:25.668168 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e619e-a4b5-430e-b585-6b77a1d15346 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:25.708409 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e619e-a4b5-430e-b585-6b77a1d15346 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:25.753101 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1350f-6e4b-4836-b9a9-ee4402c333b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:25.758718 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1350f-6e4b-4836-b9a9-ee4402c333b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:25.759243 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1350f-6e4b-4836-b9a9-ee4402c333b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:25.760400 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1350f-6e4b-4836-b9a9-ee4402c333b8 admin admin] PATH_INFO: `/v3/projects/86af0e7549534a90b229a1c6af55dda8/users/42739433c0bd4fe08d2af6ea19686776/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:25.767621 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca1350f-6e4b-4836-b9a9-ee4402c333b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86af0e7549534a90b229a1c6af55dda8, user_id=42739433c0bd4fe08d2af6ea19686776, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:25.776936 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca1350f-6e4b-4836-b9a9-ee4402c333b8 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:25.800130 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52119c6-13c2-4dfd-9b82-2b39602c4cf2 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:25.800530 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52119c6-13c2-4dfd-9b82-2b39602c4cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:25.800914 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52119c6-13c2-4dfd-9b82-2b39602c4cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:25.857889 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 860/1731] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:08:25 2022] PUT /identity/v3/projects/86af0e7549534a90b229a1c6af55dda8/users/42739433c0bd4fe08d2af6ea19686776/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:25.879276 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ff2c9-9db4-4e12-8f5b-630be54dc4a2 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:25.880357 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ff2c9-9db4-4e12-8f5b-630be54dc4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:25.880794 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ff2c9-9db4-4e12-8f5b-630be54dc4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:25.902474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-c52119c6-13c2-4dfd-9b82-2b39602c4cf2 None None] MFA Rules not processed for user `1673e91c8910435499a5d587f4ef59f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:25.903804 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-c52119c6-13c2-4dfd-9b82-2b39602c4cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:25.938051 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-496ff2c9-9db4-4e12-8f5b-630be54dc4a2 None None] MFA Rules not processed for user `42739433c0bd4fe08d2af6ea19686776`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:25.939794 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-496ff2c9-9db4-4e12-8f5b-630be54dc4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:26.065799 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 861/1732] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:25 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:26.068064 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ff2c9-9db4-4e12-8f5b-630be54dc4a2 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:26.071288 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-496ff2c9-9db4-4e12-8f5b-630be54dc4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:26.122117 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 872/1733] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:26.123256 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52119c6-13c2-4dfd-9b82-2b39602c4cf2 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:26.126688 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-c52119c6-13c2-4dfd-9b82-2b39602c4cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:26.254291 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ff2c9-9db4-4e12-8f5b-630be54dc4a2 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:26.262891 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7b035-3d0a-4be1-b7a8-af9d5c22d014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:26.263995 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7b035-3d0a-4be1-b7a8-af9d5c22d014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:26.264290 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7b035-3d0a-4be1-b7a8-af9d5c22d014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:26.264636 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7b035-3d0a-4be1-b7a8-af9d5c22d014 admin admin] PATH_INFO: `/v3/users/813d537705194247af940253912bd46f` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:26.266284 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52119c6-13c2-4dfd-9b82-2b39602c4cf2 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:26.266804 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7b035-3d0a-4be1-b7a8-af9d5c22d014 admin admin] RBAC: Authorizing `identity:delete_user(user_id=813d537705194247af940253912bd46f)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:26.270487 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7b035-3d0a-4be1-b7a8-af9d5c22d014 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:26.274956 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32f0b3-c3fe-4cc4-9c22-53fc6f56c8df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:26.275867 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32f0b3-c3fe-4cc4-9c22-53fc6f56c8df service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:26.276340 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32f0b3-c3fe-4cc4-9c22-53fc6f56c8df service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:26.276767 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32f0b3-c3fe-4cc4-9c22-53fc6f56c8df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:26.387039 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-0eb7b035-3d0a-4be1-b7a8-af9d5c22d014 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '813d537705194247af940253912bd46f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:26.435423 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32f0b3-c3fe-4cc4-9c22-53fc6f56c8df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:26.437155 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32f0b3-c3fe-4cc4-9c22-53fc6f56c8df service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:26.438625 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-0eb7b035-3d0a-4be1-b7a8-af9d5c22d014 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '813d537705194247af940253912bd46f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:26.466900 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 873/1734] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:08:26.470068 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-0eb7b035-3d0a-4be1-b7a8-af9d5c22d014 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '813d537705194247af940253912bd46f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:26.471283 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c37b9-f782-4e5d-8546-1e0fa9b620c9 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:26.474062 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c37b9-f782-4e5d-8546-1e0fa9b620c9 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:26.474533 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c37b9-f782-4e5d-8546-1e0fa9b620c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:26.511565 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-0eb7b035-3d0a-4be1-b7a8-af9d5c22d014 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '813d537705194247af940253912bd46f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:26.513684 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-0eb7b035-3d0a-4be1-b7a8-af9d5c22d014 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '813d537705194247af940253912bd46f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:26.536086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 862/1735] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:08:26 2022] DELETE /identity/v3/users/813d537705194247af940253912bd46f => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:26.538052 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794235cd-7654-4949-a3fe-6d516eae1e2b None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:26.538566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794235cd-7654-4949-a3fe-6d516eae1e2b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:26.538980 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794235cd-7654-4949-a3fe-6d516eae1e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:26.557251 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-c87c37b9-f782-4e5d-8546-1e0fa9b620c9 None None] MFA Rules not processed for user `1673e91c8910435499a5d587f4ef59f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:26.558909 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-c87c37b9-f782-4e5d-8546-1e0fa9b620c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:26.598336 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-794235cd-7654-4949-a3fe-6d516eae1e2b None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:26.599978 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-794235cd-7654-4949-a3fe-6d516eae1e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:26.731764 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 874/1736] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:26.744556 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c37b9-f782-4e5d-8546-1e0fa9b620c9 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:26.745804 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-c87c37b9-f782-4e5d-8546-1e0fa9b620c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:26.888168 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 863/1737] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:26.942516 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794235cd-7654-4949-a3fe-6d516eae1e2b None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:26.944044 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-794235cd-7654-4949-a3fe-6d516eae1e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:26.949287 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c37b9-f782-4e5d-8546-1e0fa9b620c9 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:26.980873 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bfa0bd-53d4-45b5-bbf0-cecb62f5cebc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:26.981832 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfa0bd-53d4-45b5-bbf0-cecb62f5cebc service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:26.986123 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfa0bd-53d4-45b5-bbf0-cecb62f5cebc service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:26.987206 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfa0bd-53d4-45b5-bbf0-cecb62f5cebc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:26.992655 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f5bfa0bd-53d4-45b5-bbf0-cecb62f5cebc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:27.037518 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bfa0bd-53d4-45b5-bbf0-cecb62f5cebc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:27.040426 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bfa0bd-53d4-45b5-bbf0-cecb62f5cebc service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:27.072117 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 875/1738] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:26 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 19:08:27.227514 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794235cd-7654-4949-a3fe-6d516eae1e2b None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:27.245107 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb08d8f-8bbf-4f1d-8750-4bf083983500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:27.249918 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb08d8f-8bbf-4f1d-8750-4bf083983500 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:27.250148 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb08d8f-8bbf-4f1d-8750-4bf083983500 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:27.250499 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb08d8f-8bbf-4f1d-8750-4bf083983500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:27.288079 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb08d8f-8bbf-4f1d-8750-4bf083983500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:27.289917 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb08d8f-8bbf-4f1d-8750-4bf083983500 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:27.349386 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 864/1739] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 19:08:29.095227 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011620bf-8ffa-479a-aec7-d76dae2a41df None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:29.095717 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011620bf-8ffa-479a-aec7-d76dae2a41df None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:29.095717 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011620bf-8ffa-479a-aec7-d76dae2a41df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:29.133151 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-011620bf-8ffa-479a-aec7-d76dae2a41df None None] MFA Rules not processed for user `661228875e4d4c60a558656b46ea650b`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:29.134441 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-011620bf-8ffa-479a-aec7-d76dae2a41df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:29.287992 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 876/1740] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:30.042091 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26aea38-abaf-45c2-ad70-fa0586a42b78 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:30.043047 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26aea38-abaf-45c2-ad70-fa0586a42b78 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:30.043466 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26aea38-abaf-45c2-ad70-fa0586a42b78 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:30.045100 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 865/1741] 10.222.0.24 () {54 vars in 921 bytes} [Mon May 16 19:08:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 19:08:30.058494 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb33018-5cde-4285-9034-dd788369dde3 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:30.058976 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb33018-5cde-4285-9034-dd788369dde3 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:30.059356 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb33018-5cde-4285-9034-dd788369dde3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:30.084152 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-2eb33018-5cde-4285-9034-dd788369dde3 None None] MFA Rules not processed for user `1f03aa520ee14615b802cdbc3cd4f87d`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:30.086080 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-2eb33018-5cde-4285-9034-dd788369dde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:30.100134 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 877/1742] 10.222.0.24 () {58 vars in 1018 bytes} [Mon May 16 19:08:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:30.396221 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26aea38-abaf-45c2-ad70-fa0586a42b78 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:30.398342 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a26aea38-abaf-45c2-ad70-fa0586a42b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:30.421910 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26aea38-abaf-45c2-ad70-fa0586a42b78 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:30.437254 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14bf5d-8018-4476-9571-54f46b6ceaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:30.438333 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14bf5d-8018-4476-9571-54f46b6ceaa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:30.438679 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14bf5d-8018-4476-9571-54f46b6ceaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:30.439230 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14bf5d-8018-4476-9571-54f46b6ceaa8 admin admin] PATH_INFO: `/v3/projects/9b5fedd101704ee990f6d714cb7caf3b` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:30.440707 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d14bf5d-8018-4476-9571-54f46b6ceaa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b5fedd101704ee990f6d714cb7caf3b)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:30.442754 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d14bf5d-8018-4476-9571-54f46b6ceaa8 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:30.451554 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb33018-5cde-4285-9034-dd788369dde3 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:30.453051 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-2eb33018-5cde-4285-9034-dd788369dde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:30.476684 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb33018-5cde-4285-9034-dd788369dde3 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:30.495181 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359f0ef-921f-4629-902f-93f930dfa301 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:30.495406 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6d14bf5d-8018-4476-9571-54f46b6ceaa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b5fedd101704ee990f6d714cb7caf3b', 'request_id': 'req-6d14bf5d-8018-4476-9571-54f46b6ceaa8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:30.496171 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359f0ef-921f-4629-902f-93f930dfa301 service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:30.496520 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359f0ef-921f-4629-902f-93f930dfa301 service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:30.496914 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359f0ef-921f-4629-902f-93f930dfa301 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:30.509063 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359f0ef-921f-4629-902f-93f930dfa301 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:30.511059 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359f0ef-921f-4629-902f-93f930dfa301 service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:30.515278 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6d14bf5d-8018-4476-9571-54f46b6ceaa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b5fedd101704ee990f6d714cb7caf3b', 'request_id': 'req-6d14bf5d-8018-4476-9571-54f46b6ceaa8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:30.522867 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6d14bf5d-8018-4476-9571-54f46b6ceaa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b5fedd101704ee990f6d714cb7caf3b', 'request_id': 'req-6d14bf5d-8018-4476-9571-54f46b6ceaa8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:30.531240 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 878/1743] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:08:30.547166 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6d14bf5d-8018-4476-9571-54f46b6ceaa8 admin admin] The token cache is being invalidate because project 9b5fedd101704ee990f6d714cb7caf3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:08:30.547674 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6d14bf5d-8018-4476-9571-54f46b6ceaa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:30.548638 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6d14bf5d-8018-4476-9571-54f46b6ceaa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:30.551350 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 866/1744] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:08:30 2022] DELETE /identity/v3/projects/9b5fedd101704ee990f6d714cb7caf3b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:30.556291 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359f0ef-921f-4629-902f-93f930dfa301 service nova] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:30.568992 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359f0ef-921f-4629-902f-93f930dfa301 service nova] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:30.743264 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0cc040-ae57-43a3-ae23-4aa5ed1bffd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:30.744164 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0cc040-ae57-43a3-ae23-4aa5ed1bffd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:30.744439 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0cc040-ae57-43a3-ae23-4aa5ed1bffd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:30.744707 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0cc040-ae57-43a3-ae23-4aa5ed1bffd3 admin admin] PATH_INFO: `/v3/users/8083625bc3f34021997b798c2d39b830` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:30.750353 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0cc040-ae57-43a3-ae23-4aa5ed1bffd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8083625bc3f34021997b798c2d39b830)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:30.753049 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0cc040-ae57-43a3-ae23-4aa5ed1bffd3 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:30.844403 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe079afd-57f6-454a-9b76-06bc04e14bc5 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:30.845485 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe079afd-57f6-454a-9b76-06bc04e14bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:30.845810 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe079afd-57f6-454a-9b76-06bc04e14bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:30.866006 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-2f0cc040-ae57-43a3-ae23-4aa5ed1bffd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8083625bc3f34021997b798c2d39b830'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:30.900978 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-fe079afd-57f6-454a-9b76-06bc04e14bc5 None None] MFA Rules not processed for user `7d3af11e1ffc4ab1a37669f893d2f3be`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:30.902091 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-fe079afd-57f6-454a-9b76-06bc04e14bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:30.916592 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-2f0cc040-ae57-43a3-ae23-4aa5ed1bffd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8083625bc3f34021997b798c2d39b830'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:30.932555 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-2f0cc040-ae57-43a3-ae23-4aa5ed1bffd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8083625bc3f34021997b798c2d39b830'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:30.933308 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-2f0cc040-ae57-43a3-ae23-4aa5ed1bffd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8083625bc3f34021997b798c2d39b830'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:30.949100 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-2f0cc040-ae57-43a3-ae23-4aa5ed1bffd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8083625bc3f34021997b798c2d39b830'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:30.960993 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 879/1745] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:08:30 2022] DELETE /identity/v3/users/8083625bc3f34021997b798c2d39b830 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:30.962803 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c165263-668f-48c5-a081-e83e2d2af0dd None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:30.963243 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c165263-668f-48c5-a081-e83e2d2af0dd None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:30.963681 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c165263-668f-48c5-a081-e83e2d2af0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:31.012267 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-1c165263-668f-48c5-a081-e83e2d2af0dd None None] MFA Rules not processed for user `1673e91c8910435499a5d587f4ef59f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:31.017719 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-1c165263-668f-48c5-a081-e83e2d2af0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:31.059305 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 867/1746] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:31.109428 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 880/1747] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:32.929846 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe079afd-57f6-454a-9b76-06bc04e14bc5 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:32.931499 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-fe079afd-57f6-454a-9b76-06bc04e14bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:32.960391 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe079afd-57f6-454a-9b76-06bc04e14bc5 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:32.996643 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959515e-0a45-437e-9a18-85008079f340 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:32.997494 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959515e-0a45-437e-9a18-85008079f340 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:32.997961 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959515e-0a45-437e-9a18-85008079f340 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:32.999829 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 881/1748] 10.222.0.24 () {54 vars in 912 bytes} [Mon May 16 19:08:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:08:33.011609 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da7ad9-cad7-4f87-9687-0fcd6c0891ee None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:33.012103 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da7ad9-cad7-4f87-9687-0fcd6c0891ee None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:33.012978 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da7ad9-cad7-4f87-9687-0fcd6c0891ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:33.045392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-43da7ad9-cad7-4f87-9687-0fcd6c0891ee None None] MFA Rules not processed for user `ee9e8d17cf1648e0b650df48b8f9487a`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:33.048329 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-43da7ad9-cad7-4f87-9687-0fcd6c0891ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:33.072387 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35448cfe-82fe-4dac-bb80-6d19bdcf7bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:33.073326 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35448cfe-82fe-4dac-bb80-6d19bdcf7bc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:33.073649 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35448cfe-82fe-4dac-bb80-6d19bdcf7bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:33.074095 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35448cfe-82fe-4dac-bb80-6d19bdcf7bc6 admin admin] PATH_INFO: `/v3/projects/546864d6f3224ae5bf44a0a46e619dfb` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:33.075588 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35448cfe-82fe-4dac-bb80-6d19bdcf7bc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=546864d6f3224ae5bf44a0a46e619dfb)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:33.078126 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35448cfe-82fe-4dac-bb80-6d19bdcf7bc6 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:33.182689 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 882/1749] 10.222.0.24 () {58 vars in 1009 bytes} [Mon May 16 19:08:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:08:33.188261 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-35448cfe-82fe-4dac-bb80-6d19bdcf7bc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '546864d6f3224ae5bf44a0a46e619dfb', 'request_id': 'req-35448cfe-82fe-4dac-bb80-6d19bdcf7bc6'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:33.196728 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da7ad9-cad7-4f87-9687-0fcd6c0891ee None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:33.198713 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-43da7ad9-cad7-4f87-9687-0fcd6c0891ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:33.201587 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-35448cfe-82fe-4dac-bb80-6d19bdcf7bc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '546864d6f3224ae5bf44a0a46e619dfb', 'request_id': 'req-35448cfe-82fe-4dac-bb80-6d19bdcf7bc6'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:33.210230 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-35448cfe-82fe-4dac-bb80-6d19bdcf7bc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '546864d6f3224ae5bf44a0a46e619dfb', 'request_id': 'req-35448cfe-82fe-4dac-bb80-6d19bdcf7bc6'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:33.212561 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da7ad9-cad7-4f87-9687-0fcd6c0891ee None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:33.229722 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-35448cfe-82fe-4dac-bb80-6d19bdcf7bc6 admin admin] The token cache is being invalidate because project 546864d6f3224ae5bf44a0a46e619dfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:08:33.230566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-35448cfe-82fe-4dac-bb80-6d19bdcf7bc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:33.231671 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-35448cfe-82fe-4dac-bb80-6d19bdcf7bc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:33.234383 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 868/1750] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:08:32 2022] DELETE /identity/v3/projects/546864d6f3224ae5bf44a0a46e619dfb => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:33.240237 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67748c97-85ab-41fe-a4bc-2623ef9ff2b0 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:33.240740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67748c97-85ab-41fe-a4bc-2623ef9ff2b0 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:33.241165 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67748c97-85ab-41fe-a4bc-2623ef9ff2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:33.275473 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-67748c97-85ab-41fe-a4bc-2623ef9ff2b0 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:33.277303 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-67748c97-85ab-41fe-a4bc-2623ef9ff2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:33.303602 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210990b8-4205-4100-af4c-e105346b8c49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:33.304280 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210990b8-4205-4100-af4c-e105346b8c49 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:33.304598 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210990b8-4205-4100-af4c-e105346b8c49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:33.305036 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210990b8-4205-4100-af4c-e105346b8c49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:33.312871 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-210990b8-4205-4100-af4c-e105346b8c49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:33.331466 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210990b8-4205-4100-af4c-e105346b8c49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:33.333916 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210990b8-4205-4100-af4c-e105346b8c49 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:33.351888 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 883/1751] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:08:33.370737 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 869/1752] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:33.381410 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb67e49-e6b8-411b-939f-ed1d49912b06 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:33.381770 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb67e49-e6b8-411b-939f-ed1d49912b06 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:33.382055 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb67e49-e6b8-411b-939f-ed1d49912b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:33.429448 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-7cb67e49-e6b8-411b-939f-ed1d49912b06 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:33.432674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-7cb67e49-e6b8-411b-939f-ed1d49912b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:33.447856 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 884/1753] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:33.452478 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67748c97-85ab-41fe-a4bc-2623ef9ff2b0 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:33.463796 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67748c97-85ab-41fe-a4bc-2623ef9ff2b0 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:33.500560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c5fddf-e2f3-431f-ac2b-041e2cd1b859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:33.502276 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5fddf-e2f3-431f-ac2b-041e2cd1b859 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:33.503287 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5fddf-e2f3-431f-ac2b-041e2cd1b859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:33.504494 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5fddf-e2f3-431f-ac2b-041e2cd1b859 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:33.510276 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c5fddf-e2f3-431f-ac2b-041e2cd1b859 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:08:33.513740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c5fddf-e2f3-431f-ac2b-041e2cd1b859 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:33.515872 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c5fddf-e2f3-431f-ac2b-041e2cd1b859 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:33.540302 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 870/1754] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:08:33.544968 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb67e49-e6b8-411b-939f-ed1d49912b06 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:33.564235 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb67e49-e6b8-411b-939f-ed1d49912b06 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:33.593458 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a5dfc5-02cf-4a9b-8889-1e96cca75b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:33.594184 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5dfc5-02cf-4a9b-8889-1e96cca75b18 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:33.594476 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5dfc5-02cf-4a9b-8889-1e96cca75b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:33.594743 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5dfc5-02cf-4a9b-8889-1e96cca75b18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:33.597019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a5dfc5-02cf-4a9b-8889-1e96cca75b18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:33.608776 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a5dfc5-02cf-4a9b-8889-1e96cca75b18 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:33.686761 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 885/1755] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:08:33 2022] POST /identity/v3/projects => generated 387 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:08:33.688330 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c5fddf-e2f3-431f-ac2b-041e2cd1b859 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:33.702923 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c5fddf-e2f3-431f-ac2b-041e2cd1b859 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:33.888545 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36abb60-43af-4047-903f-e4bc2b5438c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:33.889505 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36abb60-43af-4047-903f-e4bc2b5438c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:33.889505 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36abb60-43af-4047-903f-e4bc2b5438c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:33.889819 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36abb60-43af-4047-903f-e4bc2b5438c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:33.890530 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36abb60-43af-4047-903f-e4bc2b5438c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:33.892538 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36abb60-43af-4047-903f-e4bc2b5438c5 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:33.945874 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 871/1756] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:08:33 2022] POST /identity/v3/users => generated 294 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:08:33.949316 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a5dfc5-02cf-4a9b-8889-1e96cca75b18 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:33.964352 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a5dfc5-02cf-4a9b-8889-1e96cca75b18 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:33.978695 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ade74-ecfd-45be-9551-d9190624c914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:33.979416 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ade74-ecfd-45be-9551-d9190624c914 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:33.979693 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ade74-ecfd-45be-9551-d9190624c914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:33.979965 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ade74-ecfd-45be-9551-d9190624c914 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:33.980753 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ade74-ecfd-45be-9551-d9190624c914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:33.985111 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ade74-ecfd-45be-9551-d9190624c914 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:34.015045 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 886/1757] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:08:34.018834 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36abb60-43af-4047-903f-e4bc2b5438c5 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:34.035486 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36abb60-43af-4047-903f-e4bc2b5438c5 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:34.045708 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c339b-2e2c-4163-af9e-c5ffff8070fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:34.046466 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c339b-2e2c-4163-af9e-c5ffff8070fb admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:34.046753 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c339b-2e2c-4163-af9e-c5ffff8070fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:34.047027 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c339b-2e2c-4163-af9e-c5ffff8070fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:34.048056 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c339b-2e2c-4163-af9e-c5ffff8070fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:34.055085 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c339b-2e2c-4163-af9e-c5ffff8070fb admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:34.085257 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ade74-ecfd-45be-9551-d9190624c914 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:34.090985 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 872/1758] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:08:34.099506 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ade74-ecfd-45be-9551-d9190624c914 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:34.114935 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9b1f7-3a75-4ecd-a30a-3a0df8811125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:34.122533 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9b1f7-3a75-4ecd-a30a-3a0df8811125 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:34.123413 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9b1f7-3a75-4ecd-a30a-3a0df8811125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:34.123960 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9b1f7-3a75-4ecd-a30a-3a0df8811125 admin admin] PATH_INFO: `/v3/projects/3bd3efcc4fac46e69671247927639fb5/users/13e3800937184fbeac4a21bf5e183db3/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:34.147834 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed9b1f7-3a75-4ecd-a30a-3a0df8811125 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bd3efcc4fac46e69671247927639fb5, user_id=13e3800937184fbeac4a21bf5e183db3, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:34.151478 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed9b1f7-3a75-4ecd-a30a-3a0df8811125 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:34.188981 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 887/1759] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:08:34 2022] PUT /identity/v3/projects/3bd3efcc4fac46e69671247927639fb5/users/13e3800937184fbeac4a21bf5e183db3/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:34.201294 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dafd5c-88e9-44b2-b3c7-f4f483ff8447 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:34.201905 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dafd5c-88e9-44b2-b3c7-f4f483ff8447 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:34.202395 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dafd5c-88e9-44b2-b3c7-f4f483ff8447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:34.236247 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-02dafd5c-88e9-44b2-b3c7-f4f483ff8447 None None] MFA Rules not processed for user `13e3800937184fbeac4a21bf5e183db3`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:34.238041 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-02dafd5c-88e9-44b2-b3c7-f4f483ff8447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:34.266869 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9b1f7-3a75-4ecd-a30a-3a0df8811125 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:34.269364 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-5ed9b1f7-3a75-4ecd-a30a-3a0df8811125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:34.402402 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 873/1760] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:34.407076 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dafd5c-88e9-44b2-b3c7-f4f483ff8447 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:34.411652 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9b1f7-3a75-4ecd-a30a-3a0df8811125 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:34.422093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4aa5c4-5481-475d-b2a3-e776e17a727b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:34.422764 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4aa5c4-5481-475d-b2a3-e776e17a727b service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:34.423550 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4aa5c4-5481-475d-b2a3-e776e17a727b service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:34.423971 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4aa5c4-5481-475d-b2a3-e776e17a727b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:34.429847 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-3d4aa5c4-5481-475d-b2a3-e776e17a727b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:34.532871 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dafd5c-88e9-44b2-b3c7-f4f483ff8447 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:34.541411 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f0407-166d-44a2-84c0-e992f5311060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:34.543409 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f0407-166d-44a2-84c0-e992f5311060 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:34.543695 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f0407-166d-44a2-84c0-e992f5311060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:34.545490 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f0407-166d-44a2-84c0-e992f5311060 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:34.547649 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f0407-166d-44a2-84c0-e992f5311060 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:34.557889 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f0407-166d-44a2-84c0-e992f5311060 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:34.618089 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 874/1761] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:08:34 2022] POST /identity/v3/projects => generated 387 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:08:34.620414 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f0407-166d-44a2-84c0-e992f5311060 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:34.624029 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4aa5c4-5481-475d-b2a3-e776e17a727b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:34.625662 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4aa5c4-5481-475d-b2a3-e776e17a727b service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:34.642567 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 888/1762] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:34 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:08:34.763959 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f0407-166d-44a2-84c0-e992f5311060 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:34.774857 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f43277-ad9d-4f05-86fa-bdab56747a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:34.775545 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f43277-ad9d-4f05-86fa-bdab56747a59 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:34.775824 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f43277-ad9d-4f05-86fa-bdab56747a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:34.776099 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f43277-ad9d-4f05-86fa-bdab56747a59 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:34.777171 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f43277-ad9d-4f05-86fa-bdab56747a59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:34.780837 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f43277-ad9d-4f05-86fa-bdab56747a59 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:34.846054 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 875/1763] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:08:34 2022] POST /identity/v3/users => generated 300 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:08:34.850683 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4aa5c4-5481-475d-b2a3-e776e17a727b service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:34.867719 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4aa5c4-5481-475d-b2a3-e776e17a727b service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:34.875038 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e61dc-e1a2-4f8a-9104-98439a7ce0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:34.876183 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e61dc-e1a2-4f8a-9104-98439a7ce0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:34.876716 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e61dc-e1a2-4f8a-9104-98439a7ce0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:34.877192 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e61dc-e1a2-4f8a-9104-98439a7ce0b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:34.878450 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34e61dc-e1a2-4f8a-9104-98439a7ce0b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:34.881319 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34e61dc-e1a2-4f8a-9104-98439a7ce0b3 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:34.900027 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 889/1764] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:08:34.908264 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f43277-ad9d-4f05-86fa-bdab56747a59 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:34.935959 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f43277-ad9d-4f05-86fa-bdab56747a59 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:34.942672 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00663ca5-d839-49ff-bac3-c8089259c331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:34.944370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00663ca5-d839-49ff-bac3-c8089259c331 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:34.944957 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00663ca5-d839-49ff-bac3-c8089259c331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:34.947090 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00663ca5-d839-49ff-bac3-c8089259c331 admin admin] PATH_INFO: `/v3/projects/bf7a09d7c5684675bd2e1321e8e8c71c/users/d708553212a4462b970a56adc4e1d6e2/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:34.968481 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00663ca5-d839-49ff-bac3-c8089259c331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf7a09d7c5684675bd2e1321e8e8c71c, user_id=d708553212a4462b970a56adc4e1d6e2, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:34.971558 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00663ca5-d839-49ff-bac3-c8089259c331 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:35.003770 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 876/1765] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:08:34 2022] PUT /identity/v3/projects/bf7a09d7c5684675bd2e1321e8e8c71c/users/d708553212a4462b970a56adc4e1d6e2/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:08:35.009714 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e61dc-e1a2-4f8a-9104-98439a7ce0b3 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:35.027437 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e61dc-e1a2-4f8a-9104-98439a7ce0b3 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:35.031448 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9ab69-add0-4dc3-823e-3468bd5d8c7d None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:35.031868 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9ab69-add0-4dc3-823e-3468bd5d8c7d None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:35.032244 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9ab69-add0-4dc3-823e-3468bd5d8c7d None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:35.034242 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 877/1766] 10.222.0.24 () {54 vars in 921 bytes} [Mon May 16 19:08:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 19:08:35.197839 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486eaee-4e16-4fa9-a239-99d89e40963a None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:35.199002 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486eaee-4e16-4fa9-a239-99d89e40963a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:35.199543 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486eaee-4e16-4fa9-a239-99d89e40963a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:35.222159 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa12a6d-ce03-4aa4-bebe-a93b980fae89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:35.222870 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa12a6d-ce03-4aa4-bebe-a93b980fae89 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:35.223138 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa12a6d-ce03-4aa4-bebe-a93b980fae89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:35.223429 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa12a6d-ce03-4aa4-bebe-a93b980fae89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:35.224215 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa12a6d-ce03-4aa4-bebe-a93b980fae89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:35.227193 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa12a6d-ce03-4aa4-bebe-a93b980fae89 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:35.255010 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-3486eaee-4e16-4fa9-a239-99d89e40963a None None] MFA Rules not processed for user `1f03aa520ee14615b802cdbc3cd4f87d`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:35.255572 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 890/1767] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:08:35.256497 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa12a6d-ce03-4aa4-bebe-a93b980fae89 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:35.262134 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3486eaee-4e16-4fa9-a239-99d89e40963a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:35.280985 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa12a6d-ce03-4aa4-bebe-a93b980fae89 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:35.293240 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5740b6-f670-4257-b0d9-7fffd52e47ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:35.294304 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5740b6-f670-4257-b0d9-7fffd52e47ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:35.294750 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5740b6-f670-4257-b0d9-7fffd52e47ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:35.295313 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5740b6-f670-4257-b0d9-7fffd52e47ff admin admin] PATH_INFO: `/v3/projects/bf7a09d7c5684675bd2e1321e8e8c71c/users/d708553212a4462b970a56adc4e1d6e2/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:35.301730 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5740b6-f670-4257-b0d9-7fffd52e47ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf7a09d7c5684675bd2e1321e8e8c71c, user_id=d708553212a4462b970a56adc4e1d6e2, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:35.305450 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5740b6-f670-4257-b0d9-7fffd52e47ff admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:35.385595 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 891/1768] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:08:35 2022] PUT /identity/v3/projects/bf7a09d7c5684675bd2e1321e8e8c71c/users/d708553212a4462b970a56adc4e1d6e2/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:35.391710 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b4d83-eac3-4009-9a7d-929cd1d104f4 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:35.392247 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b4d83-eac3-4009-9a7d-929cd1d104f4 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:35.392685 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b4d83-eac3-4009-9a7d-929cd1d104f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:35.459995 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 878/1769] 10.222.0.24 () {58 vars in 1018 bytes} [Mon May 16 19:08:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:08:35.487715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-2c8b4d83-eac3-4009-9a7d-929cd1d104f4 None None] MFA Rules not processed for user `d708553212a4462b970a56adc4e1d6e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:35.491654 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-2c8b4d83-eac3-4009-9a7d-929cd1d104f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:35.686094 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 892/1770] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:35.701116 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486eaee-4e16-4fa9-a239-99d89e40963a None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:35.790687 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486eaee-4e16-4fa9-a239-99d89e40963a None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:35.804911 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b4d83-eac3-4009-9a7d-929cd1d104f4 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:35.806874 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-2c8b4d83-eac3-4009-9a7d-929cd1d104f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:35.929589 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff59bde-37b3-4b33-a8d5-2dbcedcf77a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:35.932556 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff59bde-37b3-4b33-a8d5-2dbcedcf77a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:35.932904 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff59bde-37b3-4b33-a8d5-2dbcedcf77a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:35.933197 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff59bde-37b3-4b33-a8d5-2dbcedcf77a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:35.963857 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff59bde-37b3-4b33-a8d5-2dbcedcf77a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:35.966037 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff59bde-37b3-4b33-a8d5-2dbcedcf77a6 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:35.977798 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b4d83-eac3-4009-9a7d-929cd1d104f4 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:35.986823 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573f463-d91d-48fa-98d2-e612a59895d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:35.987529 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573f463-d91d-48fa-98d2-e612a59895d8 service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:35.990753 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 879/1771] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:08:36.012486 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573f463-d91d-48fa-98d2-e612a59895d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:36.012776 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573f463-d91d-48fa-98d2-e612a59895d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:36.028967 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7573f463-d91d-48fa-98d2-e612a59895d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:36.042418 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7573f463-d91d-48fa-98d2-e612a59895d8 service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:36.057466 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 893/1772] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 19:08:36.134099 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff59bde-37b3-4b33-a8d5-2dbcedcf77a6 service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:36.209629 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff59bde-37b3-4b33-a8d5-2dbcedcf77a6 service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:36.216024 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e2faf-1d4d-4f8b-80f2-3879b282daa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:36.221085 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e2faf-1d4d-4f8b-80f2-3879b282daa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:36.221614 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e2faf-1d4d-4f8b-80f2-3879b282daa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:36.222168 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e2faf-1d4d-4f8b-80f2-3879b282daa1 admin admin] PATH_INFO: `/v3/users/13e3800937184fbeac4a21bf5e183db3` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:36.223728 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e2faf-1d4d-4f8b-80f2-3879b282daa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13e3800937184fbeac4a21bf5e183db3)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:36.238728 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e2faf-1d4d-4f8b-80f2-3879b282daa1 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:36.320114 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9d0e2faf-1d4d-4f8b-80f2-3879b282daa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13e3800937184fbeac4a21bf5e183db3'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:36.328052 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9d0e2faf-1d4d-4f8b-80f2-3879b282daa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13e3800937184fbeac4a21bf5e183db3'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:36.337820 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9d0e2faf-1d4d-4f8b-80f2-3879b282daa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13e3800937184fbeac4a21bf5e183db3'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:36.352518 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9d0e2faf-1d4d-4f8b-80f2-3879b282daa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13e3800937184fbeac4a21bf5e183db3'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:36.354384 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9d0e2faf-1d4d-4f8b-80f2-3879b282daa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13e3800937184fbeac4a21bf5e183db3'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:36.369370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 880/1773] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:08:36 2022] DELETE /identity/v3/users/13e3800937184fbeac4a21bf5e183db3 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:36.370696 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32399246-8458-46cd-a1ae-ba6e6552cea2 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:36.370987 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32399246-8458-46cd-a1ae-ba6e6552cea2 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:36.371264 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32399246-8458-46cd-a1ae-ba6e6552cea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:36.392794 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-32399246-8458-46cd-a1ae-ba6e6552cea2 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:36.394084 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-32399246-8458-46cd-a1ae-ba6e6552cea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:36.455613 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 894/1774] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:08:36.465629 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e2faf-1d4d-4f8b-80f2-3879b282daa1 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:36.467120 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9d0e2faf-1d4d-4f8b-80f2-3879b282daa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:36.569172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e2faf-1d4d-4f8b-80f2-3879b282daa1 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:36.576357 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d13a96-7dc9-4283-a6b9-40d52bd7374e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:36.577670 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d13a96-7dc9-4283-a6b9-40d52bd7374e service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:36.578367 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d13a96-7dc9-4283-a6b9-40d52bd7374e service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:36.579028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d13a96-7dc9-4283-a6b9-40d52bd7374e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:36.594279 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d13a96-7dc9-4283-a6b9-40d52bd7374e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:36.598395 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d13a96-7dc9-4283-a6b9-40d52bd7374e service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:36.652831 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 881/1775] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:08:37.586965 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32399246-8458-46cd-a1ae-ba6e6552cea2 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:37.588718 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-32399246-8458-46cd-a1ae-ba6e6552cea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:37.608444 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32399246-8458-46cd-a1ae-ba6e6552cea2 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:37.620366 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f142d6-fb93-4dc8-adf0-5e011523bc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:37.621275 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f142d6-fb93-4dc8-adf0-5e011523bc10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:37.621600 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f142d6-fb93-4dc8-adf0-5e011523bc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:37.621943 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f142d6-fb93-4dc8-adf0-5e011523bc10 admin admin] PATH_INFO: `/v3/projects/3bd3efcc4fac46e69671247927639fb5` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:37.626407 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f142d6-fb93-4dc8-adf0-5e011523bc10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bd3efcc4fac46e69671247927639fb5)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:37.630881 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f142d6-fb93-4dc8-adf0-5e011523bc10 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:37.744767 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-b7f142d6-fb93-4dc8-adf0-5e011523bc10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bd3efcc4fac46e69671247927639fb5', 'request_id': 'req-b7f142d6-fb93-4dc8-adf0-5e011523bc10'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:37.756505 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-b7f142d6-fb93-4dc8-adf0-5e011523bc10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bd3efcc4fac46e69671247927639fb5', 'request_id': 'req-b7f142d6-fb93-4dc8-adf0-5e011523bc10'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:37.768288 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-b7f142d6-fb93-4dc8-adf0-5e011523bc10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bd3efcc4fac46e69671247927639fb5', 'request_id': 'req-b7f142d6-fb93-4dc8-adf0-5e011523bc10'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:37.804360 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-b7f142d6-fb93-4dc8-adf0-5e011523bc10 admin admin] The token cache is being invalidate because project 3bd3efcc4fac46e69671247927639fb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:08:37.804923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-b7f142d6-fb93-4dc8-adf0-5e011523bc10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:37.805846 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-b7f142d6-fb93-4dc8-adf0-5e011523bc10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:37.807973 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 895/1776] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:08:37 2022] DELETE /identity/v3/projects/3bd3efcc4fac46e69671247927639fb5 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:37.812525 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d13a96-7dc9-4283-a6b9-40d52bd7374e service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:37.824467 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d13a96-7dc9-4283-a6b9-40d52bd7374e service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:37.936498 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7667f415-5b14-48f8-95a2-b16a033bbe8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:37.937835 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667f415-5b14-48f8-95a2-b16a033bbe8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:37.938271 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667f415-5b14-48f8-95a2-b16a033bbe8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:37.938842 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667f415-5b14-48f8-95a2-b16a033bbe8d admin admin] PATH_INFO: `/v3/users/d708553212a4462b970a56adc4e1d6e2` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:37.942414 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7667f415-5b14-48f8-95a2-b16a033bbe8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d708553212a4462b970a56adc4e1d6e2)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:37.947291 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7667f415-5b14-48f8-95a2-b16a033bbe8d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:38.062282 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7667f415-5b14-48f8-95a2-b16a033bbe8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd708553212a4462b970a56adc4e1d6e2'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:38.076026 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7667f415-5b14-48f8-95a2-b16a033bbe8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd708553212a4462b970a56adc4e1d6e2'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:38.093522 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7667f415-5b14-48f8-95a2-b16a033bbe8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd708553212a4462b970a56adc4e1d6e2'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:38.130556 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7667f415-5b14-48f8-95a2-b16a033bbe8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd708553212a4462b970a56adc4e1d6e2'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:38.133944 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7667f415-5b14-48f8-95a2-b16a033bbe8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd708553212a4462b970a56adc4e1d6e2'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:38.150256 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 882/1777] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:08:37 2022] DELETE /identity/v3/users/d708553212a4462b970a56adc4e1d6e2 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:39.925547 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f142d6-fb93-4dc8-adf0-5e011523bc10 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:39.927140 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-b7f142d6-fb93-4dc8-adf0-5e011523bc10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:39.942183 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f142d6-fb93-4dc8-adf0-5e011523bc10 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:40.040642 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86757ae7-fe57-4354-b5af-f021cd05dad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:40.041711 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86757ae7-fe57-4354-b5af-f021cd05dad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:40.042084 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86757ae7-fe57-4354-b5af-f021cd05dad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:40.042440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86757ae7-fe57-4354-b5af-f021cd05dad5 admin admin] PATH_INFO: `/v3/projects/bf7a09d7c5684675bd2e1321e8e8c71c` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:40.043894 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86757ae7-fe57-4354-b5af-f021cd05dad5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf7a09d7c5684675bd2e1321e8e8c71c)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:40.046038 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86757ae7-fe57-4354-b5af-f021cd05dad5 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:40.115148 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-86757ae7-fe57-4354-b5af-f021cd05dad5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf7a09d7c5684675bd2e1321e8e8c71c', 'request_id': 'req-86757ae7-fe57-4354-b5af-f021cd05dad5'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:40.121178 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-86757ae7-fe57-4354-b5af-f021cd05dad5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf7a09d7c5684675bd2e1321e8e8c71c', 'request_id': 'req-86757ae7-fe57-4354-b5af-f021cd05dad5'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:40.130039 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-86757ae7-fe57-4354-b5af-f021cd05dad5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf7a09d7c5684675bd2e1321e8e8c71c', 'request_id': 'req-86757ae7-fe57-4354-b5af-f021cd05dad5'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:40.152449 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-86757ae7-fe57-4354-b5af-f021cd05dad5 admin admin] The token cache is being invalidate because project bf7a09d7c5684675bd2e1321e8e8c71c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:08:40.153119 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-86757ae7-fe57-4354-b5af-f021cd05dad5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:40.154930 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-86757ae7-fe57-4354-b5af-f021cd05dad5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:40.157018 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 896/1778] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:08:39 2022] DELETE /identity/v3/projects/bf7a09d7c5684675bd2e1321e8e8c71c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:40.165310 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93b922-e324-4e51-8bb7-0ef2540daea5 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:40.165838 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93b922-e324-4e51-8bb7-0ef2540daea5 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:40.165920 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93b922-e324-4e51-8bb7-0ef2540daea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:40.185648 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-df93b922-e324-4e51-8bb7-0ef2540daea5 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:40.186856 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-df93b922-e324-4e51-8bb7-0ef2540daea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:40.252576 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 883/1779] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:40.260016 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4f440-e0ee-49cf-8e51-06c01271dec3 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:40.260608 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4f440-e0ee-49cf-8e51-06c01271dec3 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:40.261091 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4f440-e0ee-49cf-8e51-06c01271dec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:40.294540 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-2da4f440-e0ee-49cf-8e51-06c01271dec3 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:40.296045 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-2da4f440-e0ee-49cf-8e51-06c01271dec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:40.308641 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 897/1780] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:40.312899 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93b922-e324-4e51-8bb7-0ef2540daea5 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:40.323235 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93b922-e324-4e51-8bb7-0ef2540daea5 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:40.328599 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43af60-1400-44b4-879b-13da16e6e257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:40.329930 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43af60-1400-44b4-879b-13da16e6e257 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:40.330433 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43af60-1400-44b4-879b-13da16e6e257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:40.330903 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43af60-1400-44b4-879b-13da16e6e257 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:40.331968 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43af60-1400-44b4-879b-13da16e6e257 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:08:40.332816 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43af60-1400-44b4-879b-13da16e6e257 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:40.335026 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43af60-1400-44b4-879b-13da16e6e257 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:40.351082 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 884/1781] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:08:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:08:40.355734 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4f440-e0ee-49cf-8e51-06c01271dec3 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:40.368796 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4f440-e0ee-49cf-8e51-06c01271dec3 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:40.385776 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed442452-75ee-45c6-bf43-a722ab2f7c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:40.386391 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed442452-75ee-45c6-bf43-a722ab2f7c59 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:40.386670 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed442452-75ee-45c6-bf43-a722ab2f7c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:40.386942 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed442452-75ee-45c6-bf43-a722ab2f7c59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:40.387779 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed442452-75ee-45c6-bf43-a722ab2f7c59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:40.389901 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed442452-75ee-45c6-bf43-a722ab2f7c59 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:40.463239 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 898/1782] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:08:40 2022] POST /identity/v3/projects => generated 407 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:08:40.466978 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43af60-1400-44b4-879b-13da16e6e257 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:40.486381 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43af60-1400-44b4-879b-13da16e6e257 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:40.634840 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9360c2f-5ccb-4843-b6b1-437d5050efc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:40.637337 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9360c2f-5ccb-4843-b6b1-437d5050efc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:40.640409 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9360c2f-5ccb-4843-b6b1-437d5050efc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:40.640409 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9360c2f-5ccb-4843-b6b1-437d5050efc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:40.641252 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9360c2f-5ccb-4843-b6b1-437d5050efc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:40.644853 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9360c2f-5ccb-4843-b6b1-437d5050efc7 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:40.705459 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed442452-75ee-45c6-bf43-a722ab2f7c59 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:40.710789 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-ed442452-75ee-45c6-bf43-a722ab2f7c59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:40.723526 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 885/1783] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:08:40 2022] POST /identity/v3/users => generated 304 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:08:40.727151 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9360c2f-5ccb-4843-b6b1-437d5050efc7 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:40.767142 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed442452-75ee-45c6-bf43-a722ab2f7c59 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:40.775873 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9360c2f-5ccb-4843-b6b1-437d5050efc7 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:40.789106 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a444a9-05ca-47fd-8952-f140a26719d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:40.792758 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a444a9-05ca-47fd-8952-f140a26719d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:40.793082 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a444a9-05ca-47fd-8952-f140a26719d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:40.793375 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a444a9-05ca-47fd-8952-f140a26719d9 admin admin] PATH_INFO: `/v3/users/6ae049512d6745a7b9ba3399a7f2b94c` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:40.798459 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438f1a7-4a74-4f5f-af3b-1c5e0084c757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:40.799387 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438f1a7-4a74-4f5f-af3b-1c5e0084c757 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:40.799886 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438f1a7-4a74-4f5f-af3b-1c5e0084c757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:40.801148 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438f1a7-4a74-4f5f-af3b-1c5e0084c757 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:40.802508 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a444a9-05ca-47fd-8952-f140a26719d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ae049512d6745a7b9ba3399a7f2b94c)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:40.802640 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4438f1a7-4a74-4f5f-af3b-1c5e0084c757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:40.805855 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4438f1a7-4a74-4f5f-af3b-1c5e0084c757 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:40.815381 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a444a9-05ca-47fd-8952-f140a26719d9 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:40.827412 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 886/1784] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:08:40.834866 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438f1a7-4a74-4f5f-af3b-1c5e0084c757 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:40.877366 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438f1a7-4a74-4f5f-af3b-1c5e0084c757 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:40.890819 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf8a0b-c45b-4000-ab38-914a1bc33b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:40.891516 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf8a0b-c45b-4000-ab38-914a1bc33b61 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:40.892447 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf8a0b-c45b-4000-ab38-914a1bc33b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:40.892738 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf8a0b-c45b-4000-ab38-914a1bc33b61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:40.895778 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf8a0b-c45b-4000-ab38-914a1bc33b61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:40.897702 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf8a0b-c45b-4000-ab38-914a1bc33b61 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:40.921476 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 887/1785] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:08:40.925797 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf8a0b-c45b-4000-ab38-914a1bc33b61 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:40.955419 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf8a0b-c45b-4000-ab38-914a1bc33b61 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:40.974513 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19673d91-5070-440d-8e29-2444a4f1be06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:40.975440 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19673d91-5070-440d-8e29-2444a4f1be06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:40.975720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19673d91-5070-440d-8e29-2444a4f1be06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:40.975990 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19673d91-5070-440d-8e29-2444a4f1be06 admin admin] PATH_INFO: `/v3/projects/e7c2b7b2003d405a9a5d71c06345658f/users/c84960838aac47fcb6d03eac59df049c/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:40.978921 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-c6a444a9-05ca-47fd-8952-f140a26719d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ae049512d6745a7b9ba3399a7f2b94c'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:41.019232 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-c6a444a9-05ca-47fd-8952-f140a26719d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ae049512d6745a7b9ba3399a7f2b94c'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:41.025236 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19673d91-5070-440d-8e29-2444a4f1be06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7c2b7b2003d405a9a5d71c06345658f, user_id=c84960838aac47fcb6d03eac59df049c, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:41.042694 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19673d91-5070-440d-8e29-2444a4f1be06 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:41.049150 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-c6a444a9-05ca-47fd-8952-f140a26719d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ae049512d6745a7b9ba3399a7f2b94c'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:41.052355 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-c6a444a9-05ca-47fd-8952-f140a26719d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ae049512d6745a7b9ba3399a7f2b94c'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:41.083952 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 888/1786] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:08:40 2022] PUT /identity/v3/projects/e7c2b7b2003d405a9a5d71c06345658f/users/c84960838aac47fcb6d03eac59df049c/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:08:41.096301 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88257fb-ce4a-4ad0-b1cd-5eaeeb37d771 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:41.096301 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88257fb-ce4a-4ad0-b1cd-5eaeeb37d771 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:41.096301 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88257fb-ce4a-4ad0-b1cd-5eaeeb37d771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:41.108748 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-c6a444a9-05ca-47fd-8952-f140a26719d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ae049512d6745a7b9ba3399a7f2b94c'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:41.132560 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 899/1787] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:08:40 2022] DELETE /identity/v3/users/6ae049512d6745a7b9ba3399a7f2b94c => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:41.139221 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92f55d-ef13-4d11-8128-409305340112 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:41.139420 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92f55d-ef13-4d11-8128-409305340112 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:41.139715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92f55d-ef13-4d11-8128-409305340112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:41.203279 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-b88257fb-ce4a-4ad0-b1cd-5eaeeb37d771 None None] MFA Rules not processed for user `c84960838aac47fcb6d03eac59df049c`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:41.206624 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b88257fb-ce4a-4ad0-b1cd-5eaeeb37d771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:41.210511 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-bb92f55d-ef13-4d11-8128-409305340112 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:41.211968 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-bb92f55d-ef13-4d11-8128-409305340112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:41.328557 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 900/1788] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:41.330282 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1317ae5-4587-47e9-a8ca-b925c80c507a None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:41.330697 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1317ae5-4587-47e9-a8ca-b925c80c507a None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:41.331466 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1317ae5-4587-47e9-a8ca-b925c80c507a None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:41.335389 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 901/1789] 10.222.0.24 () {54 vars in 921 bytes} [Mon May 16 19:08:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:08:41.341556 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 889/1790] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:41 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:08:41.346595 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1317ae5-4587-47e9-a8ca-b925c80c507a None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:41.348198 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0788cf9-2524-47f4-9cfe-7aa6d33abfdc None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:41.348582 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0788cf9-2524-47f4-9cfe-7aa6d33abfdc None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:41.348951 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0788cf9-2524-47f4-9cfe-7aa6d33abfdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:41.349213 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-b1317ae5-4587-47e9-a8ca-b925c80c507a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:41.381490 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-c0788cf9-2524-47f4-9cfe-7aa6d33abfdc None None] MFA Rules not processed for user `1f03aa520ee14615b802cdbc3cd4f87d`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:41.382379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1317ae5-4587-47e9-a8ca-b925c80c507a None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:41.383094 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c0788cf9-2524-47f4-9cfe-7aa6d33abfdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:41.396039 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39abcb-aace-4244-b001-2622555c30a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:41.396949 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39abcb-aace-4244-b001-2622555c30a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:41.397416 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39abcb-aace-4244-b001-2622555c30a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:41.397935 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39abcb-aace-4244-b001-2622555c30a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:41.398829 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f39abcb-aace-4244-b001-2622555c30a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:41.400964 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f39abcb-aace-4244-b001-2622555c30a6 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:41.449350 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 902/1791] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:08:41 2022] POST /identity/v3/projects => generated 407 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:08:41.451167 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39abcb-aace-4244-b001-2622555c30a6 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:41.457096 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-8f39abcb-aace-4244-b001-2622555c30a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:41.498960 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 890/1792] 10.222.0.24 () {58 vars in 1018 bytes} [Mon May 16 19:08:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:08:41.499930 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0788cf9-2524-47f4-9cfe-7aa6d33abfdc None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:41.513458 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0788cf9-2524-47f4-9cfe-7aa6d33abfdc None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:41.568714 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39abcb-aace-4244-b001-2622555c30a6 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:41.581239 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2380b39-2eeb-4899-a60f-160aa8685ee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:41.583080 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2380b39-2eeb-4899-a60f-160aa8685ee2 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:41.583668 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2380b39-2eeb-4899-a60f-160aa8685ee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:41.584138 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2380b39-2eeb-4899-a60f-160aa8685ee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:41.599123 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ceb36-e777-4e31-bb98-0b7d62c7183d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:41.599822 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ceb36-e777-4e31-bb98-0b7d62c7183d admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:41.600107 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ceb36-e777-4e31-bb98-0b7d62c7183d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:41.600384 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ceb36-e777-4e31-bb98-0b7d62c7183d admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:41.601200 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ceb36-e777-4e31-bb98-0b7d62c7183d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:41.603125 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ceb36-e777-4e31-bb98-0b7d62c7183d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:41.642440 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 891/1793] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:08:41 2022] POST /identity/v3/users => generated 310 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:08:41.647138 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ceb36-e777-4e31-bb98-0b7d62c7183d admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:41.669859 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ceb36-e777-4e31-bb98-0b7d62c7183d admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:41.681001 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c41e19-2bbc-4878-9b06-12ee4ce39f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:41.682369 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c41e19-2bbc-4878-9b06-12ee4ce39f8c admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:41.684535 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c41e19-2bbc-4878-9b06-12ee4ce39f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:41.684535 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c41e19-2bbc-4878-9b06-12ee4ce39f8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:41.684535 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c41e19-2bbc-4878-9b06-12ee4ce39f8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:41.690844 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c41e19-2bbc-4878-9b06-12ee4ce39f8c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:41.712015 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 892/1794] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:41 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 19:08:41.727415 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c41e19-2bbc-4878-9b06-12ee4ce39f8c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:41.773146 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c41e19-2bbc-4878-9b06-12ee4ce39f8c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:41.776639 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2380b39-2eeb-4899-a60f-160aa8685ee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:41.783365 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2380b39-2eeb-4899-a60f-160aa8685ee2 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:41.791093 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e086ec6-df28-4693-aafa-f3041bd00298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:41.792735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e086ec6-df28-4693-aafa-f3041bd00298 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:41.794427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e086ec6-df28-4693-aafa-f3041bd00298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:41.795376 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e086ec6-df28-4693-aafa-f3041bd00298 admin admin] PATH_INFO: `/v3/projects/8aa7d133ebc7467f8186928026813420/users/cb98e3148ff147019176c87d2c06a6a0/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:41.808988 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 903/1795] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:08:41.832249 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e086ec6-df28-4693-aafa-f3041bd00298 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aa7d133ebc7467f8186928026813420, user_id=cb98e3148ff147019176c87d2c06a6a0, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:41.835380 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e086ec6-df28-4693-aafa-f3041bd00298 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:41.854768 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 893/1796] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:08:41 2022] PUT /identity/v3/projects/8aa7d133ebc7467f8186928026813420/users/cb98e3148ff147019176c87d2c06a6a0/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:41.859140 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2380b39-2eeb-4899-a60f-160aa8685ee2 service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:41.872353 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2380b39-2eeb-4899-a60f-160aa8685ee2 service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:41.935208 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630970e9-9c1b-4386-acc9-e3b9ca111b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:41.935987 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630970e9-9c1b-4386-acc9-e3b9ca111b3d admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:41.936524 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630970e9-9c1b-4386-acc9-e3b9ca111b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:41.936868 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630970e9-9c1b-4386-acc9-e3b9ca111b3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:41.937733 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630970e9-9c1b-4386-acc9-e3b9ca111b3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:41.939429 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630970e9-9c1b-4386-acc9-e3b9ca111b3d admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:41.950962 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 904/1797] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:41 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:08:41.956860 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e086ec6-df28-4693-aafa-f3041bd00298 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:41.968798 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e086ec6-df28-4693-aafa-f3041bd00298 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:41.975273 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58be9cb-0f0b-41b2-bd6f-d2e088106873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:41.976296 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58be9cb-0f0b-41b2-bd6f-d2e088106873 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:41.976645 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58be9cb-0f0b-41b2-bd6f-d2e088106873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:41.976992 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58be9cb-0f0b-41b2-bd6f-d2e088106873 admin admin] PATH_INFO: `/v3/projects/8aa7d133ebc7467f8186928026813420/users/cb98e3148ff147019176c87d2c06a6a0/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:41.979157 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58be9cb-0f0b-41b2-bd6f-d2e088106873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aa7d133ebc7467f8186928026813420, user_id=cb98e3148ff147019176c87d2c06a6a0, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:41.982098 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58be9cb-0f0b-41b2-bd6f-d2e088106873 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:41.993863 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 894/1798] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:08:41 2022] PUT /identity/v3/projects/8aa7d133ebc7467f8186928026813420/users/cb98e3148ff147019176c87d2c06a6a0/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:42.004285 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246f81d-5d6c-45e3-9bde-20d572ff6a75 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:42.004818 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246f81d-5d6c-45e3-9bde-20d572ff6a75 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:42.004818 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246f81d-5d6c-45e3-9bde-20d572ff6a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:42.038952 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-f246f81d-5d6c-45e3-9bde-20d572ff6a75 None None] MFA Rules not processed for user `cb98e3148ff147019176c87d2c06a6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:42.040280 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f246f81d-5d6c-45e3-9bde-20d572ff6a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:42.133688 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 905/1799] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:42 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:42.140281 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58be9cb-0f0b-41b2-bd6f-d2e088106873 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:42.142871 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d58be9cb-0f0b-41b2-bd6f-d2e088106873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:42.156427 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246f81d-5d6c-45e3-9bde-20d572ff6a75 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:42.157931 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f246f81d-5d6c-45e3-9bde-20d572ff6a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:42.229519 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58be9cb-0f0b-41b2-bd6f-d2e088106873 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:42.233384 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b373c80-8808-4665-abe0-05e6c4fa97a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:42.234092 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b373c80-8808-4665-abe0-05e6c4fa97a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:42.234375 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b373c80-8808-4665-abe0-05e6c4fa97a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:42.234649 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b373c80-8808-4665-abe0-05e6c4fa97a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:42.245824 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b373c80-8808-4665-abe0-05e6c4fa97a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:42.248253 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b373c80-8808-4665-abe0-05e6c4fa97a3 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:42.261714 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 895/1800] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:42 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:08:42.346351 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246f81d-5d6c-45e3-9bde-20d572ff6a75 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:42.374943 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ca509-a995-48bc-9f9d-56261b9674c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:42.375627 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ca509-a995-48bc-9f9d-56261b9674c0 service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:42.375908 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ca509-a995-48bc-9f9d-56261b9674c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:42.376184 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ca509-a995-48bc-9f9d-56261b9674c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:42.397793 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ca509-a995-48bc-9f9d-56261b9674c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:42.399697 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ca509-a995-48bc-9f9d-56261b9674c0 service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:42.445704 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 906/1801] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:08:42.539767 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b373c80-8808-4665-abe0-05e6c4fa97a3 service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:42.552013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b373c80-8808-4665-abe0-05e6c4fa97a3 service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:42.556959 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8cece3-e642-4c95-b898-c384c885bfbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:42.558532 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8cece3-e642-4c95-b898-c384c885bfbe service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:42.559061 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8cece3-e642-4c95-b898-c384c885bfbe service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:42.559534 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8cece3-e642-4c95-b898-c384c885bfbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:42.697650 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8cece3-e642-4c95-b898-c384c885bfbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:42.699265 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8cece3-e642-4c95-b898-c384c885bfbe service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:42.741954 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 896/1802] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:42 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:08:43.590600 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ca509-a995-48bc-9f9d-56261b9674c0 service nova] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:43.592618 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-7e6ca509-a995-48bc-9f9d-56261b9674c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:43.701445 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ca509-a995-48bc-9f9d-56261b9674c0 service nova] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:43.707041 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06086b99-ed64-4bfb-802c-b08f07a48798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:43.707948 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06086b99-ed64-4bfb-802c-b08f07a48798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:43.708221 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06086b99-ed64-4bfb-802c-b08f07a48798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:43.708500 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06086b99-ed64-4bfb-802c-b08f07a48798 admin admin] PATH_INFO: `/v3/projects/ff72967a59dc47be981a964c166f96a0` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:43.709798 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06086b99-ed64-4bfb-802c-b08f07a48798 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff72967a59dc47be981a964c166f96a0)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:43.711741 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06086b99-ed64-4bfb-802c-b08f07a48798 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:43.770596 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-06086b99-ed64-4bfb-802c-b08f07a48798 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff72967a59dc47be981a964c166f96a0', 'request_id': 'req-06086b99-ed64-4bfb-802c-b08f07a48798'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:43.776713 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-06086b99-ed64-4bfb-802c-b08f07a48798 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff72967a59dc47be981a964c166f96a0', 'request_id': 'req-06086b99-ed64-4bfb-802c-b08f07a48798'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:43.784645 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-06086b99-ed64-4bfb-802c-b08f07a48798 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff72967a59dc47be981a964c166f96a0', 'request_id': 'req-06086b99-ed64-4bfb-802c-b08f07a48798'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:43.804272 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-06086b99-ed64-4bfb-802c-b08f07a48798 admin admin] The token cache is being invalidate because project ff72967a59dc47be981a964c166f96a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:08:43.804610 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-06086b99-ed64-4bfb-802c-b08f07a48798 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:43.805381 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-06086b99-ed64-4bfb-802c-b08f07a48798 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:43.809632 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 907/1803] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:08:43 2022] DELETE /identity/v3/projects/ff72967a59dc47be981a964c166f96a0 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:43.812445 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8cece3-e642-4c95-b898-c384c885bfbe service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:43.824440 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8cece3-e642-4c95-b898-c384c885bfbe service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:43.881779 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a88bc0-2256-493a-b5e5-e1fccd51eb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:43.882687 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a88bc0-2256-493a-b5e5-e1fccd51eb72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:43.882973 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a88bc0-2256-493a-b5e5-e1fccd51eb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:43.883246 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a88bc0-2256-493a-b5e5-e1fccd51eb72 admin admin] PATH_INFO: `/v3/users/42739433c0bd4fe08d2af6ea19686776` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:43.884499 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a88bc0-2256-493a-b5e5-e1fccd51eb72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42739433c0bd4fe08d2af6ea19686776)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:43.886526 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a88bc0-2256-493a-b5e5-e1fccd51eb72 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:43.937816 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-03a88bc0-2256-493a-b5e5-e1fccd51eb72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42739433c0bd4fe08d2af6ea19686776'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:43.944390 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-03a88bc0-2256-493a-b5e5-e1fccd51eb72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42739433c0bd4fe08d2af6ea19686776'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:43.954319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-03a88bc0-2256-493a-b5e5-e1fccd51eb72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42739433c0bd4fe08d2af6ea19686776'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:43.974411 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-03a88bc0-2256-493a-b5e5-e1fccd51eb72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42739433c0bd4fe08d2af6ea19686776'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:43.975460 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-03a88bc0-2256-493a-b5e5-e1fccd51eb72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42739433c0bd4fe08d2af6ea19686776'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:43.983472 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 897/1804] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:08:43 2022] DELETE /identity/v3/users/42739433c0bd4fe08d2af6ea19686776 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:44.371338 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06086b99-ed64-4bfb-802c-b08f07a48798 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:44.372962 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-06086b99-ed64-4bfb-802c-b08f07a48798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:44.389091 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06086b99-ed64-4bfb-802c-b08f07a48798 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:44.462217 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e798ba8-eaef-4d42-81e2-20e001431f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:44.463139 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e798ba8-eaef-4d42-81e2-20e001431f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:44.463417 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e798ba8-eaef-4d42-81e2-20e001431f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:44.463695 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e798ba8-eaef-4d42-81e2-20e001431f27 admin admin] PATH_INFO: `/v3/projects/86af0e7549534a90b229a1c6af55dda8` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:44.467405 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e798ba8-eaef-4d42-81e2-20e001431f27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86af0e7549534a90b229a1c6af55dda8)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:44.469395 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e798ba8-eaef-4d42-81e2-20e001431f27 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:44.533783 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-4e798ba8-eaef-4d42-81e2-20e001431f27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86af0e7549534a90b229a1c6af55dda8', 'request_id': 'req-4e798ba8-eaef-4d42-81e2-20e001431f27'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:44.539684 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-4e798ba8-eaef-4d42-81e2-20e001431f27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86af0e7549534a90b229a1c6af55dda8', 'request_id': 'req-4e798ba8-eaef-4d42-81e2-20e001431f27'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:44.547523 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-4e798ba8-eaef-4d42-81e2-20e001431f27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86af0e7549534a90b229a1c6af55dda8', 'request_id': 'req-4e798ba8-eaef-4d42-81e2-20e001431f27'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:44.579300 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-4e798ba8-eaef-4d42-81e2-20e001431f27 admin admin] The token cache is being invalidate because project 86af0e7549534a90b229a1c6af55dda8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:08:44.580799 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-4e798ba8-eaef-4d42-81e2-20e001431f27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:44.581489 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-4e798ba8-eaef-4d42-81e2-20e001431f27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:44.583144 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 908/1805] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:08:44 2022] DELETE /identity/v3/projects/86af0e7549534a90b229a1c6af55dda8 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:44.590540 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d812f-e6b2-4d09-825d-0a31f0a99cce None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:44.590804 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d812f-e6b2-4d09-825d-0a31f0a99cce None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:44.591122 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d812f-e6b2-4d09-825d-0a31f0a99cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:44.627128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-a44d812f-e6b2-4d09-825d-0a31f0a99cce None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:44.628589 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a44d812f-e6b2-4d09-825d-0a31f0a99cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:44.759702 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 898/1806] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:44.768045 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c80833-09ef-4323-a9d7-d69aa67b9cef None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:44.768584 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c80833-09ef-4323-a9d7-d69aa67b9cef None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:44.768584 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c80833-09ef-4323-a9d7-d69aa67b9cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:44.822451 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-a4c80833-09ef-4323-a9d7-d69aa67b9cef None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:44.833677 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a4c80833-09ef-4323-a9d7-d69aa67b9cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:44.849755 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 909/1807] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:44.853644 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d812f-e6b2-4d09-825d-0a31f0a99cce None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:44.865569 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d812f-e6b2-4d09-825d-0a31f0a99cce None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:44.870261 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9af29-91ff-476f-80d1-d790b16daf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:44.870929 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9af29-91ff-476f-80d1-d790b16daf9d admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:44.871206 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9af29-91ff-476f-80d1-d790b16daf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:44.871528 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9af29-91ff-476f-80d1-d790b16daf9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:44.872251 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d9af29-91ff-476f-80d1-d790b16daf9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:08:44.872718 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d9af29-91ff-476f-80d1-d790b16daf9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:44.874531 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d9af29-91ff-476f-80d1-d790b16daf9d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:44.901055 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 899/1808] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:08:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:08:44.905760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c80833-09ef-4323-a9d7-d69aa67b9cef None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:44.920047 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c80833-09ef-4323-a9d7-d69aa67b9cef None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:44.930305 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5b5ab-3d71-4cf6-8b9c-a7fc36be6412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:44.930988 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5b5ab-3d71-4cf6-8b9c-a7fc36be6412 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:44.931269 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5b5ab-3d71-4cf6-8b9c-a7fc36be6412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:44.931542 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5b5ab-3d71-4cf6-8b9c-a7fc36be6412 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:44.932256 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5b5ab-3d71-4cf6-8b9c-a7fc36be6412 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:44.934265 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5b5ab-3d71-4cf6-8b9c-a7fc36be6412 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:44.967699 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 910/1809] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:08:44 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:08:44.972050 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9af29-91ff-476f-80d1-d790b16daf9d admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:44.982962 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9af29-91ff-476f-80d1-d790b16daf9d admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:45.048198 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5fcb9-b0a9-4e3f-bc9c-c87a3c588b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:45.049843 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5fcb9-b0a9-4e3f-bc9c-c87a3c588b97 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:45.050325 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5fcb9-b0a9-4e3f-bc9c-c87a3c588b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:45.050829 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5fcb9-b0a9-4e3f-bc9c-c87a3c588b97 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:45.051629 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5fcb9-b0a9-4e3f-bc9c-c87a3c588b97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:45.053714 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5fcb9-b0a9-4e3f-bc9c-c87a3c588b97 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:45.081198 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 900/1810] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:08:44 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:08:45.082450 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5b5ab-3d71-4cf6-8b9c-a7fc36be6412 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:45.096925 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5b5ab-3d71-4cf6-8b9c-a7fc36be6412 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:45.102482 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8520f8f-b0c5-4133-8599-a46ae7cf6665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:45.103163 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8520f8f-b0c5-4133-8599-a46ae7cf6665 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:45.103447 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8520f8f-b0c5-4133-8599-a46ae7cf6665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:45.103720 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8520f8f-b0c5-4133-8599-a46ae7cf6665 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:45.104512 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8520f8f-b0c5-4133-8599-a46ae7cf6665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:45.106277 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8520f8f-b0c5-4133-8599-a46ae7cf6665 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:45.120962 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 911/1811] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:08:45.122325 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5fcb9-b0a9-4e3f-bc9c-c87a3c588b97 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:45.132292 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5fcb9-b0a9-4e3f-bc9c-c87a3c588b97 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:45.137056 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031126c-23e6-4efb-aced-a2e51893764e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:45.137769 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031126c-23e6-4efb-aced-a2e51893764e admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:45.138051 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031126c-23e6-4efb-aced-a2e51893764e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:45.138319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031126c-23e6-4efb-aced-a2e51893764e admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:45.139039 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031126c-23e6-4efb-aced-a2e51893764e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:45.140758 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031126c-23e6-4efb-aced-a2e51893764e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:45.154283 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 901/1812] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:08:45.155761 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8520f8f-b0c5-4133-8599-a46ae7cf6665 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:45.170124 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8520f8f-b0c5-4133-8599-a46ae7cf6665 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:45.175257 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9207c-0499-4b63-a5ef-5c017bfa64a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:45.176152 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9207c-0499-4b63-a5ef-5c017bfa64a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:45.176428 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9207c-0499-4b63-a5ef-5c017bfa64a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:45.176695 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9207c-0499-4b63-a5ef-5c017bfa64a1 admin admin] PATH_INFO: `/v3/projects/62739e7ef7d94be99e46671dfe27865b/users/f4d206f55c134c17ba535438c68fbe6b/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:45.191346 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d9207c-0499-4b63-a5ef-5c017bfa64a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62739e7ef7d94be99e46671dfe27865b, user_id=f4d206f55c134c17ba535438c68fbe6b, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:45.194288 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d9207c-0499-4b63-a5ef-5c017bfa64a1 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:45.208662 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 912/1813] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:08:45 2022] PUT /identity/v3/projects/62739e7ef7d94be99e46671dfe27865b/users/f4d206f55c134c17ba535438c68fbe6b/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:45.221243 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393931bc-cf76-426e-9347-3a8b23021f4d None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:45.221504 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393931bc-cf76-426e-9347-3a8b23021f4d None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:45.221845 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393931bc-cf76-426e-9347-3a8b23021f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:45.249692 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-393931bc-cf76-426e-9347-3a8b23021f4d None None] MFA Rules not processed for user `f4d206f55c134c17ba535438c68fbe6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:45.250883 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-393931bc-cf76-426e-9347-3a8b23021f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:45.338435 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 902/1814] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:45.342779 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9207c-0499-4b63-a5ef-5c017bfa64a1 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:45.428519 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9207c-0499-4b63-a5ef-5c017bfa64a1 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:45.434596 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a83fc-039a-40bb-b52e-007f29617bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:45.435324 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a83fc-039a-40bb-b52e-007f29617bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:45.437127 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a83fc-039a-40bb-b52e-007f29617bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:45.437410 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a83fc-039a-40bb-b52e-007f29617bb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:45.438187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a83fc-039a-40bb-b52e-007f29617bb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:45.440303 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a83fc-039a-40bb-b52e-007f29617bb5 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:45.477254 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 913/1815] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:08:45 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:08:45.481475 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393931bc-cf76-426e-9347-3a8b23021f4d None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:45.493805 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393931bc-cf76-426e-9347-3a8b23021f4d None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:45.549409 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b6286-b762-489e-b667-e2508dc266c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:45.550144 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b6286-b762-489e-b667-e2508dc266c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:45.550425 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b6286-b762-489e-b667-e2508dc266c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:45.550728 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b6286-b762-489e-b667-e2508dc266c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:45.551454 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b6286-b762-489e-b667-e2508dc266c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:45.553480 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b6286-b762-489e-b667-e2508dc266c8 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:45.582107 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 903/1816] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:08:45 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:08:45.585879 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a83fc-039a-40bb-b52e-007f29617bb5 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:45.596150 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a83fc-039a-40bb-b52e-007f29617bb5 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:45.600647 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b0582-cf71-40d1-97cc-0bbda8f4d2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:45.601319 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b0582-cf71-40d1-97cc-0bbda8f4d2f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:45.601624 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b0582-cf71-40d1-97cc-0bbda8f4d2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:45.601893 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b0582-cf71-40d1-97cc-0bbda8f4d2f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:45.602615 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b0582-cf71-40d1-97cc-0bbda8f4d2f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:45.604216 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b0582-cf71-40d1-97cc-0bbda8f4d2f0 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:45.614738 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 914/1817] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:08:45.618879 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b6286-b762-489e-b667-e2508dc266c8 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:45.628946 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b6286-b762-489e-b667-e2508dc266c8 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:45.633591 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca4c70-1ba7-4043-8f8d-0d1c45795b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:45.634491 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca4c70-1ba7-4043-8f8d-0d1c45795b0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:45.634773 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca4c70-1ba7-4043-8f8d-0d1c45795b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:45.635047 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca4c70-1ba7-4043-8f8d-0d1c45795b0d admin admin] PATH_INFO: `/v3/projects/345fb36823f44b0db2ad374091098924/users/c397abea01e44f159822c9215e5df9e2/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:45.650439 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca4c70-1ba7-4043-8f8d-0d1c45795b0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=345fb36823f44b0db2ad374091098924, user_id=c397abea01e44f159822c9215e5df9e2, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:45.653243 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca4c70-1ba7-4043-8f8d-0d1c45795b0d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:45.666990 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 904/1818] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:08:45 2022] PUT /identity/v3/projects/345fb36823f44b0db2ad374091098924/users/c397abea01e44f159822c9215e5df9e2/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:08:45.671074 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b0582-cf71-40d1-97cc-0bbda8f4d2f0 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:45.681848 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b0582-cf71-40d1-97cc-0bbda8f4d2f0 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:45.738229 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e725b4-fe2b-46ba-ac0e-f59f7154e0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:45.739210 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e725b4-fe2b-46ba-ac0e-f59f7154e0bb admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:45.739642 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e725b4-fe2b-46ba-ac0e-f59f7154e0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:45.740100 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e725b4-fe2b-46ba-ac0e-f59f7154e0bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:45.741203 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e725b4-fe2b-46ba-ac0e-f59f7154e0bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:45.743759 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e725b4-fe2b-46ba-ac0e-f59f7154e0bb admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:45.759443 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 915/1819] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:08:45.764992 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca4c70-1ba7-4043-8f8d-0d1c45795b0d admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:45.775457 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca4c70-1ba7-4043-8f8d-0d1c45795b0d admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:45.780897 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed08ed5-2194-43cb-bff5-9fb0db664c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:45.781815 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed08ed5-2194-43cb-bff5-9fb0db664c41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:45.782221 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed08ed5-2194-43cb-bff5-9fb0db664c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:45.782501 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed08ed5-2194-43cb-bff5-9fb0db664c41 admin admin] PATH_INFO: `/v3/projects/345fb36823f44b0db2ad374091098924/users/c397abea01e44f159822c9215e5df9e2/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:45.784538 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed08ed5-2194-43cb-bff5-9fb0db664c41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=345fb36823f44b0db2ad374091098924, user_id=c397abea01e44f159822c9215e5df9e2, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:45.787179 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed08ed5-2194-43cb-bff5-9fb0db664c41 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:45.797570 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 905/1820] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:08:45 2022] PUT /identity/v3/projects/345fb36823f44b0db2ad374091098924/users/c397abea01e44f159822c9215e5df9e2/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:45.807398 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999f89f-ff84-4659-8393-5deb6bf0eb41 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:45.807869 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999f89f-ff84-4659-8393-5deb6bf0eb41 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:45.807869 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999f89f-ff84-4659-8393-5deb6bf0eb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:45.835364 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-c999f89f-ff84-4659-8393-5deb6bf0eb41 None None] MFA Rules not processed for user `c397abea01e44f159822c9215e5df9e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:45.836887 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-c999f89f-ff84-4659-8393-5deb6bf0eb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:45.909691 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 916/1821] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:45 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:45.921615 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed08ed5-2194-43cb-bff5-9fb0db664c41 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:45.924041 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5ed08ed5-2194-43cb-bff5-9fb0db664c41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:45.995799 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed08ed5-2194-43cb-bff5-9fb0db664c41 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:46.000323 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd59a6b-0ce5-4b7e-9267-73f8e346a632 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:46.000976 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd59a6b-0ce5-4b7e-9267-73f8e346a632 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:46.001260 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd59a6b-0ce5-4b7e-9267-73f8e346a632 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:46.001552 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd59a6b-0ce5-4b7e-9267-73f8e346a632 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:46.064202 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd59a6b-0ce5-4b7e-9267-73f8e346a632 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:46.065593 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd59a6b-0ce5-4b7e-9267-73f8e346a632 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:46.075848 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 906/1822] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:08:49.667629 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c999f89f-ff84-4659-8393-5deb6bf0eb41 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:49.753723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c999f89f-ff84-4659-8393-5deb6bf0eb41 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:49.760508 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79871852-c849-4339-a290-e9ea381125ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:49.761443 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79871852-c849-4339-a290-e9ea381125ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:49.761845 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79871852-c849-4339-a290-e9ea381125ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:49.762157 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79871852-c849-4339-a290-e9ea381125ce admin admin] PATH_INFO: `/v3/users/f4d206f55c134c17ba535438c68fbe6b` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:49.763463 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79871852-c849-4339-a290-e9ea381125ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4d206f55c134c17ba535438c68fbe6b)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:49.765418 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79871852-c849-4339-a290-e9ea381125ce admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:49.836312 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-79871852-c849-4339-a290-e9ea381125ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4d206f55c134c17ba535438c68fbe6b'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:49.844985 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-79871852-c849-4339-a290-e9ea381125ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4d206f55c134c17ba535438c68fbe6b'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:49.852080 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-79871852-c849-4339-a290-e9ea381125ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4d206f55c134c17ba535438c68fbe6b'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:49.852651 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-79871852-c849-4339-a290-e9ea381125ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4d206f55c134c17ba535438c68fbe6b'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:49.865522 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-79871852-c849-4339-a290-e9ea381125ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4d206f55c134c17ba535438c68fbe6b'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:49.872341 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 917/1823] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:08:49 2022] DELETE /identity/v3/users/f4d206f55c134c17ba535438c68fbe6b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:49.876811 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfbcaa-85f9-4ed3-b64c-8124d41f00e2 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:49.877280 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfbcaa-85f9-4ed3-b64c-8124d41f00e2 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:49.877412 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfbcaa-85f9-4ed3-b64c-8124d41f00e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:49.900851 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-c7cfbcaa-85f9-4ed3-b64c-8124d41f00e2 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:49.902662 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c7cfbcaa-85f9-4ed3-b64c-8124d41f00e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:49.984986 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 907/1824] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:49.998029 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79871852-c849-4339-a290-e9ea381125ce admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:49.999752 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-79871852-c849-4339-a290-e9ea381125ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:50.060108 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79871852-c849-4339-a290-e9ea381125ce admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:50.064998 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fe4ca-688a-4b60-a244-8770bd6715d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:50.065654 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fe4ca-688a-4b60-a244-8770bd6715d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:50.065994 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fe4ca-688a-4b60-a244-8770bd6715d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:50.066305 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fe4ca-688a-4b60-a244-8770bd6715d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:50.078720 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4fe4ca-688a-4b60-a244-8770bd6715d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:50.080211 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4fe4ca-688a-4b60-a244-8770bd6715d4 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:50.092471 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 918/1825] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:08:50.539805 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cfbcaa-85f9-4ed3-b64c-8124d41f00e2 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:50.541362 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c7cfbcaa-85f9-4ed3-b64c-8124d41f00e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:50.554583 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cfbcaa-85f9-4ed3-b64c-8124d41f00e2 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:50.562085 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf3520-599a-4901-b593-3d50b7316c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:50.563648 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf3520-599a-4901-b593-3d50b7316c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:50.565993 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf3520-599a-4901-b593-3d50b7316c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:50.566235 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf3520-599a-4901-b593-3d50b7316c5c admin admin] PATH_INFO: `/v3/projects/62739e7ef7d94be99e46671dfe27865b` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:50.568287 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf3520-599a-4901-b593-3d50b7316c5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=62739e7ef7d94be99e46671dfe27865b)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:50.570735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf3520-599a-4901-b593-3d50b7316c5c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:50.623651 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-23bf3520-599a-4901-b593-3d50b7316c5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62739e7ef7d94be99e46671dfe27865b', 'request_id': 'req-23bf3520-599a-4901-b593-3d50b7316c5c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:50.633544 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-23bf3520-599a-4901-b593-3d50b7316c5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62739e7ef7d94be99e46671dfe27865b', 'request_id': 'req-23bf3520-599a-4901-b593-3d50b7316c5c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:50.639895 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-23bf3520-599a-4901-b593-3d50b7316c5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62739e7ef7d94be99e46671dfe27865b', 'request_id': 'req-23bf3520-599a-4901-b593-3d50b7316c5c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:50.652821 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-23bf3520-599a-4901-b593-3d50b7316c5c admin admin] The token cache is being invalidate because project 62739e7ef7d94be99e46671dfe27865b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:08:50.653112 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-23bf3520-599a-4901-b593-3d50b7316c5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:50.654171 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-23bf3520-599a-4901-b593-3d50b7316c5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:50.658624 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 908/1826] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:08:50 2022] DELETE /identity/v3/projects/62739e7ef7d94be99e46671dfe27865b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:50.659859 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fe4ca-688a-4b60-a244-8770bd6715d4 service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:50.669894 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fe4ca-688a-4b60-a244-8770bd6715d4 service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:50.702750 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf3520-599a-4901-b593-3d50b7316c5c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:50.704759 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-23bf3520-599a-4901-b593-3d50b7316c5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:50.735348 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab527ad0-1f3e-419c-8dfc-3e3399c5db51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:50.736498 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab527ad0-1f3e-419c-8dfc-3e3399c5db51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:50.736781 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab527ad0-1f3e-419c-8dfc-3e3399c5db51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:50.737056 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab527ad0-1f3e-419c-8dfc-3e3399c5db51 admin admin] PATH_INFO: `/v3/users/c397abea01e44f159822c9215e5df9e2` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:50.738309 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab527ad0-1f3e-419c-8dfc-3e3399c5db51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c397abea01e44f159822c9215e5df9e2)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:50.740267 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab527ad0-1f3e-419c-8dfc-3e3399c5db51 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:50.779901 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf3520-599a-4901-b593-3d50b7316c5c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:50.784729 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f513d20-5d1c-4a38-b2ff-f215d77889d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:50.786046 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f513d20-5d1c-4a38-b2ff-f215d77889d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:50.786333 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f513d20-5d1c-4a38-b2ff-f215d77889d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:50.786604 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f513d20-5d1c-4a38-b2ff-f215d77889d9 admin admin] PATH_INFO: `/v3/users/c84960838aac47fcb6d03eac59df049c` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:50.787945 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f513d20-5d1c-4a38-b2ff-f215d77889d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c84960838aac47fcb6d03eac59df049c)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:50.789908 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f513d20-5d1c-4a38-b2ff-f215d77889d9 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:50.790574 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ab527ad0-1f3e-419c-8dfc-3e3399c5db51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c397abea01e44f159822c9215e5df9e2'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:50.804450 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ab527ad0-1f3e-419c-8dfc-3e3399c5db51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c397abea01e44f159822c9215e5df9e2'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:50.814936 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ab527ad0-1f3e-419c-8dfc-3e3399c5db51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c397abea01e44f159822c9215e5df9e2'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:50.817137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ab527ad0-1f3e-419c-8dfc-3e3399c5db51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c397abea01e44f159822c9215e5df9e2'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:50.832842 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ab527ad0-1f3e-419c-8dfc-3e3399c5db51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c397abea01e44f159822c9215e5df9e2'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:50.844635 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 919/1827] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:08:50 2022] DELETE /identity/v3/users/c397abea01e44f159822c9215e5df9e2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:50.851534 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3f513d20-5d1c-4a38-b2ff-f215d77889d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c84960838aac47fcb6d03eac59df049c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:50.859142 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3f513d20-5d1c-4a38-b2ff-f215d77889d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c84960838aac47fcb6d03eac59df049c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:50.868664 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3f513d20-5d1c-4a38-b2ff-f215d77889d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c84960838aac47fcb6d03eac59df049c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:50.881404 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3f513d20-5d1c-4a38-b2ff-f215d77889d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c84960838aac47fcb6d03eac59df049c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:50.882278 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3f513d20-5d1c-4a38-b2ff-f215d77889d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c84960838aac47fcb6d03eac59df049c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:50.889033 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 909/1828] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:08:50 2022] DELETE /identity/v3/users/c84960838aac47fcb6d03eac59df049c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:50.893578 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689487df-9c7d-486a-93ce-b647304058db None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:50.893725 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689487df-9c7d-486a-93ce-b647304058db None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:50.894001 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689487df-9c7d-486a-93ce-b647304058db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:50.920510 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-689487df-9c7d-486a-93ce-b647304058db None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:50.922122 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-689487df-9c7d-486a-93ce-b647304058db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:50.989874 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 920/1829] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:51.001307 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f513d20-5d1c-4a38-b2ff-f215d77889d9 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:51.013513 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3f513d20-5d1c-4a38-b2ff-f215d77889d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:51.103953 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f513d20-5d1c-4a38-b2ff-f215d77889d9 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:51.108252 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662de893-d4fc-4024-bd95-4f35fdb64148 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:51.108936 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662de893-d4fc-4024-bd95-4f35fdb64148 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:51.109215 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662de893-d4fc-4024-bd95-4f35fdb64148 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:51.109492 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662de893-d4fc-4024-bd95-4f35fdb64148 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:51.130598 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662de893-d4fc-4024-bd95-4f35fdb64148 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:51.132375 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662de893-d4fc-4024-bd95-4f35fdb64148 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:51.144627 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 910/1830] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:08:51.319043 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689487df-9c7d-486a-93ce-b647304058db None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:51.320500 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-689487df-9c7d-486a-93ce-b647304058db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:51.334461 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689487df-9c7d-486a-93ce-b647304058db None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:51.339681 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a28a39-0546-44be-809c-1e92bbcc6c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:51.340733 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a28a39-0546-44be-809c-1e92bbcc6c55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:51.341103 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a28a39-0546-44be-809c-1e92bbcc6c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:51.341469 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a28a39-0546-44be-809c-1e92bbcc6c55 admin admin] PATH_INFO: `/v3/projects/345fb36823f44b0db2ad374091098924` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:51.342796 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a28a39-0546-44be-809c-1e92bbcc6c55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=345fb36823f44b0db2ad374091098924)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:51.344888 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a28a39-0546-44be-809c-1e92bbcc6c55 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:51.401051 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-88a28a39-0546-44be-809c-1e92bbcc6c55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '345fb36823f44b0db2ad374091098924', 'request_id': 'req-88a28a39-0546-44be-809c-1e92bbcc6c55'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:51.408597 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-88a28a39-0546-44be-809c-1e92bbcc6c55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '345fb36823f44b0db2ad374091098924', 'request_id': 'req-88a28a39-0546-44be-809c-1e92bbcc6c55'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:51.418223 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-88a28a39-0546-44be-809c-1e92bbcc6c55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '345fb36823f44b0db2ad374091098924', 'request_id': 'req-88a28a39-0546-44be-809c-1e92bbcc6c55'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:51.435981 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-88a28a39-0546-44be-809c-1e92bbcc6c55 admin admin] The token cache is being invalidate because project 345fb36823f44b0db2ad374091098924 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:08:51.436342 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-88a28a39-0546-44be-809c-1e92bbcc6c55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:51.437160 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-88a28a39-0546-44be-809c-1e92bbcc6c55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:51.438945 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 921/1831] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:08:51 2022] DELETE /identity/v3/projects/345fb36823f44b0db2ad374091098924 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:51.444996 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c8276-b32b-4cf2-bf57-b87ecb522be7 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:51.445964 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c8276-b32b-4cf2-bf57-b87ecb522be7 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:51.446441 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c8276-b32b-4cf2-bf57-b87ecb522be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:51.466357 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-1e0c8276-b32b-4cf2-bf57-b87ecb522be7 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:51.467804 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1e0c8276-b32b-4cf2-bf57-b87ecb522be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:51.532196 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 911/1832] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:51.539736 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f84fbb-e954-48bf-b5ac-be49f0145347 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:51.540207 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f84fbb-e954-48bf-b5ac-be49f0145347 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:51.540540 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f84fbb-e954-48bf-b5ac-be49f0145347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:51.565214 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-e1f84fbb-e954-48bf-b5ac-be49f0145347 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:51.566906 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-e1f84fbb-e954-48bf-b5ac-be49f0145347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:51.578247 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 922/1833] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:08:51.582396 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c8276-b32b-4cf2-bf57-b87ecb522be7 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:51.593122 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c8276-b32b-4cf2-bf57-b87ecb522be7 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:51.599647 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028cf03f-2d46-474f-85ac-8c86574cafe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:51.600583 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028cf03f-2d46-474f-85ac-8c86574cafe4 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:51.601086 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f84fbb-e954-48bf-b5ac-be49f0145347 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:51.601271 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028cf03f-2d46-474f-85ac-8c86574cafe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:51.601762 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028cf03f-2d46-474f-85ac-8c86574cafe4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:51.602640 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-e1f84fbb-e954-48bf-b5ac-be49f0145347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:51.602968 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028cf03f-2d46-474f-85ac-8c86574cafe4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:08:51.603495 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028cf03f-2d46-474f-85ac-8c86574cafe4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:51.605425 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028cf03f-2d46-474f-85ac-8c86574cafe4 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:51.617332 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f84fbb-e954-48bf-b5ac-be49f0145347 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:51.626646 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 912/1834] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:08:51.630883 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028cf03f-2d46-474f-85ac-8c86574cafe4 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:51.639066 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ed01c-c913-48ee-ac18-0eabf3a67fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:51.640290 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ed01c-c913-48ee-ac18-0eabf3a67fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:51.640639 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ed01c-c913-48ee-ac18-0eabf3a67fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:51.640980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ed01c-c913-48ee-ac18-0eabf3a67fd8 admin admin] PATH_INFO: `/v3/projects/e7c2b7b2003d405a9a5d71c06345658f` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:51.642531 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ed01c-c913-48ee-ac18-0eabf3a67fd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7c2b7b2003d405a9a5d71c06345658f)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:51.643353 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028cf03f-2d46-474f-85ac-8c86574cafe4 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:51.646221 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ed01c-c913-48ee-ac18-0eabf3a67fd8 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:51.660019 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf687f-5d10-47d8-8324-ed3173f4e747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:51.661335 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf687f-5d10-47d8-8324-ed3173f4e747 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:51.661836 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf687f-5d10-47d8-8324-ed3173f4e747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:51.662115 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf687f-5d10-47d8-8324-ed3173f4e747 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:51.662821 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcf687f-5d10-47d8-8324-ed3173f4e747 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:51.664767 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcf687f-5d10-47d8-8324-ed3173f4e747 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:51.699472 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 913/1835] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:08:51 2022] POST /identity/v3/projects => generated 383 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:08:51.704088 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf687f-5d10-47d8-8324-ed3173f4e747 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:51.706959 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-bc0ed01c-c913-48ee-ac18-0eabf3a67fd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7c2b7b2003d405a9a5d71c06345658f', 'request_id': 'req-bc0ed01c-c913-48ee-ac18-0eabf3a67fd8'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:51.712884 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-bc0ed01c-c913-48ee-ac18-0eabf3a67fd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7c2b7b2003d405a9a5d71c06345658f', 'request_id': 'req-bc0ed01c-c913-48ee-ac18-0eabf3a67fd8'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:51.720180 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-bc0ed01c-c913-48ee-ac18-0eabf3a67fd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7c2b7b2003d405a9a5d71c06345658f', 'request_id': 'req-bc0ed01c-c913-48ee-ac18-0eabf3a67fd8'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:51.743475 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-bc0ed01c-c913-48ee-ac18-0eabf3a67fd8 admin admin] The token cache is being invalidate because project e7c2b7b2003d405a9a5d71c06345658f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:08:51.743758 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-bc0ed01c-c913-48ee-ac18-0eabf3a67fd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:51.744727 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-bc0ed01c-c913-48ee-ac18-0eabf3a67fd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:51.746682 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 923/1836] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:08:51 2022] DELETE /identity/v3/projects/e7c2b7b2003d405a9a5d71c06345658f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:51.750486 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ed01c-c913-48ee-ac18-0eabf3a67fd8 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:51.752055 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-bc0ed01c-c913-48ee-ac18-0eabf3a67fd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:51.783641 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf687f-5d10-47d8-8324-ed3173f4e747 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:51.788675 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62dce8e-a148-48ae-81aa-ad966bc41206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:51.789513 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62dce8e-a148-48ae-81aa-ad966bc41206 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:51.789849 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62dce8e-a148-48ae-81aa-ad966bc41206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:51.790123 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62dce8e-a148-48ae-81aa-ad966bc41206 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:51.790827 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62dce8e-a148-48ae-81aa-ad966bc41206 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:51.792879 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62dce8e-a148-48ae-81aa-ad966bc41206 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:51.814164 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 914/1837] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:08:51 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:08:51.818208 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62dce8e-a148-48ae-81aa-ad966bc41206 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:51.819730 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a62dce8e-a148-48ae-81aa-ad966bc41206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:51.824531 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ed01c-c913-48ee-ac18-0eabf3a67fd8 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:51.830500 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a7c96-713d-48fe-975b-e3af2cc1f2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:51.831431 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a7c96-713d-48fe-975b-e3af2cc1f2c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:51.831540 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62dce8e-a148-48ae-81aa-ad966bc41206 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:51.831720 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a7c96-713d-48fe-975b-e3af2cc1f2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:51.832334 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a7c96-713d-48fe-975b-e3af2cc1f2c6 admin admin] PATH_INFO: `/v3/users/cb98e3148ff147019176c87d2c06a6a0` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:51.833483 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a7c96-713d-48fe-975b-e3af2cc1f2c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb98e3148ff147019176c87d2c06a6a0)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:51.835462 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a7c96-713d-48fe-975b-e3af2cc1f2c6 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:51.836052 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51182314-c622-4559-a123-59489a545c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:51.836692 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51182314-c622-4559-a123-59489a545c98 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:51.836983 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51182314-c622-4559-a123-59489a545c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:51.837238 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51182314-c622-4559-a123-59489a545c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:51.837993 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51182314-c622-4559-a123-59489a545c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:51.839581 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51182314-c622-4559-a123-59489a545c98 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:51.850342 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 915/1838] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 19:08:51.854044 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51182314-c622-4559-a123-59489a545c98 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:51.863791 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51182314-c622-4559-a123-59489a545c98 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:51.869256 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c3821-072f-4fbc-a7c6-b348ac815f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:51.869962 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c3821-072f-4fbc-a7c6-b348ac815f19 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:51.870277 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c3821-072f-4fbc-a7c6-b348ac815f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:51.870551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c3821-072f-4fbc-a7c6-b348ac815f19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:51.871332 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c3821-072f-4fbc-a7c6-b348ac815f19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:51.873024 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c3821-072f-4fbc-a7c6-b348ac815f19 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:51.887128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 916/1839] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 19:08:51.887761 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-237a7c96-713d-48fe-975b-e3af2cc1f2c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb98e3148ff147019176c87d2c06a6a0'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:51.888647 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c3821-072f-4fbc-a7c6-b348ac815f19 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:51.897294 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-237a7c96-713d-48fe-975b-e3af2cc1f2c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb98e3148ff147019176c87d2c06a6a0'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:51.902117 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c3821-072f-4fbc-a7c6-b348ac815f19 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:51.905102 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-237a7c96-713d-48fe-975b-e3af2cc1f2c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb98e3148ff147019176c87d2c06a6a0'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:51.905798 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-237a7c96-713d-48fe-975b-e3af2cc1f2c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb98e3148ff147019176c87d2c06a6a0'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:51.908190 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca8564-f8a2-4156-9d63-4d4d7b76057c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:51.909515 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca8564-f8a2-4156-9d63-4d4d7b76057c admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:51.909963 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca8564-f8a2-4156-9d63-4d4d7b76057c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:51.910478 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca8564-f8a2-4156-9d63-4d4d7b76057c admin admin] PATH_INFO: `/v3/projects/8be5f92e0a594b10ad7c10907ee3563b/users/89b0031492374a56aa8c06bdf1e6e77f/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:51.922230 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-237a7c96-713d-48fe-975b-e3af2cc1f2c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb98e3148ff147019176c87d2c06a6a0'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:51.925959 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abca8564-f8a2-4156-9d63-4d4d7b76057c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8be5f92e0a594b10ad7c10907ee3563b, user_id=89b0031492374a56aa8c06bdf1e6e77f, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:51.928660 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abca8564-f8a2-4156-9d63-4d4d7b76057c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:51.934160 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 924/1840] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:08:51 2022] DELETE /identity/v3/users/cb98e3148ff147019176c87d2c06a6a0 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:08:51.953804 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 917/1841] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:08:51 2022] PUT /identity/v3/projects/8be5f92e0a594b10ad7c10907ee3563b/users/89b0031492374a56aa8c06bdf1e6e77f/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:51.959582 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5928a9-4a9c-4dc0-a3d9-b7d38640f3bb None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:51.959952 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5928a9-4a9c-4dc0-a3d9-b7d38640f3bb None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:51.960300 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5928a9-4a9c-4dc0-a3d9-b7d38640f3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:51.991511 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-3a5928a9-4a9c-4dc0-a3d9-b7d38640f3bb None None] MFA Rules not processed for user `89b0031492374a56aa8c06bdf1e6e77f`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:51.992826 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-3a5928a9-4a9c-4dc0-a3d9-b7d38640f3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:52.067133 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 925/1842] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:52.071815 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca8564-f8a2-4156-9d63-4d4d7b76057c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:52.073870 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-abca8564-f8a2-4156-9d63-4d4d7b76057c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:52.163325 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca8564-f8a2-4156-9d63-4d4d7b76057c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:52.169848 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a730e-f2c3-43c5-93fb-923609066e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:52.170815 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a730e-f2c3-43c5-93fb-923609066e88 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:52.171102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a730e-f2c3-43c5-93fb-923609066e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:52.171372 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a730e-f2c3-43c5-93fb-923609066e88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:52.172250 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a730e-f2c3-43c5-93fb-923609066e88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:52.176182 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a730e-f2c3-43c5-93fb-923609066e88 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:52.213209 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 918/1843] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:08:52 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:08:52.213912 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5928a9-4a9c-4dc0-a3d9-b7d38640f3bb None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:52.224595 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5928a9-4a9c-4dc0-a3d9-b7d38640f3bb None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:52.297467 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bfb6f1-6f76-4579-950a-32bb668f1947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:52.298830 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfb6f1-6f76-4579-950a-32bb668f1947 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:52.299319 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfb6f1-6f76-4579-950a-32bb668f1947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:52.299763 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfb6f1-6f76-4579-950a-32bb668f1947 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:52.300764 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bfb6f1-6f76-4579-950a-32bb668f1947 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:52.304017 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bfb6f1-6f76-4579-950a-32bb668f1947 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:52.336675 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 926/1844] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:08:52 2022] POST /identity/v3/users => generated 292 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:08:52.337262 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a730e-f2c3-43c5-93fb-923609066e88 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:52.358149 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a730e-f2c3-43c5-93fb-923609066e88 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:52.363559 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7783b-e4aa-4e87-8290-7da71f2e2c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:52.364232 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7783b-e4aa-4e87-8290-7da71f2e2c8b admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:52.364511 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7783b-e4aa-4e87-8290-7da71f2e2c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:52.364787 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7783b-e4aa-4e87-8290-7da71f2e2c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:52.365525 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7783b-e4aa-4e87-8290-7da71f2e2c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:52.367195 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7783b-e4aa-4e87-8290-7da71f2e2c8b admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:52.382433 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 919/1845] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 19:08:52.387557 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bfb6f1-6f76-4579-950a-32bb668f1947 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:52.402058 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bfb6f1-6f76-4579-950a-32bb668f1947 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:52.407535 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7783b-e4aa-4e87-8290-7da71f2e2c8b admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:52.407960 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9017c-abb7-40e4-9f13-403b03d17d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:52.408687 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9017c-abb7-40e4-9f13-403b03d17d5f admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:52.409077 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9017c-abb7-40e4-9f13-403b03d17d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:52.409987 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-95c7783b-e4aa-4e87-8290-7da71f2e2c8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:52.410119 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9017c-abb7-40e4-9f13-403b03d17d5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:52.410383 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9017c-abb7-40e4-9f13-403b03d17d5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:52.412242 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9017c-abb7-40e4-9f13-403b03d17d5f admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:52.425587 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 927/1846] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:08:52.430486 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7783b-e4aa-4e87-8290-7da71f2e2c8b admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:52.435288 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec879ee1-ef61-4646-a28c-3b923a9af47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:52.436178 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec879ee1-ef61-4646-a28c-3b923a9af47a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:52.436456 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec879ee1-ef61-4646-a28c-3b923a9af47a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:52.437032 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec879ee1-ef61-4646-a28c-3b923a9af47a admin admin] PATH_INFO: `/v3/projects/8aa7d133ebc7467f8186928026813420` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:52.437818 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9017c-abb7-40e4-9f13-403b03d17d5f admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:52.439268 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec879ee1-ef61-4646-a28c-3b923a9af47a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8aa7d133ebc7467f8186928026813420)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:52.441372 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec879ee1-ef61-4646-a28c-3b923a9af47a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:52.451483 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9017c-abb7-40e4-9f13-403b03d17d5f admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:52.456205 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c2916-ea18-4343-b2fe-4c5e6b79b143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:52.457199 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c2916-ea18-4343-b2fe-4c5e6b79b143 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:52.457596 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c2916-ea18-4343-b2fe-4c5e6b79b143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:52.457978 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c2916-ea18-4343-b2fe-4c5e6b79b143 admin admin] PATH_INFO: `/v3/projects/9779ff1718b54f81989206ee60d0123a/users/69130d20d924464b9d94d3d31e5a78ff/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:52.475651 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c2916-ea18-4343-b2fe-4c5e6b79b143 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9779ff1718b54f81989206ee60d0123a, user_id=69130d20d924464b9d94d3d31e5a78ff, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:52.478390 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c2916-ea18-4343-b2fe-4c5e6b79b143 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:52.493858 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ec879ee1-ef61-4646-a28c-3b923a9af47a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aa7d133ebc7467f8186928026813420', 'request_id': 'req-ec879ee1-ef61-4646-a28c-3b923a9af47a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:52.497714 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 928/1847] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:08:52 2022] PUT /identity/v3/projects/9779ff1718b54f81989206ee60d0123a/users/69130d20d924464b9d94d3d31e5a78ff/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:52.505626 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ec879ee1-ef61-4646-a28c-3b923a9af47a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aa7d133ebc7467f8186928026813420', 'request_id': 'req-ec879ee1-ef61-4646-a28c-3b923a9af47a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:52.507554 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916a0c4-da29-4dad-b820-347e1210851e None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:52.508041 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916a0c4-da29-4dad-b820-347e1210851e None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:52.508189 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916a0c4-da29-4dad-b820-347e1210851e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:52.509630 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ec879ee1-ef61-4646-a28c-3b923a9af47a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aa7d133ebc7467f8186928026813420', 'request_id': 'req-ec879ee1-ef61-4646-a28c-3b923a9af47a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:52.521619 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ec879ee1-ef61-4646-a28c-3b923a9af47a admin admin] The token cache is being invalidate because project 8aa7d133ebc7467f8186928026813420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:08:52.521982 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ec879ee1-ef61-4646-a28c-3b923a9af47a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:52.522750 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ec879ee1-ef61-4646-a28c-3b923a9af47a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:52.524711 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 920/1848] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:08:52 2022] DELETE /identity/v3/projects/8aa7d133ebc7467f8186928026813420 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:08:52.529905 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d6166-ac96-4edf-93b8-1fed435261a2 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:52.530255 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d6166-ac96-4edf-93b8-1fed435261a2 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:52.530723 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d6166-ac96-4edf-93b8-1fed435261a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:52.536518 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-c916a0c4-da29-4dad-b820-347e1210851e None None] MFA Rules not processed for user `69130d20d924464b9d94d3d31e5a78ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:52.537753 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-c916a0c4-da29-4dad-b820-347e1210851e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:52.549559 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-045d6166-ac96-4edf-93b8-1fed435261a2 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:52.550930 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-045d6166-ac96-4edf-93b8-1fed435261a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:52.604973 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 929/1849] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:52.609417 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916a0c4-da29-4dad-b820-347e1210851e None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:52.610833 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-c916a0c4-da29-4dad-b820-347e1210851e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:52.614968 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 921/1850] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:52.623853 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242c9ef-9957-48e0-9f6b-f06d3bb5331b None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:52.624151 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242c9ef-9957-48e0-9f6b-f06d3bb5331b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:52.624500 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242c9ef-9957-48e0-9f6b-f06d3bb5331b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:52.624876 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916a0c4-da29-4dad-b820-347e1210851e None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:52.629615 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d098c1-76d1-4c17-b933-d56fc28968b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:52.630354 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d098c1-76d1-4c17-b933-d56fc28968b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:52.630703 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d098c1-76d1-4c17-b933-d56fc28968b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:52.631047 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d098c1-76d1-4c17-b933-d56fc28968b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:52.631814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d098c1-76d1-4c17-b933-d56fc28968b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:52.633864 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d098c1-76d1-4c17-b933-d56fc28968b8 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:52.644040 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-2242c9ef-9957-48e0-9f6b-f06d3bb5331b None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:52.645233 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2242c9ef-9957-48e0-9f6b-f06d3bb5331b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:52.654676 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 922/1851] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:08:52.659520 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242c9ef-9957-48e0-9f6b-f06d3bb5331b None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:52.665715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 930/1852] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:08:52 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:08:52.668544 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d098c1-76d1-4c17-b933-d56fc28968b8 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:52.670507 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242c9ef-9957-48e0-9f6b-f06d3bb5331b None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:52.751164 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba07a2d-2e90-4dcb-b0d9-55a0bc919394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:52.751852 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba07a2d-2e90-4dcb-b0d9-55a0bc919394 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:52.752609 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba07a2d-2e90-4dcb-b0d9-55a0bc919394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:52.752891 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba07a2d-2e90-4dcb-b0d9-55a0bc919394 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:52.753694 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba07a2d-2e90-4dcb-b0d9-55a0bc919394 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:08:52.754005 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba07a2d-2e90-4dcb-b0d9-55a0bc919394 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:52.755685 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba07a2d-2e90-4dcb-b0d9-55a0bc919394 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:52.760141 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d098c1-76d1-4c17-b933-d56fc28968b8 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:52.767568 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf7c67-24f2-4259-bb1d-e58ffd959a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:52.768576 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf7c67-24f2-4259-bb1d-e58ffd959a56 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:52.769071 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf7c67-24f2-4259-bb1d-e58ffd959a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:52.772841 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 923/1853] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 19:08:52.773311 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf7c67-24f2-4259-bb1d-e58ffd959a56 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:52.774146 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba07a2d-2e90-4dcb-b0d9-55a0bc919394 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:52.774545 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf7c67-24f2-4259-bb1d-e58ffd959a56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:52.776734 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf7c67-24f2-4259-bb1d-e58ffd959a56 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:52.787257 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba07a2d-2e90-4dcb-b0d9-55a0bc919394 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:52.794101 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436fc80-e16c-4b20-b31b-6374219b6512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:52.794861 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436fc80-e16c-4b20-b31b-6374219b6512 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:52.795466 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436fc80-e16c-4b20-b31b-6374219b6512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:52.795601 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436fc80-e16c-4b20-b31b-6374219b6512 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:52.796472 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c436fc80-e16c-4b20-b31b-6374219b6512 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:52.798732 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c436fc80-e16c-4b20-b31b-6374219b6512 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:52.810986 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 931/1854] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:08:52 2022] POST /identity/v3/users => generated 297 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:08:52.815819 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf7c67-24f2-4259-bb1d-e58ffd959a56 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:52.833806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 924/1855] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:08:52 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:08:52.834567 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436fc80-e16c-4b20-b31b-6374219b6512 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:52.840348 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf7c67-24f2-4259-bb1d-e58ffd959a56 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:52.898230 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0b03c-96b3-48c0-bf39-617d19fc6d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:52.898912 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0b03c-96b3-48c0-bf39-617d19fc6d10 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:52.899199 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0b03c-96b3-48c0-bf39-617d19fc6d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:52.899472 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0b03c-96b3-48c0-bf39-617d19fc6d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:52.900221 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce0b03c-96b3-48c0-bf39-617d19fc6d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:52.901897 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce0b03c-96b3-48c0-bf39-617d19fc6d10 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:52.915544 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 932/1856] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 19:08:52.919028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436fc80-e16c-4b20-b31b-6374219b6512 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:52.919526 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0b03c-96b3-48c0-bf39-617d19fc6d10 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:52.923832 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc748b2-afd4-4070-96a1-fcb49f1d6697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:52.924507 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc748b2-afd4-4070-96a1-fcb49f1d6697 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:52.924782 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc748b2-afd4-4070-96a1-fcb49f1d6697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:52.925063 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc748b2-afd4-4070-96a1-fcb49f1d6697 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:52.925877 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc748b2-afd4-4070-96a1-fcb49f1d6697 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:52.927710 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc748b2-afd4-4070-96a1-fcb49f1d6697 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:52.931728 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0b03c-96b3-48c0-bf39-617d19fc6d10 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:52.936451 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb640764-95d8-4966-9570-1efdccb6b355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:52.937430 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb640764-95d8-4966-9570-1efdccb6b355 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:52.937739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb640764-95d8-4966-9570-1efdccb6b355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:52.938014 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb640764-95d8-4966-9570-1efdccb6b355 admin admin] PATH_INFO: `/v3/projects/832ba4f533a946d2bea9a7ae37a052f9/users/6617529ae8fd4a0783fd5d22abcb8cbb/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:52.949215 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 925/1857] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:08:52 2022] POST /identity/v3/users => generated 291 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:08:52.953218 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc748b2-afd4-4070-96a1-fcb49f1d6697 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:52.954331 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb640764-95d8-4966-9570-1efdccb6b355 admin admin] RBAC: Authorizing `identity:create_grant(project_id=832ba4f533a946d2bea9a7ae37a052f9, user_id=6617529ae8fd4a0783fd5d22abcb8cbb, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:52.957044 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb640764-95d8-4966-9570-1efdccb6b355 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:52.963628 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc748b2-afd4-4070-96a1-fcb49f1d6697 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:52.969517 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29bca49-0ab3-4921-be73-86ea47b22320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:52.970391 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bca49-0ab3-4921-be73-86ea47b22320 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:52.970713 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bca49-0ab3-4921-be73-86ea47b22320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:52.970926 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bca49-0ab3-4921-be73-86ea47b22320 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:52.971659 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29bca49-0ab3-4921-be73-86ea47b22320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:52.973261 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29bca49-0ab3-4921-be73-86ea47b22320 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:52.973565 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 933/1858] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:08:52 2022] PUT /identity/v3/projects/832ba4f533a946d2bea9a7ae37a052f9/users/6617529ae8fd4a0783fd5d22abcb8cbb/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:52.977432 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb640764-95d8-4966-9570-1efdccb6b355 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:52.988214 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 926/1859] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:08:52.989312 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29bca49-0ab3-4921-be73-86ea47b22320 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:52.999328 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29bca49-0ab3-4921-be73-86ea47b22320 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:53.038159 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb640764-95d8-4966-9570-1efdccb6b355 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:53.043539 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02353e-5f02-40dd-9424-4cc8ade6b485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:53.043784 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02353e-5f02-40dd-9424-4cc8ade6b485 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:53.044375 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02353e-5f02-40dd-9424-4cc8ade6b485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:53.044674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02353e-5f02-40dd-9424-4cc8ade6b485 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:53.045523 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c02353e-5f02-40dd-9424-4cc8ade6b485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:53.047383 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c02353e-5f02-40dd-9424-4cc8ade6b485 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:53.058017 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 934/1860] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 19:08:53.062448 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d7e80-94ae-4d09-87f4-a3519905ddaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:53.062622 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02353e-5f02-40dd-9424-4cc8ade6b485 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:53.063205 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d7e80-94ae-4d09-87f4-a3519905ddaa admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:53.063497 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d7e80-94ae-4d09-87f4-a3519905ddaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:53.063767 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d7e80-94ae-4d09-87f4-a3519905ddaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:53.064513 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d7e80-94ae-4d09-87f4-a3519905ddaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:53.066258 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d7e80-94ae-4d09-87f4-a3519905ddaa admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:53.074217 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02353e-5f02-40dd-9424-4cc8ade6b485 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:53.080438 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 927/1861] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:08:53.081978 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d7e80-94ae-4d09-87f4-a3519905ddaa admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:53.084257 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a2414-37e0-4fbf-a0f4-039c0f5a8a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:53.085423 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a2414-37e0-4fbf-a0f4-039c0f5a8a9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:53.085939 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a2414-37e0-4fbf-a0f4-039c0f5a8a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:53.086411 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a2414-37e0-4fbf-a0f4-039c0f5a8a9d admin admin] PATH_INFO: `/v3/projects/832ba4f533a946d2bea9a7ae37a052f9/users/6617529ae8fd4a0783fd5d22abcb8cbb/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:53.089240 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900a2414-37e0-4fbf-a0f4-039c0f5a8a9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=832ba4f533a946d2bea9a7ae37a052f9, user_id=6617529ae8fd4a0783fd5d22abcb8cbb, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:53.093122 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900a2414-37e0-4fbf-a0f4-039c0f5a8a9d admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:53.095010 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d7e80-94ae-4d09-87f4-a3519905ddaa admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:53.101650 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c271ef-3383-47e9-ae9c-bd9f43e4da34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:53.102456 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c271ef-3383-47e9-ae9c-bd9f43e4da34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:53.103035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c271ef-3383-47e9-ae9c-bd9f43e4da34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:53.103453 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c271ef-3383-47e9-ae9c-bd9f43e4da34 admin admin] PATH_INFO: `/v3/projects/1a0afb6684af44b9b8247b1d1d880bc2/users/87cc6a86a85744c1bde075ff277156f2/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:53.107933 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 935/1862] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:08:53 2022] PUT /identity/v3/projects/832ba4f533a946d2bea9a7ae37a052f9/users/6617529ae8fd4a0783fd5d22abcb8cbb/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:53.118907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92551b-8609-4883-9c4e-1b764cdf9c5d None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:53.124209 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92551b-8609-4883-9c4e-1b764cdf9c5d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:53.124209 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92551b-8609-4883-9c4e-1b764cdf9c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:53.139871 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c271ef-3383-47e9-ae9c-bd9f43e4da34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a0afb6684af44b9b8247b1d1d880bc2, user_id=87cc6a86a85744c1bde075ff277156f2, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:53.142984 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c271ef-3383-47e9-ae9c-bd9f43e4da34 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:53.174214 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-6b92551b-8609-4883-9c4e-1b764cdf9c5d None None] MFA Rules not processed for user `6617529ae8fd4a0783fd5d22abcb8cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:53.175740 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-6b92551b-8609-4883-9c4e-1b764cdf9c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:53.194664 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 928/1863] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:08:53 2022] PUT /identity/v3/projects/1a0afb6684af44b9b8247b1d1d880bc2/users/87cc6a86a85744c1bde075ff277156f2/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:53.207720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a0237-bfa3-4f12-92d0-e82b903744e9 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:53.208239 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a0237-bfa3-4f12-92d0-e82b903744e9 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:53.208729 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a0237-bfa3-4f12-92d0-e82b903744e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:53.260580 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-7b0a0237-bfa3-4f12-92d0-e82b903744e9 None None] MFA Rules not processed for user `87cc6a86a85744c1bde075ff277156f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:53.262797 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7b0a0237-bfa3-4f12-92d0-e82b903744e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:53.331022 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 936/1864] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:53.338898 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92551b-8609-4883-9c4e-1b764cdf9c5d None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:53.341170 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-6b92551b-8609-4883-9c4e-1b764cdf9c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:53.375215 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 929/1865] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:53.379760 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a0237-bfa3-4f12-92d0-e82b903744e9 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:53.436307 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92551b-8609-4883-9c4e-1b764cdf9c5d None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:53.468758 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a0237-bfa3-4f12-92d0-e82b903744e9 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:53.477711 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8126d-3ec7-4284-b62f-9d8a32af9106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:53.480207 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8126d-3ec7-4284-b62f-9d8a32af9106 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:53.480543 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8126d-3ec7-4284-b62f-9d8a32af9106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:53.480889 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8126d-3ec7-4284-b62f-9d8a32af9106 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:53.482062 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8126d-3ec7-4284-b62f-9d8a32af9106 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:53.485647 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8126d-3ec7-4284-b62f-9d8a32af9106 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:53.506292 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d74bec-193b-47fd-9c01-aaa3a9aad5e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:53.507763 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d74bec-193b-47fd-9c01-aaa3a9aad5e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:53.508149 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d74bec-193b-47fd-9c01-aaa3a9aad5e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:53.508426 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d74bec-193b-47fd-9c01-aaa3a9aad5e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:53.511273 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-49d74bec-193b-47fd-9c01-aaa3a9aad5e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:53.521587 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 930/1866] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:08:53 2022] POST /identity/v3/projects => generated 379 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:08:53.525314 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8126d-3ec7-4284-b62f-9d8a32af9106 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:53.600553 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8126d-3ec7-4284-b62f-9d8a32af9106 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:53.603976 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d74bec-193b-47fd-9c01-aaa3a9aad5e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:53.605467 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d74bec-193b-47fd-9c01-aaa3a9aad5e7 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:53.610701 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110b765-8c1c-47f4-b63d-fb76f83e62e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:53.611499 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110b765-8c1c-47f4-b63d-fb76f83e62e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:53.611781 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110b765-8c1c-47f4-b63d-fb76f83e62e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:53.612051 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110b765-8c1c-47f4-b63d-fb76f83e62e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:53.612776 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e110b765-8c1c-47f4-b63d-fb76f83e62e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:53.614424 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 937/1867] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:08:53.614809 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e110b765-8c1c-47f4-b63d-fb76f83e62e6 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:53.638550 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 931/1868] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:08:53 2022] POST /identity/v3/users => generated 296 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:08:53.639773 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d74bec-193b-47fd-9c01-aaa3a9aad5e7 service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:53.650962 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d74bec-193b-47fd-9c01-aaa3a9aad5e7 service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:53.655985 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c1ded-a85a-45fc-ad49-60720b690c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:53.656648 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c1ded-a85a-45fc-ad49-60720b690c6b admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:53.656937 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c1ded-a85a-45fc-ad49-60720b690c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:53.657211 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c1ded-a85a-45fc-ad49-60720b690c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:53.657998 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c1ded-a85a-45fc-ad49-60720b690c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:53.659603 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c1ded-a85a-45fc-ad49-60720b690c6b admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:53.672548 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 938/1869] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 19:08:53.673801 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110b765-8c1c-47f4-b63d-fb76f83e62e6 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:53.684811 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110b765-8c1c-47f4-b63d-fb76f83e62e6 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:53.690187 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585327d-b4e8-4149-8857-067659d8d421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:53.691131 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585327d-b4e8-4149-8857-067659d8d421 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:53.691412 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585327d-b4e8-4149-8857-067659d8d421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:53.691683 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585327d-b4e8-4149-8857-067659d8d421 admin admin] PATH_INFO: `/v3/projects/0260c21969184358bbc2d02874d7d5da/users/fa1e4c55a57e44449fd413df223164b5/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:53.706856 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585327d-b4e8-4149-8857-067659d8d421 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0260c21969184358bbc2d02874d7d5da, user_id=fa1e4c55a57e44449fd413df223164b5, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:53.709521 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585327d-b4e8-4149-8857-067659d8d421 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:53.722610 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 932/1870] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:08:53 2022] PUT /identity/v3/projects/0260c21969184358bbc2d02874d7d5da/users/fa1e4c55a57e44449fd413df223164b5/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:53.726646 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c1ded-a85a-45fc-ad49-60720b690c6b admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:53.737108 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c1ded-a85a-45fc-ad49-60720b690c6b admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:53.796120 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39815d33-acc5-46ce-84ce-08e3ecf6aeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:53.796809 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39815d33-acc5-46ce-84ce-08e3ecf6aeb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:53.797091 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39815d33-acc5-46ce-84ce-08e3ecf6aeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:53.797431 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39815d33-acc5-46ce-84ce-08e3ecf6aeb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:53.798846 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39815d33-acc5-46ce-84ce-08e3ecf6aeb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:53.801048 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39815d33-acc5-46ce-84ce-08e3ecf6aeb1 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:53.816282 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 939/1871] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:08:53.817660 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585327d-b4e8-4149-8857-067659d8d421 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:53.828350 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585327d-b4e8-4149-8857-067659d8d421 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:53.833112 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2babc-0e52-4942-9e25-a8ff3df601b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:53.834033 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2babc-0e52-4942-9e25-a8ff3df601b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:53.834317 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2babc-0e52-4942-9e25-a8ff3df601b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:53.834587 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2babc-0e52-4942-9e25-a8ff3df601b8 admin admin] PATH_INFO: `/v3/projects/0260c21969184358bbc2d02874d7d5da/users/fa1e4c55a57e44449fd413df223164b5/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:53.836577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f2babc-0e52-4942-9e25-a8ff3df601b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0260c21969184358bbc2d02874d7d5da, user_id=fa1e4c55a57e44449fd413df223164b5, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:53.839282 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f2babc-0e52-4942-9e25-a8ff3df601b8 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:53.850699 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 933/1872] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:08:53 2022] PUT /identity/v3/projects/0260c21969184358bbc2d02874d7d5da/users/fa1e4c55a57e44449fd413df223164b5/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:53.865806 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1992d62-c017-4b2b-acc1-e9ee86b17e14 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:53.866101 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1992d62-c017-4b2b-acc1-e9ee86b17e14 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:53.866373 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1992d62-c017-4b2b-acc1-e9ee86b17e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:53.900969 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-a1992d62-c017-4b2b-acc1-e9ee86b17e14 None None] MFA Rules not processed for user `fa1e4c55a57e44449fd413df223164b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:53.902572 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a1992d62-c017-4b2b-acc1-e9ee86b17e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:53.983767 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 940/1873] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:53 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:53.995210 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2babc-0e52-4942-9e25-a8ff3df601b8 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:54.049371 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2babc-0e52-4942-9e25-a8ff3df601b8 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:54.053333 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb9915-8e34-4cb4-8fc0-ee7d789712c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:54.054036 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb9915-8e34-4cb4-8fc0-ee7d789712c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:54.054318 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb9915-8e34-4cb4-8fc0-ee7d789712c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:54.054593 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb9915-8e34-4cb4-8fc0-ee7d789712c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:54.063811 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cb9915-8e34-4cb4-8fc0-ee7d789712c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:54.065237 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cb9915-8e34-4cb4-8fc0-ee7d789712c8 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:54.075567 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 934/1874] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:08:54.483246 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1992d62-c017-4b2b-acc1-e9ee86b17e14 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:54.546964 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1992d62-c017-4b2b-acc1-e9ee86b17e14 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:54.552060 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d64b0-be9c-4021-9dae-61cc6753caae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:54.552953 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d64b0-be9c-4021-9dae-61cc6753caae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:54.553845 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d64b0-be9c-4021-9dae-61cc6753caae admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:54.554126 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d64b0-be9c-4021-9dae-61cc6753caae admin admin] PATH_INFO: `/v3/users/87cc6a86a85744c1bde075ff277156f2` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:54.555349 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d64b0-be9c-4021-9dae-61cc6753caae admin admin] RBAC: Authorizing `identity:delete_user(user_id=87cc6a86a85744c1bde075ff277156f2)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:54.557393 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d64b0-be9c-4021-9dae-61cc6753caae admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:54.604661 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-7f0d64b0-be9c-4021-9dae-61cc6753caae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87cc6a86a85744c1bde075ff277156f2'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:54.615030 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-7f0d64b0-be9c-4021-9dae-61cc6753caae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87cc6a86a85744c1bde075ff277156f2'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:54.622012 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-7f0d64b0-be9c-4021-9dae-61cc6753caae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87cc6a86a85744c1bde075ff277156f2'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:54.622726 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-7f0d64b0-be9c-4021-9dae-61cc6753caae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87cc6a86a85744c1bde075ff277156f2'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:54.634529 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-7f0d64b0-be9c-4021-9dae-61cc6753caae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87cc6a86a85744c1bde075ff277156f2'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:54.640947 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 941/1875] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:08:54 2022] DELETE /identity/v3/users/87cc6a86a85744c1bde075ff277156f2 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:54.645563 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77957ba5-da34-4fe6-a1cb-76e61d9e7683 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:54.645876 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77957ba5-da34-4fe6-a1cb-76e61d9e7683 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:54.646152 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77957ba5-da34-4fe6-a1cb-76e61d9e7683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:54.664341 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-77957ba5-da34-4fe6-a1cb-76e61d9e7683 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:54.665566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-77957ba5-da34-4fe6-a1cb-76e61d9e7683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:54.725947 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 935/1876] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:54.736165 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d64b0-be9c-4021-9dae-61cc6753caae admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:54.737641 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-7f0d64b0-be9c-4021-9dae-61cc6753caae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:54.792899 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d64b0-be9c-4021-9dae-61cc6753caae admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:54.796535 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94afec8-7d38-45c2-87df-d31484d7f26c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:54.797182 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94afec8-7d38-45c2-87df-d31484d7f26c service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:54.797461 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94afec8-7d38-45c2-87df-d31484d7f26c service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:54.797769 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94afec8-7d38-45c2-87df-d31484d7f26c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:54.806603 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94afec8-7d38-45c2-87df-d31484d7f26c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:54.808039 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94afec8-7d38-45c2-87df-d31484d7f26c service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:54.817221 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 942/1877] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:08:55.136301 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77957ba5-da34-4fe6-a1cb-76e61d9e7683 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:55.138118 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-77957ba5-da34-4fe6-a1cb-76e61d9e7683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:55.150254 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77957ba5-da34-4fe6-a1cb-76e61d9e7683 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:55.157837 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9ec0d-73e9-4067-ba0a-14131963814c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:55.163345 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9ec0d-73e9-4067-ba0a-14131963814c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:55.163345 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9ec0d-73e9-4067-ba0a-14131963814c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:55.163345 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9ec0d-73e9-4067-ba0a-14131963814c admin admin] PATH_INFO: `/v3/projects/1a0afb6684af44b9b8247b1d1d880bc2` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:55.169292 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9ec0d-73e9-4067-ba0a-14131963814c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a0afb6684af44b9b8247b1d1d880bc2)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:55.171455 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9ec0d-73e9-4067-ba0a-14131963814c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:55.227207 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-97a9ec0d-73e9-4067-ba0a-14131963814c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a0afb6684af44b9b8247b1d1d880bc2', 'request_id': 'req-97a9ec0d-73e9-4067-ba0a-14131963814c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:55.234692 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-97a9ec0d-73e9-4067-ba0a-14131963814c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a0afb6684af44b9b8247b1d1d880bc2', 'request_id': 'req-97a9ec0d-73e9-4067-ba0a-14131963814c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:55.240190 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-97a9ec0d-73e9-4067-ba0a-14131963814c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a0afb6684af44b9b8247b1d1d880bc2', 'request_id': 'req-97a9ec0d-73e9-4067-ba0a-14131963814c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:55.251188 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-97a9ec0d-73e9-4067-ba0a-14131963814c admin admin] The token cache is being invalidate because project 1a0afb6684af44b9b8247b1d1d880bc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:08:55.251475 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-97a9ec0d-73e9-4067-ba0a-14131963814c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:55.252133 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-97a9ec0d-73e9-4067-ba0a-14131963814c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:55.253780 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 936/1878] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:08:55 2022] DELETE /identity/v3/projects/1a0afb6684af44b9b8247b1d1d880bc2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:55.257806 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94afec8-7d38-45c2-87df-d31484d7f26c service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:55.267438 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94afec8-7d38-45c2-87df-d31484d7f26c service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:55.329494 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a91d55-a5a8-4b72-8e43-74372c913bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:55.330804 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a91d55-a5a8-4b72-8e43-74372c913bba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:55.331085 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a91d55-a5a8-4b72-8e43-74372c913bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:55.331362 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a91d55-a5a8-4b72-8e43-74372c913bba admin admin] PATH_INFO: `/v3/users/fa1e4c55a57e44449fd413df223164b5` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:55.333190 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a91d55-a5a8-4b72-8e43-74372c913bba admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa1e4c55a57e44449fd413df223164b5)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:55.335990 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a91d55-a5a8-4b72-8e43-74372c913bba admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:55.390008 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-67a91d55-a5a8-4b72-8e43-74372c913bba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa1e4c55a57e44449fd413df223164b5'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:55.397695 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-67a91d55-a5a8-4b72-8e43-74372c913bba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa1e4c55a57e44449fd413df223164b5'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:55.405104 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-67a91d55-a5a8-4b72-8e43-74372c913bba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa1e4c55a57e44449fd413df223164b5'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:55.405789 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-67a91d55-a5a8-4b72-8e43-74372c913bba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa1e4c55a57e44449fd413df223164b5'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:55.417011 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-67a91d55-a5a8-4b72-8e43-74372c913bba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa1e4c55a57e44449fd413df223164b5'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:55.422950 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 943/1879] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:08:55 2022] DELETE /identity/v3/users/fa1e4c55a57e44449fd413df223164b5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:55.703617 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9ec0d-73e9-4067-ba0a-14131963814c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:55.705104 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-97a9ec0d-73e9-4067-ba0a-14131963814c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:55.718409 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9ec0d-73e9-4067-ba0a-14131963814c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:55.773972 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed889fc6-6d2e-41e8-aeb1-08ab1c7cf18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:55.774848 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed889fc6-6d2e-41e8-aeb1-08ab1c7cf18b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:55.775123 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed889fc6-6d2e-41e8-aeb1-08ab1c7cf18b admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:55.775391 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed889fc6-6d2e-41e8-aeb1-08ab1c7cf18b admin admin] PATH_INFO: `/v3/projects/0260c21969184358bbc2d02874d7d5da` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:55.776543 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed889fc6-6d2e-41e8-aeb1-08ab1c7cf18b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0260c21969184358bbc2d02874d7d5da)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:55.778563 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed889fc6-6d2e-41e8-aeb1-08ab1c7cf18b admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:55.862561 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ed889fc6-6d2e-41e8-aeb1-08ab1c7cf18b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0260c21969184358bbc2d02874d7d5da', 'request_id': 'req-ed889fc6-6d2e-41e8-aeb1-08ab1c7cf18b'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:55.874829 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ed889fc6-6d2e-41e8-aeb1-08ab1c7cf18b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0260c21969184358bbc2d02874d7d5da', 'request_id': 'req-ed889fc6-6d2e-41e8-aeb1-08ab1c7cf18b'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:55.882758 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ed889fc6-6d2e-41e8-aeb1-08ab1c7cf18b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0260c21969184358bbc2d02874d7d5da', 'request_id': 'req-ed889fc6-6d2e-41e8-aeb1-08ab1c7cf18b'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:55.895733 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ed889fc6-6d2e-41e8-aeb1-08ab1c7cf18b admin admin] The token cache is being invalidate because project 0260c21969184358bbc2d02874d7d5da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:08:55.896168 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ed889fc6-6d2e-41e8-aeb1-08ab1c7cf18b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:55.896791 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ed889fc6-6d2e-41e8-aeb1-08ab1c7cf18b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:55.898901 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 937/1880] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:08:55 2022] DELETE /identity/v3/projects/0260c21969184358bbc2d02874d7d5da => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:55.904246 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1044bb-4138-43e2-9e78-ace104b7cc04 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:55.904738 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1044bb-4138-43e2-9e78-ace104b7cc04 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:55.904857 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1044bb-4138-43e2-9e78-ace104b7cc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:55.928569 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-1e1044bb-4138-43e2-9e78-ace104b7cc04 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:55.929923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-1e1044bb-4138-43e2-9e78-ace104b7cc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:56.004720 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 944/1881] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:56.006971 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ce75e-5e02-4b03-b947-4ecd7ef13e15 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:56.007322 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ce75e-5e02-4b03-b947-4ecd7ef13e15 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:56.007623 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ce75e-5e02-4b03-b947-4ecd7ef13e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:56.036428 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-b65ce75e-5e02-4b03-b947-4ecd7ef13e15 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:56.037699 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b65ce75e-5e02-4b03-b947-4ecd7ef13e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:56.053575 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 938/1882] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:56.055829 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1044bb-4138-43e2-9e78-ace104b7cc04 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:56.069041 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1044bb-4138-43e2-9e78-ace104b7cc04 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:56.077185 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617996f-6f32-4f3b-a773-88ba092e82ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:56.077857 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617996f-6f32-4f3b-a773-88ba092e82ef admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:56.078139 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617996f-6f32-4f3b-a773-88ba092e82ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:56.078405 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617996f-6f32-4f3b-a773-88ba092e82ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:56.079217 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617996f-6f32-4f3b-a773-88ba092e82ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:08:56.079531 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617996f-6f32-4f3b-a773-88ba092e82ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:56.081410 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617996f-6f32-4f3b-a773-88ba092e82ef admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:56.097568 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 945/1883] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:08:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:08:56.099966 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ce75e-5e02-4b03-b947-4ecd7ef13e15 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:56.121670 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ce75e-5e02-4b03-b947-4ecd7ef13e15 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:56.125649 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c83b8-f39b-4537-842f-9a0be002a19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:56.126341 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c83b8-f39b-4537-842f-9a0be002a19f admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:56.126622 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c83b8-f39b-4537-842f-9a0be002a19f admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:56.126916 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c83b8-f39b-4537-842f-9a0be002a19f admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:56.127711 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c83b8-f39b-4537-842f-9a0be002a19f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:56.129955 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c83b8-f39b-4537-842f-9a0be002a19f admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:56.161906 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 939/1884] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:08:56 2022] POST /identity/v3/projects => generated 381 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:08:56.163089 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617996f-6f32-4f3b-a773-88ba092e82ef admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:56.175772 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617996f-6f32-4f3b-a773-88ba092e82ef admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:56.239344 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b901f62-13f3-4a6f-9a87-5ac9171fca6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:56.240037 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b901f62-13f3-4a6f-9a87-5ac9171fca6f admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:56.240325 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b901f62-13f3-4a6f-9a87-5ac9171fca6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:56.240614 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b901f62-13f3-4a6f-9a87-5ac9171fca6f admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:56.241483 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b901f62-13f3-4a6f-9a87-5ac9171fca6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:56.243564 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b901f62-13f3-4a6f-9a87-5ac9171fca6f admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:56.276456 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 946/1885] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:08:56 2022] POST /identity/v3/users => generated 291 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:08:56.278381 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c83b8-f39b-4537-842f-9a0be002a19f admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:56.292815 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c83b8-f39b-4537-842f-9a0be002a19f admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:56.298505 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00b74d-9006-4912-8211-bf9b82eda786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:56.299667 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00b74d-9006-4912-8211-bf9b82eda786 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:56.299981 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00b74d-9006-4912-8211-bf9b82eda786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:56.300605 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00b74d-9006-4912-8211-bf9b82eda786 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:56.301617 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a00b74d-9006-4912-8211-bf9b82eda786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:56.303584 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a00b74d-9006-4912-8211-bf9b82eda786 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:56.330306 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 940/1886] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 19:08:56.332886 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b901f62-13f3-4a6f-9a87-5ac9171fca6f admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:56.344188 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b901f62-13f3-4a6f-9a87-5ac9171fca6f admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:56.363903 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4b22a-7e58-44c8-b38e-c271a02a48c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:56.364798 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4b22a-7e58-44c8-b38e-c271a02a48c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:56.365275 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4b22a-7e58-44c8-b38e-c271a02a48c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:56.365583 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4b22a-7e58-44c8-b38e-c271a02a48c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:56.366369 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4b22a-7e58-44c8-b38e-c271a02a48c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:56.372403 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4b22a-7e58-44c8-b38e-c271a02a48c0 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:56.401705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 947/1887] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:08:56.403131 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00b74d-9006-4912-8211-bf9b82eda786 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:56.419544 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00b74d-9006-4912-8211-bf9b82eda786 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:56.425343 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b03d8-e447-491b-ad6b-96fdedf8e6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:56.426808 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b03d8-e447-491b-ad6b-96fdedf8e6bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:56.427286 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b03d8-e447-491b-ad6b-96fdedf8e6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:56.427751 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b03d8-e447-491b-ad6b-96fdedf8e6bf admin admin] PATH_INFO: `/v3/projects/230ffb2a6d7e4e32af88c59fd8fadfc0/users/c2925a3ac13a4b78bfe614662a47b803/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:56.457631 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b03d8-e447-491b-ad6b-96fdedf8e6bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=230ffb2a6d7e4e32af88c59fd8fadfc0, user_id=c2925a3ac13a4b78bfe614662a47b803, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:56.460659 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b03d8-e447-491b-ad6b-96fdedf8e6bf admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:56.486485 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 941/1888] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:08:56 2022] PUT /identity/v3/projects/230ffb2a6d7e4e32af88c59fd8fadfc0/users/c2925a3ac13a4b78bfe614662a47b803/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:08:56.491198 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded08fa-bb11-4dde-b52a-dd18104bc65a None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:56.491491 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded08fa-bb11-4dde-b52a-dd18104bc65a None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:56.491772 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded08fa-bb11-4dde-b52a-dd18104bc65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:56.565436 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-bded08fa-bb11-4dde-b52a-dd18104bc65a None None] MFA Rules not processed for user `c2925a3ac13a4b78bfe614662a47b803`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:56.571090 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-bded08fa-bb11-4dde-b52a-dd18104bc65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:56.687280 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 948/1889] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:56.692554 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b03d8-e447-491b-ad6b-96fdedf8e6bf admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:56.757696 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b03d8-e447-491b-ad6b-96fdedf8e6bf admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:56.762744 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243a1d6-3aeb-46b4-abb0-fbb804c22fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:56.763496 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243a1d6-3aeb-46b4-abb0-fbb804c22fc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:56.763785 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243a1d6-3aeb-46b4-abb0-fbb804c22fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:56.764054 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243a1d6-3aeb-46b4-abb0-fbb804c22fc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:56.764920 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6243a1d6-3aeb-46b4-abb0-fbb804c22fc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:56.766999 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6243a1d6-3aeb-46b4-abb0-fbb804c22fc3 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:56.799663 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 942/1890] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:08:56 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:08:56.803725 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded08fa-bb11-4dde-b52a-dd18104bc65a None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:56.823328 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded08fa-bb11-4dde-b52a-dd18104bc65a None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:56.884199 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56138c-1fda-4c77-b156-754642423c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:56.884774 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56138c-1fda-4c77-b156-754642423c01 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:56.885436 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56138c-1fda-4c77-b156-754642423c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:56.885436 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56138c-1fda-4c77-b156-754642423c01 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:56.886112 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c56138c-1fda-4c77-b156-754642423c01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:56.888201 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c56138c-1fda-4c77-b156-754642423c01 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:56.913165 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 949/1891] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:08:56 2022] POST /identity/v3/users => generated 297 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:08:56.915089 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243a1d6-3aeb-46b4-abb0-fbb804c22fc3 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:56.926670 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243a1d6-3aeb-46b4-abb0-fbb804c22fc3 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:56.932379 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6e8de-3b32-4b09-80b8-a76f95e175ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:56.933056 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6e8de-3b32-4b09-80b8-a76f95e175ba admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:56.933474 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6e8de-3b32-4b09-80b8-a76f95e175ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:56.933706 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6e8de-3b32-4b09-80b8-a76f95e175ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:56.934429 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6e8de-3b32-4b09-80b8-a76f95e175ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:56.936119 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6e8de-3b32-4b09-80b8-a76f95e175ba admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:56.946853 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 943/1892] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:08:56.951135 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56138c-1fda-4c77-b156-754642423c01 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:56.961086 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56138c-1fda-4c77-b156-754642423c01 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:56.965904 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067992a-03f3-411d-ab3a-7236dc96d226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:56.966793 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067992a-03f3-411d-ab3a-7236dc96d226 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:56.967071 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067992a-03f3-411d-ab3a-7236dc96d226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:56.967353 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067992a-03f3-411d-ab3a-7236dc96d226 admin admin] PATH_INFO: `/v3/projects/61c640685ac6437b8b7f3645fa58f6ee/users/8e270855de234765a746d863f031fe2f/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:56.983064 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067992a-03f3-411d-ab3a-7236dc96d226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61c640685ac6437b8b7f3645fa58f6ee, user_id=8e270855de234765a746d863f031fe2f, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:56.986083 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067992a-03f3-411d-ab3a-7236dc96d226 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:56.999451 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 950/1893] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:08:56 2022] PUT /identity/v3/projects/61c640685ac6437b8b7f3645fa58f6ee/users/8e270855de234765a746d863f031fe2f/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:57.003994 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6e8de-3b32-4b09-80b8-a76f95e175ba admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:57.014259 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6e8de-3b32-4b09-80b8-a76f95e175ba admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:57.074532 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5168e5e-93e9-400a-9443-7e76a5d1d82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:57.075342 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5168e5e-93e9-400a-9443-7e76a5d1d82d admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:57.075623 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5168e5e-93e9-400a-9443-7e76a5d1d82d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:57.075891 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5168e5e-93e9-400a-9443-7e76a5d1d82d admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:57.076608 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5168e5e-93e9-400a-9443-7e76a5d1d82d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:57.078241 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5168e5e-93e9-400a-9443-7e76a5d1d82d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:57.092147 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 944/1894] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:08:57.093559 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067992a-03f3-411d-ab3a-7236dc96d226 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:57.103954 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067992a-03f3-411d-ab3a-7236dc96d226 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:57.108737 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e74ec8-ead3-4732-a4d8-12c72c757af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:57.109746 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e74ec8-ead3-4732-a4d8-12c72c757af6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:57.110073 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e74ec8-ead3-4732-a4d8-12c72c757af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:57.110334 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e74ec8-ead3-4732-a4d8-12c72c757af6 admin admin] PATH_INFO: `/v3/projects/61c640685ac6437b8b7f3645fa58f6ee/users/8e270855de234765a746d863f031fe2f/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:57.112337 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e74ec8-ead3-4732-a4d8-12c72c757af6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61c640685ac6437b8b7f3645fa58f6ee, user_id=8e270855de234765a746d863f031fe2f, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:57.115027 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e74ec8-ead3-4732-a4d8-12c72c757af6 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:57.136529 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 951/1895] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:08:57 2022] PUT /identity/v3/projects/61c640685ac6437b8b7f3645fa58f6ee/users/8e270855de234765a746d863f031fe2f/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:57.147150 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ac43d-7dd3-4eee-a2b3-9957098e3ed6 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:57.147700 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ac43d-7dd3-4eee-a2b3-9957098e3ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:57.148145 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ac43d-7dd3-4eee-a2b3-9957098e3ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:57.182978 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-da5ac43d-7dd3-4eee-a2b3-9957098e3ed6 None None] MFA Rules not processed for user `8e270855de234765a746d863f031fe2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:57.184606 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-da5ac43d-7dd3-4eee-a2b3-9957098e3ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:57.277821 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 945/1896] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:57 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:57.291006 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e74ec8-ead3-4732-a4d8-12c72c757af6 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:57.291906 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f8e74ec8-ead3-4732-a4d8-12c72c757af6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:57.321822 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ac43d-7dd3-4eee-a2b3-9957098e3ed6 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:57.323482 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-da5ac43d-7dd3-4eee-a2b3-9957098e3ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:57.356283 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e74ec8-ead3-4732-a4d8-12c72c757af6 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:57.360003 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0bc808-a818-4add-b0e8-70a36cfbb117 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:57.360660 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bc808-a818-4add-b0e8-70a36cfbb117 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:57.360940 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bc808-a818-4add-b0e8-70a36cfbb117 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:57.361215 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bc808-a818-4add-b0e8-70a36cfbb117 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:57.370582 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0bc808-a818-4add-b0e8-70a36cfbb117 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:57.372207 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0bc808-a818-4add-b0e8-70a36cfbb117 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:57.380474 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ac43d-7dd3-4eee-a2b3-9957098e3ed6 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:57.381291 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 952/1897] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:57 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:08:57.384211 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf9ba3-317f-400c-988e-9ca7eea61116 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:57.384866 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf9ba3-317f-400c-988e-9ca7eea61116 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:57.385147 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf9ba3-317f-400c-988e-9ca7eea61116 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:57.385422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf9ba3-317f-400c-988e-9ca7eea61116 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:57.387247 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c7bf9ba3-317f-400c-988e-9ca7eea61116 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:57.448631 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf9ba3-317f-400c-988e-9ca7eea61116 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:57.450257 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf9ba3-317f-400c-988e-9ca7eea61116 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:57.460301 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 946/1898] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 19:08:57.470230 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0bc808-a818-4add-b0e8-70a36cfbb117 service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:57.478965 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0bc808-a818-4add-b0e8-70a36cfbb117 service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:57.483441 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8570c-d52a-4161-9551-57462c693a43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:57.484388 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8570c-d52a-4161-9551-57462c693a43 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:57.484741 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8570c-d52a-4161-9551-57462c693a43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:57.485109 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8570c-d52a-4161-9551-57462c693a43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:57.549224 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb8570c-d52a-4161-9551-57462c693a43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:57.551521 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb8570c-d52a-4161-9551-57462c693a43 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:57.561345 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 953/1899] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:08:57.827691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf9ba3-317f-400c-988e-9ca7eea61116 service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:57.924659 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf9ba3-317f-400c-988e-9ca7eea61116 service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:57.929547 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad5dd8-e23e-41f5-a881-3bdc227eb618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:57.930438 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad5dd8-e23e-41f5-a881-3bdc227eb618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:57.930729 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad5dd8-e23e-41f5-a881-3bdc227eb618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:57.930997 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad5dd8-e23e-41f5-a881-3bdc227eb618 admin admin] PATH_INFO: `/v3/users/c2925a3ac13a4b78bfe614662a47b803` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:57.932192 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad5dd8-e23e-41f5-a881-3bdc227eb618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2925a3ac13a4b78bfe614662a47b803)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:57.934331 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad5dd8-e23e-41f5-a881-3bdc227eb618 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:58.006942 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-57ad5dd8-e23e-41f5-a881-3bdc227eb618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2925a3ac13a4b78bfe614662a47b803'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:58.017438 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-57ad5dd8-e23e-41f5-a881-3bdc227eb618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2925a3ac13a4b78bfe614662a47b803'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:58.025666 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-57ad5dd8-e23e-41f5-a881-3bdc227eb618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2925a3ac13a4b78bfe614662a47b803'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:58.044737 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8570c-d52a-4161-9551-57462c693a43 service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:58.052729 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-57ad5dd8-e23e-41f5-a881-3bdc227eb618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2925a3ac13a4b78bfe614662a47b803'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:58.054887 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8570c-d52a-4161-9551-57462c693a43 service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:58.055818 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-57ad5dd8-e23e-41f5-a881-3bdc227eb618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2925a3ac13a4b78bfe614662a47b803'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:58.059502 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ea163-7e6a-4278-9086-b78c4a6f23b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:58.060176 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ea163-7e6a-4278-9086-b78c4a6f23b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:58.060526 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ea163-7e6a-4278-9086-b78c4a6f23b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:58.061243 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ea163-7e6a-4278-9086-b78c4a6f23b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:58.063631 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-5c3ea163-7e6a-4278-9086-b78c4a6f23b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:58.068383 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 947/1900] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:08:57 2022] DELETE /identity/v3/users/c2925a3ac13a4b78bfe614662a47b803 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:58.070026 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945722b-5193-4598-9fd8-c4d78bbfab23 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:58.070319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945722b-5193-4598-9fd8-c4d78bbfab23 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:58.070596 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945722b-5193-4598-9fd8-c4d78bbfab23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:58.092215 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-6945722b-5193-4598-9fd8-c4d78bbfab23 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:58.093671 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6945722b-5193-4598-9fd8-c4d78bbfab23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:58.143199 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ea163-7e6a-4278-9086-b78c4a6f23b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:58.144647 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ea163-7e6a-4278-9086-b78c4a6f23b1 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:58.156999 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 954/1901] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 19:08:58.182759 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 948/1902] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:58.194889 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ea163-7e6a-4278-9086-b78c4a6f23b1 service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:58.196387 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-5c3ea163-7e6a-4278-9086-b78c4a6f23b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:58.278091 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ea163-7e6a-4278-9086-b78c4a6f23b1 service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:58.334996 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a01c7-88ed-4d89-a910-2717c3286fef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:58.335749 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a01c7-88ed-4d89-a910-2717c3286fef service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:58.335859 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a01c7-88ed-4d89-a910-2717c3286fef service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:58.336107 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a01c7-88ed-4d89-a910-2717c3286fef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:58.349859 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a01c7-88ed-4d89-a910-2717c3286fef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:58.351331 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a01c7-88ed-4d89-a910-2717c3286fef service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:58.371617 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 955/1903] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:08:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:08:58.801121 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6945722b-5193-4598-9fd8-c4d78bbfab23 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:58.802672 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6945722b-5193-4598-9fd8-c4d78bbfab23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:58.816836 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6945722b-5193-4598-9fd8-c4d78bbfab23 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:58.821564 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29deef2e-0bd0-4785-860e-641816a094bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:58.822444 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29deef2e-0bd0-4785-860e-641816a094bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:58.822719 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29deef2e-0bd0-4785-860e-641816a094bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:58.822987 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29deef2e-0bd0-4785-860e-641816a094bb admin admin] PATH_INFO: `/v3/projects/230ffb2a6d7e4e32af88c59fd8fadfc0` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:58.824269 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29deef2e-0bd0-4785-860e-641816a094bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=230ffb2a6d7e4e32af88c59fd8fadfc0)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:58.826317 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29deef2e-0bd0-4785-860e-641816a094bb admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:58.877350 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-29deef2e-0bd0-4785-860e-641816a094bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '230ffb2a6d7e4e32af88c59fd8fadfc0', 'request_id': 'req-29deef2e-0bd0-4785-860e-641816a094bb'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:58.890344 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-29deef2e-0bd0-4785-860e-641816a094bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '230ffb2a6d7e4e32af88c59fd8fadfc0', 'request_id': 'req-29deef2e-0bd0-4785-860e-641816a094bb'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:58.897298 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-29deef2e-0bd0-4785-860e-641816a094bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '230ffb2a6d7e4e32af88c59fd8fadfc0', 'request_id': 'req-29deef2e-0bd0-4785-860e-641816a094bb'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:58.910990 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-29deef2e-0bd0-4785-860e-641816a094bb admin admin] The token cache is being invalidate because project 230ffb2a6d7e4e32af88c59fd8fadfc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:08:58.911421 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-29deef2e-0bd0-4785-860e-641816a094bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:58.912214 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-29deef2e-0bd0-4785-860e-641816a094bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:58.914607 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 949/1904] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:08:58 2022] DELETE /identity/v3/projects/230ffb2a6d7e4e32af88c59fd8fadfc0 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:58.918183 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a01c7-88ed-4d89-a910-2717c3286fef service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:58.928240 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a01c7-88ed-4d89-a910-2717c3286fef service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:58.994544 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f223e-057d-41a7-b43e-032544c0b48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:58.996202 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f223e-057d-41a7-b43e-032544c0b48a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:58.996486 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f223e-057d-41a7-b43e-032544c0b48a admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:58.996758 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f223e-057d-41a7-b43e-032544c0b48a admin admin] PATH_INFO: `/v3/users/8e270855de234765a746d863f031fe2f` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:58.998325 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f223e-057d-41a7-b43e-032544c0b48a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e270855de234765a746d863f031fe2f)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:59.000261 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f223e-057d-41a7-b43e-032544c0b48a admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:59.045974 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-469f223e-057d-41a7-b43e-032544c0b48a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e270855de234765a746d863f031fe2f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:59.054725 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-469f223e-057d-41a7-b43e-032544c0b48a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e270855de234765a746d863f031fe2f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:59.061450 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-469f223e-057d-41a7-b43e-032544c0b48a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e270855de234765a746d863f031fe2f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:59.062225 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-469f223e-057d-41a7-b43e-032544c0b48a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e270855de234765a746d863f031fe2f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:59.074293 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-469f223e-057d-41a7-b43e-032544c0b48a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e270855de234765a746d863f031fe2f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:59.080376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 956/1905] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:08:58 2022] DELETE /identity/v3/users/8e270855de234765a746d863f031fe2f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:08:59.402195 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29deef2e-0bd0-4785-860e-641816a094bb admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:59.404627 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-29deef2e-0bd0-4785-860e-641816a094bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:59.419913 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29deef2e-0bd0-4785-860e-641816a094bb admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:59.489850 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026566a-b5d9-4104-981b-63c6719a8f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:59.490773 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026566a-b5d9-4104-981b-63c6719a8f92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:59.491042 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026566a-b5d9-4104-981b-63c6719a8f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:59.491473 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026566a-b5d9-4104-981b-63c6719a8f92 admin admin] PATH_INFO: `/v3/projects/61c640685ac6437b8b7f3645fa58f6ee` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:59.492813 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026566a-b5d9-4104-981b-63c6719a8f92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61c640685ac6437b8b7f3645fa58f6ee)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:59.495278 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026566a-b5d9-4104-981b-63c6719a8f92 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:59.543896 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-2026566a-b5d9-4104-981b-63c6719a8f92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61c640685ac6437b8b7f3645fa58f6ee', 'request_id': 'req-2026566a-b5d9-4104-981b-63c6719a8f92'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:59.554504 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-2026566a-b5d9-4104-981b-63c6719a8f92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61c640685ac6437b8b7f3645fa58f6ee', 'request_id': 'req-2026566a-b5d9-4104-981b-63c6719a8f92'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:59.562473 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-2026566a-b5d9-4104-981b-63c6719a8f92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61c640685ac6437b8b7f3645fa58f6ee', 'request_id': 'req-2026566a-b5d9-4104-981b-63c6719a8f92'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:59.575595 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-2026566a-b5d9-4104-981b-63c6719a8f92 admin admin] The token cache is being invalidate because project 61c640685ac6437b8b7f3645fa58f6ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:08:59.576034 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-2026566a-b5d9-4104-981b-63c6719a8f92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:59.576895 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-2026566a-b5d9-4104-981b-63c6719a8f92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:08:59.585736 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 950/1906] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:08:59 2022] DELETE /identity/v3/projects/61c640685ac6437b8b7f3645fa58f6ee => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:08:59.587313 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a667ce-0e59-4cd8-acd4-e2b8e251639b None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:59.587851 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a667ce-0e59-4cd8-acd4-e2b8e251639b None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:59.588196 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a667ce-0e59-4cd8-acd4-e2b8e251639b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:59.613462 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-e4a667ce-0e59-4cd8-acd4-e2b8e251639b None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:59.615052 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-e4a667ce-0e59-4cd8-acd4-e2b8e251639b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:59.699649 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 957/1907] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:08:59.708881 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a94a6-43c5-4862-9e48-61e7e828fd84 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:59.709254 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a94a6-43c5-4862-9e48-61e7e828fd84 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:59.709687 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a94a6-43c5-4862-9e48-61e7e828fd84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:59.729591 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-528a94a6-43c5-4862-9e48-61e7e828fd84 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:08:59.731049 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-528a94a6-43c5-4862-9e48-61e7e828fd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:08:59.743015 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 951/1908] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:08:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:08:59.744239 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a667ce-0e59-4cd8-acd4-e2b8e251639b None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:59.754505 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a667ce-0e59-4cd8-acd4-e2b8e251639b None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:59.760253 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09b5af-0717-4e88-868b-1a2350e9b7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:59.760988 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09b5af-0717-4e88-868b-1a2350e9b7ba admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:59.761299 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09b5af-0717-4e88-868b-1a2350e9b7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:59.761656 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09b5af-0717-4e88-868b-1a2350e9b7ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:59.762474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d09b5af-0717-4e88-868b-1a2350e9b7ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:08:59.762698 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d09b5af-0717-4e88-868b-1a2350e9b7ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:59.765013 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d09b5af-0717-4e88-868b-1a2350e9b7ba admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:59.777513 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 958/1909] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:08:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:08:59.782419 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a94a6-43c5-4862-9e48-61e7e828fd84 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:59.791628 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a94a6-43c5-4862-9e48-61e7e828fd84 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:59.796359 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7aa11d-42f8-4a95-ac65-579f5b84bcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:59.797022 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7aa11d-42f8-4a95-ac65-579f5b84bcd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:59.797308 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7aa11d-42f8-4a95-ac65-579f5b84bcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:59.797934 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7aa11d-42f8-4a95-ac65-579f5b84bcd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:59.798649 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7aa11d-42f8-4a95-ac65-579f5b84bcd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:59.800566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7aa11d-42f8-4a95-ac65-579f5b84bcd1 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:59.827823 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 952/1910] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:08:59 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:08:59.831874 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09b5af-0717-4e88-868b-1a2350e9b7ba admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:59.842798 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09b5af-0717-4e88-868b-1a2350e9b7ba admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:59.909756 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454eac0d-48b5-4c9c-aab4-341fe13c94d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:59.910644 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454eac0d-48b5-4c9c-aab4-341fe13c94d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:59.910931 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454eac0d-48b5-4c9c-aab4-341fe13c94d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:59.911209 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454eac0d-48b5-4c9c-aab4-341fe13c94d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:59.912331 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454eac0d-48b5-4c9c-aab4-341fe13c94d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:59.914380 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454eac0d-48b5-4c9c-aab4-341fe13c94d4 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:59.942039 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 959/1911] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:08:59 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:08:59.943170 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7aa11d-42f8-4a95-ac65-579f5b84bcd1 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:59.954749 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7aa11d-42f8-4a95-ac65-579f5b84bcd1 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:59.959965 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361181a-9064-4607-ba0d-e6495dad77cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:59.960872 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361181a-9064-4607-ba0d-e6495dad77cd admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:59.961227 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361181a-9064-4607-ba0d-e6495dad77cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:59.961875 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361181a-9064-4607-ba0d-e6495dad77cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:59.962735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d361181a-9064-4607-ba0d-e6495dad77cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:59.964487 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d361181a-9064-4607-ba0d-e6495dad77cd admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:08:59.976229 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 953/1912] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:08:59.980301 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454eac0d-48b5-4c9c-aab4-341fe13c94d4 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:08:59.991382 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454eac0d-48b5-4c9c-aab4-341fe13c94d4 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:08:59.996079 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1b61e-e60a-4716-add8-68e093c95f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:08:59.996782 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1b61e-e60a-4716-add8-68e093c95f36 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:08:59.997064 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1b61e-e60a-4716-add8-68e093c95f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:08:59.997338 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1b61e-e60a-4716-add8-68e093c95f36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:08:59.998113 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1b61e-e60a-4716-add8-68e093c95f36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:08:59.999722 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1b61e-e60a-4716-add8-68e093c95f36 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:00.014654 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 960/1913] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:09:00.015432 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361181a-9064-4607-ba0d-e6495dad77cd admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:00.027840 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361181a-9064-4607-ba0d-e6495dad77cd admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:00.036138 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a436a-67f3-41e8-a217-d02fb9b119b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:00.037130 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a436a-67f3-41e8-a217-d02fb9b119b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:00.037415 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a436a-67f3-41e8-a217-d02fb9b119b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:00.037790 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a436a-67f3-41e8-a217-d02fb9b119b8 admin admin] PATH_INFO: `/v3/projects/d4febad77c3643a4986caea14ff5d914/users/b952490fb3364db88d83c0999d01419e/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:00.054277 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a436a-67f3-41e8-a217-d02fb9b119b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4febad77c3643a4986caea14ff5d914, user_id=b952490fb3364db88d83c0999d01419e, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:00.057079 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a436a-67f3-41e8-a217-d02fb9b119b8 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:00.071094 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 954/1914] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:09:00 2022] PUT /identity/v3/projects/d4febad77c3643a4986caea14ff5d914/users/b952490fb3364db88d83c0999d01419e/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:00.082621 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839b12d-c5f1-4cbc-a592-eb1b8b8592a5 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:00.083134 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839b12d-c5f1-4cbc-a592-eb1b8b8592a5 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:00.083225 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839b12d-c5f1-4cbc-a592-eb1b8b8592a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:00.111364 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-e839b12d-c5f1-4cbc-a592-eb1b8b8592a5 None None] MFA Rules not processed for user `b952490fb3364db88d83c0999d01419e`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:00.112600 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-e839b12d-c5f1-4cbc-a592-eb1b8b8592a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:00.180325 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 961/1915] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:00.192079 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a436a-67f3-41e8-a217-d02fb9b119b8 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:00.194156 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-846a436a-67f3-41e8-a217-d02fb9b119b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:00.249878 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a436a-67f3-41e8-a217-d02fb9b119b8 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:00.253829 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5befc483-f7b0-41a5-8db4-5880229ef20c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:00.254492 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befc483-f7b0-41a5-8db4-5880229ef20c service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:00.254776 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befc483-f7b0-41a5-8db4-5880229ef20c service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:00.255048 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befc483-f7b0-41a5-8db4-5880229ef20c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:00.264089 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5befc483-f7b0-41a5-8db4-5880229ef20c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:00.265601 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5befc483-f7b0-41a5-8db4-5880229ef20c service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:00.275045 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 955/1916] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:09:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:09:02.192607 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839b12d-c5f1-4cbc-a592-eb1b8b8592a5 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:02.195374 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-e839b12d-c5f1-4cbc-a592-eb1b8b8592a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:02.297841 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839b12d-c5f1-4cbc-a592-eb1b8b8592a5 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:02.308371 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae37fbd-adc9-463a-9dc0-e7a8ad1abdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:02.310433 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae37fbd-adc9-463a-9dc0-e7a8ad1abdac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:02.310869 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae37fbd-adc9-463a-9dc0-e7a8ad1abdac admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:02.311292 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae37fbd-adc9-463a-9dc0-e7a8ad1abdac admin admin] PATH_INFO: `/v3/users/89b0031492374a56aa8c06bdf1e6e77f` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:02.312872 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae37fbd-adc9-463a-9dc0-e7a8ad1abdac admin admin] RBAC: Authorizing `identity:delete_user(user_id=89b0031492374a56aa8c06bdf1e6e77f)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:02.315699 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae37fbd-adc9-463a-9dc0-e7a8ad1abdac admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:02.413884 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-3ae37fbd-adc9-463a-9dc0-e7a8ad1abdac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89b0031492374a56aa8c06bdf1e6e77f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:02.428386 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-3ae37fbd-adc9-463a-9dc0-e7a8ad1abdac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89b0031492374a56aa8c06bdf1e6e77f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:02.439103 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-3ae37fbd-adc9-463a-9dc0-e7a8ad1abdac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89b0031492374a56aa8c06bdf1e6e77f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:02.441975 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-3ae37fbd-adc9-463a-9dc0-e7a8ad1abdac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89b0031492374a56aa8c06bdf1e6e77f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:02.457476 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-3ae37fbd-adc9-463a-9dc0-e7a8ad1abdac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89b0031492374a56aa8c06bdf1e6e77f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:02.468404 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 962/1917] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:09:02 2022] DELETE /identity/v3/users/89b0031492374a56aa8c06bdf1e6e77f => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:02.473025 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db39883-9acb-4b21-8251-b94dcf83c68c None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:02.473586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db39883-9acb-4b21-8251-b94dcf83c68c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:02.473586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db39883-9acb-4b21-8251-b94dcf83c68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:02.500911 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-1db39883-9acb-4b21-8251-b94dcf83c68c None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:02.502499 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1db39883-9acb-4b21-8251-b94dcf83c68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:02.582151 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 956/1918] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:02.592873 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae37fbd-adc9-463a-9dc0-e7a8ad1abdac admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:02.594427 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-3ae37fbd-adc9-463a-9dc0-e7a8ad1abdac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:02.651560 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae37fbd-adc9-463a-9dc0-e7a8ad1abdac admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:02.655675 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d2db0-c166-4c69-8451-4b81d6c14648 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:02.656332 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d2db0-c166-4c69-8451-4b81d6c14648 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:02.656620 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d2db0-c166-4c69-8451-4b81d6c14648 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:02.656893 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d2db0-c166-4c69-8451-4b81d6c14648 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:02.665873 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d2db0-c166-4c69-8451-4b81d6c14648 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:02.667319 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d2db0-c166-4c69-8451-4b81d6c14648 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:02.676795 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 963/1919] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:09:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:09:02.950459 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db39883-9acb-4b21-8251-b94dcf83c68c None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:02.951896 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1db39883-9acb-4b21-8251-b94dcf83c68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:02.964928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db39883-9acb-4b21-8251-b94dcf83c68c None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:02.976427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906a093-5ff2-4a3a-b0d4-242377fa60f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:02.977448 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906a093-5ff2-4a3a-b0d4-242377fa60f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:02.977986 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906a093-5ff2-4a3a-b0d4-242377fa60f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:02.978080 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906a093-5ff2-4a3a-b0d4-242377fa60f0 admin admin] PATH_INFO: `/v3/projects/8be5f92e0a594b10ad7c10907ee3563b` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:02.979618 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c906a093-5ff2-4a3a-b0d4-242377fa60f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8be5f92e0a594b10ad7c10907ee3563b)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:02.981829 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c906a093-5ff2-4a3a-b0d4-242377fa60f0 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:03.031578 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-c906a093-5ff2-4a3a-b0d4-242377fa60f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8be5f92e0a594b10ad7c10907ee3563b', 'request_id': 'req-c906a093-5ff2-4a3a-b0d4-242377fa60f0'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:03.040880 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-c906a093-5ff2-4a3a-b0d4-242377fa60f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8be5f92e0a594b10ad7c10907ee3563b', 'request_id': 'req-c906a093-5ff2-4a3a-b0d4-242377fa60f0'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:03.047451 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-c906a093-5ff2-4a3a-b0d4-242377fa60f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8be5f92e0a594b10ad7c10907ee3563b', 'request_id': 'req-c906a093-5ff2-4a3a-b0d4-242377fa60f0'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:03.059740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-c906a093-5ff2-4a3a-b0d4-242377fa60f0 admin admin] The token cache is being invalidate because project 8be5f92e0a594b10ad7c10907ee3563b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:09:03.060093 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-c906a093-5ff2-4a3a-b0d4-242377fa60f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:03.060779 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-c906a093-5ff2-4a3a-b0d4-242377fa60f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:03.062663 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 957/1920] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:09:02 2022] DELETE /identity/v3/projects/8be5f92e0a594b10ad7c10907ee3563b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:03.066674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d2db0-c166-4c69-8451-4b81d6c14648 service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:03.076533 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d2db0-c166-4c69-8451-4b81d6c14648 service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:03.134637 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eae7b6-7b52-4e1b-b636-e61323fab7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:03.135529 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eae7b6-7b52-4e1b-b636-e61323fab7da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:03.135807 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eae7b6-7b52-4e1b-b636-e61323fab7da admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:03.136092 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eae7b6-7b52-4e1b-b636-e61323fab7da admin admin] PATH_INFO: `/v3/users/69130d20d924464b9d94d3d31e5a78ff` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:03.137277 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eae7b6-7b52-4e1b-b636-e61323fab7da admin admin] RBAC: Authorizing `identity:delete_user(user_id=69130d20d924464b9d94d3d31e5a78ff)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:03.139251 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eae7b6-7b52-4e1b-b636-e61323fab7da admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:03.185179 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-39eae7b6-7b52-4e1b-b636-e61323fab7da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69130d20d924464b9d94d3d31e5a78ff'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:03.193886 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-39eae7b6-7b52-4e1b-b636-e61323fab7da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69130d20d924464b9d94d3d31e5a78ff'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:03.202065 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-39eae7b6-7b52-4e1b-b636-e61323fab7da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69130d20d924464b9d94d3d31e5a78ff'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:03.202751 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-39eae7b6-7b52-4e1b-b636-e61323fab7da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69130d20d924464b9d94d3d31e5a78ff'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:03.215138 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-39eae7b6-7b52-4e1b-b636-e61323fab7da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69130d20d924464b9d94d3d31e5a78ff'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:03.221213 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 964/1921] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:09:03 2022] DELETE /identity/v3/users/69130d20d924464b9d94d3d31e5a78ff => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:03.494020 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906a093-5ff2-4a3a-b0d4-242377fa60f0 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:03.495716 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c906a093-5ff2-4a3a-b0d4-242377fa60f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:03.509454 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906a093-5ff2-4a3a-b0d4-242377fa60f0 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:03.572459 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af8ca1-05b0-40dc-9eb0-b3062615ad19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:03.573252 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af8ca1-05b0-40dc-9eb0-b3062615ad19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:03.573648 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af8ca1-05b0-40dc-9eb0-b3062615ad19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:03.573914 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af8ca1-05b0-40dc-9eb0-b3062615ad19 admin admin] PATH_INFO: `/v3/projects/9779ff1718b54f81989206ee60d0123a` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:03.575105 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af8ca1-05b0-40dc-9eb0-b3062615ad19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9779ff1718b54f81989206ee60d0123a)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:03.577129 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af8ca1-05b0-40dc-9eb0-b3062615ad19 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:03.628906 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-03af8ca1-05b0-40dc-9eb0-b3062615ad19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9779ff1718b54f81989206ee60d0123a', 'request_id': 'req-03af8ca1-05b0-40dc-9eb0-b3062615ad19'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:03.637875 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-03af8ca1-05b0-40dc-9eb0-b3062615ad19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9779ff1718b54f81989206ee60d0123a', 'request_id': 'req-03af8ca1-05b0-40dc-9eb0-b3062615ad19'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:03.644486 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-03af8ca1-05b0-40dc-9eb0-b3062615ad19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9779ff1718b54f81989206ee60d0123a', 'request_id': 'req-03af8ca1-05b0-40dc-9eb0-b3062615ad19'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:03.656957 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-03af8ca1-05b0-40dc-9eb0-b3062615ad19 admin admin] The token cache is being invalidate because project 9779ff1718b54f81989206ee60d0123a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:09:03.657078 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-03af8ca1-05b0-40dc-9eb0-b3062615ad19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:03.657780 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-03af8ca1-05b0-40dc-9eb0-b3062615ad19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:03.662819 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 958/1922] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:09:03 2022] DELETE /identity/v3/projects/9779ff1718b54f81989206ee60d0123a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:03.666796 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eae7b6-7b52-4e1b-b636-e61323fab7da admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:03.668385 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-39eae7b6-7b52-4e1b-b636-e61323fab7da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:03.681666 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eae7b6-7b52-4e1b-b636-e61323fab7da admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:03.736803 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de0e69-7ce2-428b-828b-b5a03d61f833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:03.737749 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de0e69-7ce2-428b-828b-b5a03d61f833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:03.738029 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de0e69-7ce2-428b-828b-b5a03d61f833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:03.738302 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de0e69-7ce2-428b-828b-b5a03d61f833 admin admin] PATH_INFO: `/v3/users/6617529ae8fd4a0783fd5d22abcb8cbb` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:03.739502 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de0e69-7ce2-428b-828b-b5a03d61f833 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6617529ae8fd4a0783fd5d22abcb8cbb)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:03.741466 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de0e69-7ce2-428b-828b-b5a03d61f833 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:03.788650 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-b0de0e69-7ce2-428b-828b-b5a03d61f833 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6617529ae8fd4a0783fd5d22abcb8cbb'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:03.796165 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-b0de0e69-7ce2-428b-828b-b5a03d61f833 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6617529ae8fd4a0783fd5d22abcb8cbb'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:03.802856 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-b0de0e69-7ce2-428b-828b-b5a03d61f833 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6617529ae8fd4a0783fd5d22abcb8cbb'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:03.803499 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-b0de0e69-7ce2-428b-828b-b5a03d61f833 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6617529ae8fd4a0783fd5d22abcb8cbb'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:03.815012 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-b0de0e69-7ce2-428b-828b-b5a03d61f833 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6617529ae8fd4a0783fd5d22abcb8cbb'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:03.821047 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 965/1923] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:09:03 2022] DELETE /identity/v3/users/6617529ae8fd4a0783fd5d22abcb8cbb => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:09:04.188056 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af8ca1-05b0-40dc-9eb0-b3062615ad19 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:04.189622 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-03af8ca1-05b0-40dc-9eb0-b3062615ad19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:04.202945 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af8ca1-05b0-40dc-9eb0-b3062615ad19 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:04.259897 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547475a-780a-42cf-9095-3f1089a359c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:04.260770 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547475a-780a-42cf-9095-3f1089a359c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:04.261047 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547475a-780a-42cf-9095-3f1089a359c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:04.261405 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547475a-780a-42cf-9095-3f1089a359c8 admin admin] PATH_INFO: `/v3/projects/832ba4f533a946d2bea9a7ae37a052f9` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:04.262614 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547475a-780a-42cf-9095-3f1089a359c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=832ba4f533a946d2bea9a7ae37a052f9)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:04.264543 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547475a-780a-42cf-9095-3f1089a359c8 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:04.310569 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-2547475a-780a-42cf-9095-3f1089a359c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '832ba4f533a946d2bea9a7ae37a052f9', 'request_id': 'req-2547475a-780a-42cf-9095-3f1089a359c8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:04.319390 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-2547475a-780a-42cf-9095-3f1089a359c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '832ba4f533a946d2bea9a7ae37a052f9', 'request_id': 'req-2547475a-780a-42cf-9095-3f1089a359c8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:04.325106 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-2547475a-780a-42cf-9095-3f1089a359c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '832ba4f533a946d2bea9a7ae37a052f9', 'request_id': 'req-2547475a-780a-42cf-9095-3f1089a359c8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:04.336865 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-2547475a-780a-42cf-9095-3f1089a359c8 admin admin] The token cache is being invalidate because project 832ba4f533a946d2bea9a7ae37a052f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:09:04.337154 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-2547475a-780a-42cf-9095-3f1089a359c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:04.337858 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-2547475a-780a-42cf-9095-3f1089a359c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:04.339510 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 959/1924] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:09:04 2022] DELETE /identity/v3/projects/832ba4f533a946d2bea9a7ae37a052f9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:04.344548 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c52455-07db-4670-a444-312fe24e0047 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:04.345063 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c52455-07db-4670-a444-312fe24e0047 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:04.345063 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c52455-07db-4670-a444-312fe24e0047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:04.363321 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-08c52455-07db-4670-a444-312fe24e0047 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:04.364435 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-08c52455-07db-4670-a444-312fe24e0047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:04.421278 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 966/1925] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:04.429310 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee860120-5852-4af5-af8b-80912721d9cf None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:04.429625 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee860120-5852-4af5-af8b-80912721d9cf None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:04.429899 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee860120-5852-4af5-af8b-80912721d9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:04.448035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-ee860120-5852-4af5-af8b-80912721d9cf None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:04.448962 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ee860120-5852-4af5-af8b-80912721d9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:04.457757 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 960/1926] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:04.462045 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c52455-07db-4670-a444-312fe24e0047 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:04.473064 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c52455-07db-4670-a444-312fe24e0047 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:04.478068 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645bb0dc-8a23-4e63-a6ad-1665781ab266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:04.478813 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645bb0dc-8a23-4e63-a6ad-1665781ab266 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:04.479153 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645bb0dc-8a23-4e63-a6ad-1665781ab266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:04.479514 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645bb0dc-8a23-4e63-a6ad-1665781ab266 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:04.480428 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645bb0dc-8a23-4e63-a6ad-1665781ab266 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:09:04.480829 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645bb0dc-8a23-4e63-a6ad-1665781ab266 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:04.482551 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645bb0dc-8a23-4e63-a6ad-1665781ab266 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:04.494148 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 967/1927] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:09:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:09:04.498774 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee860120-5852-4af5-af8b-80912721d9cf None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:04.508080 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee860120-5852-4af5-af8b-80912721d9cf None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:04.512985 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a94b26-7057-4feb-b096-c538176e8b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:04.513801 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a94b26-7057-4feb-b096-c538176e8b99 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:04.514174 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a94b26-7057-4feb-b096-c538176e8b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:04.514512 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a94b26-7057-4feb-b096-c538176e8b99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:04.515314 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a94b26-7057-4feb-b096-c538176e8b99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:04.517299 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a94b26-7057-4feb-b096-c538176e8b99 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:04.544704 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 961/1928] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:09:04 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:09:04.549055 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645bb0dc-8a23-4e63-a6ad-1665781ab266 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:04.558946 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645bb0dc-8a23-4e63-a6ad-1665781ab266 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:04.618750 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa06b11-1df8-4f5a-adcb-cb405d138193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:04.619378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa06b11-1df8-4f5a-adcb-cb405d138193 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:04.619675 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa06b11-1df8-4f5a-adcb-cb405d138193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:04.619952 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa06b11-1df8-4f5a-adcb-cb405d138193 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:04.620798 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa06b11-1df8-4f5a-adcb-cb405d138193 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:04.622784 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa06b11-1df8-4f5a-adcb-cb405d138193 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:04.645788 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 968/1929] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:09:04 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:09:04.650307 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a94b26-7057-4feb-b096-c538176e8b99 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:04.661660 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a94b26-7057-4feb-b096-c538176e8b99 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:04.666780 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7979f46-0992-4fae-9a06-066d2df5d128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:04.667532 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7979f46-0992-4fae-9a06-066d2df5d128 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:04.667837 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7979f46-0992-4fae-9a06-066d2df5d128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:04.668112 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7979f46-0992-4fae-9a06-066d2df5d128 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:04.669397 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7979f46-0992-4fae-9a06-066d2df5d128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:04.670508 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7979f46-0992-4fae-9a06-066d2df5d128 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:04.691676 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 962/1930] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:09:04.693325 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa06b11-1df8-4f5a-adcb-cb405d138193 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:04.704161 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa06b11-1df8-4f5a-adcb-cb405d138193 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:04.709182 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65bdd4d-2b02-4b7b-a965-4ae438c1dde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:04.710133 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bdd4d-2b02-4b7b-a965-4ae438c1dde0 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:04.710488 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bdd4d-2b02-4b7b-a965-4ae438c1dde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:04.710830 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bdd4d-2b02-4b7b-a965-4ae438c1dde0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:04.711788 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65bdd4d-2b02-4b7b-a965-4ae438c1dde0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:04.713989 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65bdd4d-2b02-4b7b-a965-4ae438c1dde0 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:04.726556 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 969/1931] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:09:04.735968 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7979f46-0992-4fae-9a06-066d2df5d128 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:04.746479 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7979f46-0992-4fae-9a06-066d2df5d128 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:04.751314 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da69e9-28c6-4d5b-9d0f-e8140aceeb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:04.752224 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da69e9-28c6-4d5b-9d0f-e8140aceeb88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:04.752722 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da69e9-28c6-4d5b-9d0f-e8140aceeb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:04.752997 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da69e9-28c6-4d5b-9d0f-e8140aceeb88 admin admin] PATH_INFO: `/v3/projects/f7b9188e991a4a7bb57c8a5beb3fb278/users/c8ac79259d304d589aa1e529849bfcbe/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:04.769031 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da69e9-28c6-4d5b-9d0f-e8140aceeb88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7b9188e991a4a7bb57c8a5beb3fb278, user_id=c8ac79259d304d589aa1e529849bfcbe, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:04.772218 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da69e9-28c6-4d5b-9d0f-e8140aceeb88 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:04.789919 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 963/1932] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:09:04 2022] PUT /identity/v3/projects/f7b9188e991a4a7bb57c8a5beb3fb278/users/c8ac79259d304d589aa1e529849bfcbe/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:04.797597 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d577a5-9eb4-4f4f-9c4d-194eeecaeedb None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:04.798227 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d577a5-9eb4-4f4f-9c4d-194eeecaeedb None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:04.798611 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d577a5-9eb4-4f4f-9c4d-194eeecaeedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:04.819773 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-66d577a5-9eb4-4f4f-9c4d-194eeecaeedb None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:04.821000 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-66d577a5-9eb4-4f4f-9c4d-194eeecaeedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:04.893297 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 970/1933] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:04.900740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da69e9-28c6-4d5b-9d0f-e8140aceeb88 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:04.902580 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-92da69e9-28c6-4d5b-9d0f-e8140aceeb88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:04.980878 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da69e9-28c6-4d5b-9d0f-e8140aceeb88 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:04.986161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc47bc1-143b-45cd-b8b4-d60446376ebb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:04.986843 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc47bc1-143b-45cd-b8b4-d60446376ebb service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:04.987110 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc47bc1-143b-45cd-b8b4-d60446376ebb service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:04.987390 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc47bc1-143b-45cd-b8b4-d60446376ebb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:04.996962 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc47bc1-143b-45cd-b8b4-d60446376ebb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:04.998436 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc47bc1-143b-45cd-b8b4-d60446376ebb service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:05.008209 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 964/1934] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:09:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:09:05.614287 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85138d29-d983-4728-ad1e-fa9297f8d900 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:05.614807 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85138d29-d983-4728-ad1e-fa9297f8d900 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:05.614807 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85138d29-d983-4728-ad1e-fa9297f8d900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:05.642101 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-85138d29-d983-4728-ad1e-fa9297f8d900 None None] MFA Rules not processed for user `c8ac79259d304d589aa1e529849bfcbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:05.643560 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-85138d29-d983-4728-ad1e-fa9297f8d900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:05.711214 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 971/1935] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:05.722543 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc47bc1-143b-45cd-b8b4-d60446376ebb service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:05.724066 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6cc47bc1-143b-45cd-b8b4-d60446376ebb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:05.790321 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc47bc1-143b-45cd-b8b4-d60446376ebb service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:05.794085 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432669d-752e-49a6-9409-8f139ecffe57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:05.794740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432669d-752e-49a6-9409-8f139ecffe57 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:05.795024 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432669d-752e-49a6-9409-8f139ecffe57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:05.795307 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432669d-752e-49a6-9409-8f139ecffe57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:05.803681 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5432669d-752e-49a6-9409-8f139ecffe57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:05.805119 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5432669d-752e-49a6-9409-8f139ecffe57 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:05.813739 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 965/1936] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:09:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:09:12.443663 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a2a3c-b63e-43ce-8c3d-fde570be59e4 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:12.443663 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a2a3c-b63e-43ce-8c3d-fde570be59e4 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:12.443663 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a2a3c-b63e-43ce-8c3d-fde570be59e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:12.459006 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-f35a2a3c-b63e-43ce-8c3d-fde570be59e4 None None] MFA Rules not processed for user `c8ac79259d304d589aa1e529849bfcbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:12.460325 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f35a2a3c-b63e-43ce-8c3d-fde570be59e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:12.473523 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 972/1937] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:13.748114 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432669d-752e-49a6-9409-8f139ecffe57 service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:13.749634 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5432669d-752e-49a6-9409-8f139ecffe57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:13.763307 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432669d-752e-49a6-9409-8f139ecffe57 service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:13.768270 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590aa9b4-5687-4baf-bd1e-0ff60574f280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:13.769262 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590aa9b4-5687-4baf-bd1e-0ff60574f280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:13.769554 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590aa9b4-5687-4baf-bd1e-0ff60574f280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:13.769827 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590aa9b4-5687-4baf-bd1e-0ff60574f280 admin admin] PATH_INFO: `/v3/users/33efe1275b474b3da24bd0db02d9e389` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:13.771063 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590aa9b4-5687-4baf-bd1e-0ff60574f280 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33efe1275b474b3da24bd0db02d9e389)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:13.773009 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590aa9b4-5687-4baf-bd1e-0ff60574f280 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:13.843548 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-590aa9b4-5687-4baf-bd1e-0ff60574f280 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33efe1275b474b3da24bd0db02d9e389'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:13.862386 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-590aa9b4-5687-4baf-bd1e-0ff60574f280 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33efe1275b474b3da24bd0db02d9e389'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:13.883089 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-590aa9b4-5687-4baf-bd1e-0ff60574f280 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33efe1275b474b3da24bd0db02d9e389'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:13.898023 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-590aa9b4-5687-4baf-bd1e-0ff60574f280 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33efe1275b474b3da24bd0db02d9e389'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:13.898812 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-590aa9b4-5687-4baf-bd1e-0ff60574f280 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33efe1275b474b3da24bd0db02d9e389'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:13.907352 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 966/1938] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:09:13 2022] DELETE /identity/v3/users/33efe1275b474b3da24bd0db02d9e389 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:13.912547 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b3547-8784-41f0-923e-6c1454c4c860 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:13.913023 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b3547-8784-41f0-923e-6c1454c4c860 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:13.913357 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b3547-8784-41f0-923e-6c1454c4c860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:13.931377 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-bc5b3547-8784-41f0-923e-6c1454c4c860 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:13.932666 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-bc5b3547-8784-41f0-923e-6c1454c4c860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:13.990380 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 973/1939] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:13.999977 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590aa9b4-5687-4baf-bd1e-0ff60574f280 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:14.001483 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-590aa9b4-5687-4baf-bd1e-0ff60574f280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:14.057851 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590aa9b4-5687-4baf-bd1e-0ff60574f280 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:14.062193 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df6491-d163-4cd5-be95-994e04b7223e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:14.062846 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df6491-d163-4cd5-be95-994e04b7223e service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:14.063129 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df6491-d163-4cd5-be95-994e04b7223e service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:14.063426 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df6491-d163-4cd5-be95-994e04b7223e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:14.073314 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2df6491-d163-4cd5-be95-994e04b7223e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:14.074787 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2df6491-d163-4cd5-be95-994e04b7223e service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:14.084303 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 967/1940] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:09:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:09:14.424819 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b3547-8784-41f0-923e-6c1454c4c860 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:14.426297 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-bc5b3547-8784-41f0-923e-6c1454c4c860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:14.441755 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b3547-8784-41f0-923e-6c1454c4c860 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:14.448403 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b2a16-7c16-41b7-8a3c-392411bdf590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:14.449469 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b2a16-7c16-41b7-8a3c-392411bdf590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:14.449952 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b2a16-7c16-41b7-8a3c-392411bdf590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:14.450251 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b2a16-7c16-41b7-8a3c-392411bdf590 admin admin] PATH_INFO: `/v3/projects/ef4e4538396b4304b280b2a867b69d86` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:14.451480 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804b2a16-7c16-41b7-8a3c-392411bdf590 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef4e4538396b4304b280b2a867b69d86)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:14.453798 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804b2a16-7c16-41b7-8a3c-392411bdf590 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:14.511297 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-804b2a16-7c16-41b7-8a3c-392411bdf590 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef4e4538396b4304b280b2a867b69d86', 'request_id': 'req-804b2a16-7c16-41b7-8a3c-392411bdf590'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:14.517636 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-804b2a16-7c16-41b7-8a3c-392411bdf590 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef4e4538396b4304b280b2a867b69d86', 'request_id': 'req-804b2a16-7c16-41b7-8a3c-392411bdf590'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:14.524761 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-804b2a16-7c16-41b7-8a3c-392411bdf590 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef4e4538396b4304b280b2a867b69d86', 'request_id': 'req-804b2a16-7c16-41b7-8a3c-392411bdf590'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:14.539053 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-804b2a16-7c16-41b7-8a3c-392411bdf590 admin admin] The token cache is being invalidate because project ef4e4538396b4304b280b2a867b69d86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:09:14.539500 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-804b2a16-7c16-41b7-8a3c-392411bdf590 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:14.540201 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-804b2a16-7c16-41b7-8a3c-392411bdf590 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:14.541898 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 974/1941] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:09:14 2022] DELETE /identity/v3/projects/ef4e4538396b4304b280b2a867b69d86 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:14.546073 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df6491-d163-4cd5-be95-994e04b7223e service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:14.555739 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df6491-d163-4cd5-be95-994e04b7223e service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:14.609485 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c8782-7a13-4359-9c8c-6be3646e4d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:14.610396 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c8782-7a13-4359-9c8c-6be3646e4d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:14.610663 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c8782-7a13-4359-9c8c-6be3646e4d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:14.610933 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c8782-7a13-4359-9c8c-6be3646e4d17 admin admin] PATH_INFO: `/v3/users/114a35eeef824c269b3e9ff6861bd6cc` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:14.612182 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c8782-7a13-4359-9c8c-6be3646e4d17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=114a35eeef824c269b3e9ff6861bd6cc)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:14.615181 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c8782-7a13-4359-9c8c-6be3646e4d17 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:14.665063 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a79c8782-7a13-4359-9c8c-6be3646e4d17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '114a35eeef824c269b3e9ff6861bd6cc'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:14.672641 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a79c8782-7a13-4359-9c8c-6be3646e4d17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '114a35eeef824c269b3e9ff6861bd6cc'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:14.681214 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a79c8782-7a13-4359-9c8c-6be3646e4d17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '114a35eeef824c269b3e9ff6861bd6cc'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:14.695311 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a79c8782-7a13-4359-9c8c-6be3646e4d17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '114a35eeef824c269b3e9ff6861bd6cc'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:14.695976 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a79c8782-7a13-4359-9c8c-6be3646e4d17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '114a35eeef824c269b3e9ff6861bd6cc'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:14.702031 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 968/1942] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:09:14 2022] DELETE /identity/v3/users/114a35eeef824c269b3e9ff6861bd6cc => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:14.971937 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b2a16-7c16-41b7-8a3c-392411bdf590 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:14.974693 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-804b2a16-7c16-41b7-8a3c-392411bdf590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:14.986713 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b2a16-7c16-41b7-8a3c-392411bdf590 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:15.049189 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c11724-a8ca-4507-9f6a-00f07119a79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:15.050119 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c11724-a8ca-4507-9f6a-00f07119a79b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:15.050401 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c11724-a8ca-4507-9f6a-00f07119a79b admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:15.050673 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c11724-a8ca-4507-9f6a-00f07119a79b admin admin] PATH_INFO: `/v3/projects/4c0bdfbffe9e43aabe8468a23b075d65` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:15.051859 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c11724-a8ca-4507-9f6a-00f07119a79b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c0bdfbffe9e43aabe8468a23b075d65)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:15.053877 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c11724-a8ca-4507-9f6a-00f07119a79b admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:15.135583 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-81c11724-a8ca-4507-9f6a-00f07119a79b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c0bdfbffe9e43aabe8468a23b075d65', 'request_id': 'req-81c11724-a8ca-4507-9f6a-00f07119a79b'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:15.141883 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-81c11724-a8ca-4507-9f6a-00f07119a79b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c0bdfbffe9e43aabe8468a23b075d65', 'request_id': 'req-81c11724-a8ca-4507-9f6a-00f07119a79b'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:15.148916 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-81c11724-a8ca-4507-9f6a-00f07119a79b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c0bdfbffe9e43aabe8468a23b075d65', 'request_id': 'req-81c11724-a8ca-4507-9f6a-00f07119a79b'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:15.164538 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-81c11724-a8ca-4507-9f6a-00f07119a79b admin admin] The token cache is being invalidate because project 4c0bdfbffe9e43aabe8468a23b075d65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:09:15.164961 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-81c11724-a8ca-4507-9f6a-00f07119a79b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:15.166118 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-81c11724-a8ca-4507-9f6a-00f07119a79b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:15.167243 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 975/1943] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:09:14 2022] DELETE /identity/v3/projects/4c0bdfbffe9e43aabe8468a23b075d65 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:15.172501 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185f708-d010-4afc-80d7-68b0450bc691 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:15.173036 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185f708-d010-4afc-80d7-68b0450bc691 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:15.173124 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185f708-d010-4afc-80d7-68b0450bc691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:15.193256 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-b185f708-d010-4afc-80d7-68b0450bc691 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:15.194769 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b185f708-d010-4afc-80d7-68b0450bc691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:15.271303 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5bfc8-c43b-4be3-b8f3-f61b240e6621 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:15.271303 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5bfc8-c43b-4be3-b8f3-f61b240e6621 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:15.271303 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5bfc8-c43b-4be3-b8f3-f61b240e6621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:15.278826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 969/1944] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:09:15.295715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-b9d5bfc8-c43b-4be3-b8f3-f61b240e6621 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:15.297471 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-b9d5bfc8-c43b-4be3-b8f3-f61b240e6621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:15.318881 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 976/1945] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:15.323398 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185f708-d010-4afc-80d7-68b0450bc691 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:15.336022 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185f708-d010-4afc-80d7-68b0450bc691 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:15.341990 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c361016-1c0c-4be1-9077-346a11b09482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:15.343147 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c361016-1c0c-4be1-9077-346a11b09482 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:15.343870 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c361016-1c0c-4be1-9077-346a11b09482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:15.344346 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c361016-1c0c-4be1-9077-346a11b09482 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:15.345438 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c361016-1c0c-4be1-9077-346a11b09482 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:09:15.345989 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c361016-1c0c-4be1-9077-346a11b09482 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:15.347833 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c361016-1c0c-4be1-9077-346a11b09482 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:15.368179 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5bfc8-c43b-4be3-b8f3-f61b240e6621 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:15.375281 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 970/1946] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:09:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:09:15.379519 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5bfc8-c43b-4be3-b8f3-f61b240e6621 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:15.386224 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ed62b-fe86-4321-b2a2-820a25638ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:15.386224 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ed62b-fe86-4321-b2a2-820a25638ade admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:15.386224 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ed62b-fe86-4321-b2a2-820a25638ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:15.386224 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ed62b-fe86-4321-b2a2-820a25638ade admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:15.386978 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ed62b-fe86-4321-b2a2-820a25638ade admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:15.389038 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ed62b-fe86-4321-b2a2-820a25638ade admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:15.418661 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 977/1947] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:09:15 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:09:15.424363 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c361016-1c0c-4be1-9077-346a11b09482 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:15.435138 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c361016-1c0c-4be1-9077-346a11b09482 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:15.492988 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ca7e1-af9c-49ab-8677-fabc03d3dc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:15.493699 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ca7e1-af9c-49ab-8677-fabc03d3dc0d admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:15.493983 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ca7e1-af9c-49ab-8677-fabc03d3dc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:15.494309 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ca7e1-af9c-49ab-8677-fabc03d3dc0d admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:15.494963 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ca7e1-af9c-49ab-8677-fabc03d3dc0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:15.497087 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ca7e1-af9c-49ab-8677-fabc03d3dc0d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:15.521008 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 971/1948] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:09:15 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:09:15.522473 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ed62b-fe86-4321-b2a2-820a25638ade admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:15.535474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ed62b-fe86-4321-b2a2-820a25638ade admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:15.541044 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d169832-01aa-4fc7-980a-ca9f190e2f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:15.541913 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d169832-01aa-4fc7-980a-ca9f190e2f55 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:15.542173 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d169832-01aa-4fc7-980a-ca9f190e2f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:15.542679 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d169832-01aa-4fc7-980a-ca9f190e2f55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:15.544170 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d169832-01aa-4fc7-980a-ca9f190e2f55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:15.546348 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d169832-01aa-4fc7-980a-ca9f190e2f55 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:15.558633 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 978/1949] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:09:15.562696 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ca7e1-af9c-49ab-8677-fabc03d3dc0d admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:15.573457 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ca7e1-af9c-49ab-8677-fabc03d3dc0d admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:15.579066 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155934d-8b79-40f0-b300-960be1417dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:15.579731 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155934d-8b79-40f0-b300-960be1417dcf admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:15.580033 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155934d-8b79-40f0-b300-960be1417dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:15.580307 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155934d-8b79-40f0-b300-960be1417dcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:15.581058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155934d-8b79-40f0-b300-960be1417dcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:15.582752 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155934d-8b79-40f0-b300-960be1417dcf admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:15.593334 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 972/1950] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:09:15.597737 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d169832-01aa-4fc7-980a-ca9f190e2f55 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:15.607861 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d169832-01aa-4fc7-980a-ca9f190e2f55 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:15.612549 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324307b1-4e8c-44ad-95b3-348b8325535d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:15.613461 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324307b1-4e8c-44ad-95b3-348b8325535d admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:15.613775 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324307b1-4e8c-44ad-95b3-348b8325535d admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:15.614056 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324307b1-4e8c-44ad-95b3-348b8325535d admin admin] PATH_INFO: `/v3/projects/8f60e317c8664f9e9c1990413a6a6aef/users/34fc33c34e4f4e4d8279393334c9c4a2/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:15.628732 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324307b1-4e8c-44ad-95b3-348b8325535d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f60e317c8664f9e9c1990413a6a6aef, user_id=34fc33c34e4f4e4d8279393334c9c4a2, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:15.631432 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324307b1-4e8c-44ad-95b3-348b8325535d admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:15.645594 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 979/1951] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:09:15 2022] PUT /identity/v3/projects/8f60e317c8664f9e9c1990413a6a6aef/users/34fc33c34e4f4e4d8279393334c9c4a2/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:15.657119 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a9c05-5e1a-4628-b2f8-1fa35d524161 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:15.657405 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a9c05-5e1a-4628-b2f8-1fa35d524161 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:15.657830 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a9c05-5e1a-4628-b2f8-1fa35d524161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:15.685165 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-400a9c05-5e1a-4628-b2f8-1fa35d524161 None None] MFA Rules not processed for user `34fc33c34e4f4e4d8279393334c9c4a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:15.686700 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-400a9c05-5e1a-4628-b2f8-1fa35d524161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:15.747606 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 973/1952] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:15.752244 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324307b1-4e8c-44ad-95b3-348b8325535d admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:15.815844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324307b1-4e8c-44ad-95b3-348b8325535d admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:15.820960 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1f084-a330-441a-9c57-21fccbb16744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:15.821668 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1f084-a330-441a-9c57-21fccbb16744 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:15.821946 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1f084-a330-441a-9c57-21fccbb16744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:15.822221 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1f084-a330-441a-9c57-21fccbb16744 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:15.822915 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d1f084-a330-441a-9c57-21fccbb16744 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:15.824848 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d1f084-a330-441a-9c57-21fccbb16744 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:15.851253 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 980/1953] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:09:15 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:09:15.855574 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a9c05-5e1a-4628-b2f8-1fa35d524161 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:15.865948 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a9c05-5e1a-4628-b2f8-1fa35d524161 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:15.922180 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c532d0-f6f6-4e8d-9ac5-1744ffe81b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:15.923123 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c532d0-f6f6-4e8d-9ac5-1744ffe81b2f admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:15.923478 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c532d0-f6f6-4e8d-9ac5-1744ffe81b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:15.923821 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c532d0-f6f6-4e8d-9ac5-1744ffe81b2f admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:15.924605 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c532d0-f6f6-4e8d-9ac5-1744ffe81b2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:15.926613 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c532d0-f6f6-4e8d-9ac5-1744ffe81b2f admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:15.947636 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 974/1954] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:09:15 2022] POST /identity/v3/users => generated 297 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:09:15.951562 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1f084-a330-441a-9c57-21fccbb16744 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:15.961674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1f084-a330-441a-9c57-21fccbb16744 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:15.966185 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb6369-5ddb-488f-a1fb-92b75793b861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:15.967004 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb6369-5ddb-488f-a1fb-92b75793b861 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:15.967158 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb6369-5ddb-488f-a1fb-92b75793b861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:15.967402 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb6369-5ddb-488f-a1fb-92b75793b861 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:15.968126 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb6369-5ddb-488f-a1fb-92b75793b861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:15.969944 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb6369-5ddb-488f-a1fb-92b75793b861 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:15.981877 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 981/1955] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:09:15.986121 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c532d0-f6f6-4e8d-9ac5-1744ffe81b2f admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:15.996036 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c532d0-f6f6-4e8d-9ac5-1744ffe81b2f admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:16.001377 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d98e59-dce6-4efb-b498-bf4cd5bc9b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:16.002229 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d98e59-dce6-4efb-b498-bf4cd5bc9b05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:16.002510 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d98e59-dce6-4efb-b498-bf4cd5bc9b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:16.002783 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d98e59-dce6-4efb-b498-bf4cd5bc9b05 admin admin] PATH_INFO: `/v3/projects/2e677c1909f546bc96d4b50e107a411d/users/de74e4d1261544e4b2b49c3cdb25d8a4/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:16.017509 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d98e59-dce6-4efb-b498-bf4cd5bc9b05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e677c1909f546bc96d4b50e107a411d, user_id=de74e4d1261544e4b2b49c3cdb25d8a4, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:16.020221 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d98e59-dce6-4efb-b498-bf4cd5bc9b05 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:16.037168 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 975/1956] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:09:15 2022] PUT /identity/v3/projects/2e677c1909f546bc96d4b50e107a411d/users/de74e4d1261544e4b2b49c3cdb25d8a4/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:16.042697 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb6369-5ddb-488f-a1fb-92b75793b861 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:16.053157 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb6369-5ddb-488f-a1fb-92b75793b861 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:16.114378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0616d-b7d8-4cef-9c67-5512565b8769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:16.115414 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0616d-b7d8-4cef-9c67-5512565b8769 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:16.115730 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0616d-b7d8-4cef-9c67-5512565b8769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:16.116039 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0616d-b7d8-4cef-9c67-5512565b8769 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:16.116809 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0616d-b7d8-4cef-9c67-5512565b8769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:16.118468 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0616d-b7d8-4cef-9c67-5512565b8769 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:16.128970 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 982/1957] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:09:16.133442 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d98e59-dce6-4efb-b498-bf4cd5bc9b05 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:16.144564 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d98e59-dce6-4efb-b498-bf4cd5bc9b05 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:16.150739 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb58d8-7d8f-4af7-a6d7-08041deb5fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:16.152049 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb58d8-7d8f-4af7-a6d7-08041deb5fd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:16.152419 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb58d8-7d8f-4af7-a6d7-08041deb5fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:16.152749 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb58d8-7d8f-4af7-a6d7-08041deb5fd9 admin admin] PATH_INFO: `/v3/projects/2e677c1909f546bc96d4b50e107a411d/users/de74e4d1261544e4b2b49c3cdb25d8a4/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:16.156720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb58d8-7d8f-4af7-a6d7-08041deb5fd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e677c1909f546bc96d4b50e107a411d, user_id=de74e4d1261544e4b2b49c3cdb25d8a4, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:16.159881 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb58d8-7d8f-4af7-a6d7-08041deb5fd9 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:16.171302 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 976/1958] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:09:16 2022] PUT /identity/v3/projects/2e677c1909f546bc96d4b50e107a411d/users/de74e4d1261544e4b2b49c3cdb25d8a4/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:16.181585 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323925e-e668-4054-83b2-780842232a67 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:16.181901 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323925e-e668-4054-83b2-780842232a67 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:16.182175 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323925e-e668-4054-83b2-780842232a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:16.208895 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-a323925e-e668-4054-83b2-780842232a67 None None] MFA Rules not processed for user `de74e4d1261544e4b2b49c3cdb25d8a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:16.210107 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a323925e-e668-4054-83b2-780842232a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:16.292220 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 983/1959] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:16.305984 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb58d8-7d8f-4af7-a6d7-08041deb5fd9 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:16.308000 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-aacb58d8-7d8f-4af7-a6d7-08041deb5fd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:16.368314 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb58d8-7d8f-4af7-a6d7-08041deb5fd9 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:16.373116 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be197dcb-a331-4594-96c9-adc2e3ef7635 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:16.373794 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be197dcb-a331-4594-96c9-adc2e3ef7635 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:16.374073 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be197dcb-a331-4594-96c9-adc2e3ef7635 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:16.374345 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be197dcb-a331-4594-96c9-adc2e3ef7635 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:16.384349 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be197dcb-a331-4594-96c9-adc2e3ef7635 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:16.385844 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be197dcb-a331-4594-96c9-adc2e3ef7635 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:16.395967 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 977/1960] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:09:16 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:09:16.469934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323925e-e668-4054-83b2-780842232a67 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:16.479404 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323925e-e668-4054-83b2-780842232a67 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:16.483348 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1cb06b-1fa2-4523-9d1d-f789deeb6aaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:16.484027 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1cb06b-1fa2-4523-9d1d-f789deeb6aaa service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:16.484305 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1cb06b-1fa2-4523-9d1d-f789deeb6aaa service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:16.484594 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1cb06b-1fa2-4523-9d1d-f789deeb6aaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:16.542950 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1cb06b-1fa2-4523-9d1d-f789deeb6aaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:16.544397 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1cb06b-1fa2-4523-9d1d-f789deeb6aaa service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:16.553686 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 984/1961] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:09:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:09:26.401439 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be197dcb-a331-4594-96c9-adc2e3ef7635 service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:26.403255 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-be197dcb-a331-4594-96c9-adc2e3ef7635 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:26.497492 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be197dcb-a331-4594-96c9-adc2e3ef7635 service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:26.503615 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828bc73-5710-43d9-8ac3-9b949e3d90fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:26.504734 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828bc73-5710-43d9-8ac3-9b949e3d90fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:26.504884 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828bc73-5710-43d9-8ac3-9b949e3d90fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:26.505389 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828bc73-5710-43d9-8ac3-9b949e3d90fe admin admin] PATH_INFO: `/v3/users/b952490fb3364db88d83c0999d01419e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:26.506771 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5828bc73-5710-43d9-8ac3-9b949e3d90fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=b952490fb3364db88d83c0999d01419e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:26.508996 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5828bc73-5710-43d9-8ac3-9b949e3d90fe admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:26.567075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5828bc73-5710-43d9-8ac3-9b949e3d90fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b952490fb3364db88d83c0999d01419e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:26.574121 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5828bc73-5710-43d9-8ac3-9b949e3d90fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b952490fb3364db88d83c0999d01419e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:26.582933 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5828bc73-5710-43d9-8ac3-9b949e3d90fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b952490fb3364db88d83c0999d01419e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:26.594610 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5828bc73-5710-43d9-8ac3-9b949e3d90fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b952490fb3364db88d83c0999d01419e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:26.595268 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5828bc73-5710-43d9-8ac3-9b949e3d90fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b952490fb3364db88d83c0999d01419e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:26.601331 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 978/1962] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:09:26 2022] DELETE /identity/v3/users/b952490fb3364db88d83c0999d01419e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:26.606358 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05fcda-87fd-4ffa-a1fb-ac52bfdd5695 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:26.606919 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05fcda-87fd-4ffa-a1fb-ac52bfdd5695 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:26.607010 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05fcda-87fd-4ffa-a1fb-ac52bfdd5695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:26.626195 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-4c05fcda-87fd-4ffa-a1fb-ac52bfdd5695 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:26.627562 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-4c05fcda-87fd-4ffa-a1fb-ac52bfdd5695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:26.687141 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 985/1963] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:26.697319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828bc73-5710-43d9-8ac3-9b949e3d90fe admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:26.698843 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5828bc73-5710-43d9-8ac3-9b949e3d90fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:26.757028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828bc73-5710-43d9-8ac3-9b949e3d90fe admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:26.760630 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb83211-a4e3-410e-8ff0-bb0439469ace service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:26.761272 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb83211-a4e3-410e-8ff0-bb0439469ace service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:26.761558 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb83211-a4e3-410e-8ff0-bb0439469ace service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:26.761949 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb83211-a4e3-410e-8ff0-bb0439469ace service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:26.772112 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb83211-a4e3-410e-8ff0-bb0439469ace service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:26.774426 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb83211-a4e3-410e-8ff0-bb0439469ace service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:26.789555 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 979/1964] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:09:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:09:27.100647 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05fcda-87fd-4ffa-a1fb-ac52bfdd5695 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:27.102740 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-4c05fcda-87fd-4ffa-a1fb-ac52bfdd5695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:27.120802 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05fcda-87fd-4ffa-a1fb-ac52bfdd5695 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:27.124511 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b8b198-7b52-44eb-8124-d0011013cffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:27.125934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b8b198-7b52-44eb-8124-d0011013cffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:27.126228 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b8b198-7b52-44eb-8124-d0011013cffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:27.126502 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b8b198-7b52-44eb-8124-d0011013cffc admin admin] PATH_INFO: `/v3/projects/d4febad77c3643a4986caea14ff5d914` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:27.128592 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b8b198-7b52-44eb-8124-d0011013cffc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4febad77c3643a4986caea14ff5d914)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:27.131601 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b8b198-7b52-44eb-8124-d0011013cffc admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:27.177454 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f8b8b198-7b52-44eb-8124-d0011013cffc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4febad77c3643a4986caea14ff5d914', 'request_id': 'req-f8b8b198-7b52-44eb-8124-d0011013cffc'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:27.182622 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f8b8b198-7b52-44eb-8124-d0011013cffc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4febad77c3643a4986caea14ff5d914', 'request_id': 'req-f8b8b198-7b52-44eb-8124-d0011013cffc'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:27.188644 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f8b8b198-7b52-44eb-8124-d0011013cffc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4febad77c3643a4986caea14ff5d914', 'request_id': 'req-f8b8b198-7b52-44eb-8124-d0011013cffc'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:27.202067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f8b8b198-7b52-44eb-8124-d0011013cffc admin admin] The token cache is being invalidate because project d4febad77c3643a4986caea14ff5d914 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:09:27.202340 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f8b8b198-7b52-44eb-8124-d0011013cffc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:27.202928 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f8b8b198-7b52-44eb-8124-d0011013cffc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:27.204530 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 986/1965] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:09:27 2022] DELETE /identity/v3/projects/d4febad77c3643a4986caea14ff5d914 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:27.209639 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1a798-d123-4f85-8785-d9b2603eb279 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:27.209945 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1a798-d123-4f85-8785-d9b2603eb279 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:27.210247 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1a798-d123-4f85-8785-d9b2603eb279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:27.228465 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-cba1a798-d123-4f85-8785-d9b2603eb279 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:27.229699 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-cba1a798-d123-4f85-8785-d9b2603eb279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:27.290254 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 980/1966] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:27.299316 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee43b58-f47b-4dc8-93da-b8c048aaa1b4 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:27.299611 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee43b58-f47b-4dc8-93da-b8c048aaa1b4 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:27.299923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee43b58-f47b-4dc8-93da-b8c048aaa1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:27.318858 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-8ee43b58-f47b-4dc8-93da-b8c048aaa1b4 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:27.320300 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-8ee43b58-f47b-4dc8-93da-b8c048aaa1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:27.328964 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 987/1967] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:27.333301 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1a798-d123-4f85-8785-d9b2603eb279 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:27.342900 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1a798-d123-4f85-8785-d9b2603eb279 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:27.348074 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30d433-69a7-4aa1-a8c4-e69d87d16d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:27.348746 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30d433-69a7-4aa1-a8c4-e69d87d16d53 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:27.349019 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30d433-69a7-4aa1-a8c4-e69d87d16d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:27.349272 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30d433-69a7-4aa1-a8c4-e69d87d16d53 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:27.350044 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30d433-69a7-4aa1-a8c4-e69d87d16d53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:09:27.350344 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30d433-69a7-4aa1-a8c4-e69d87d16d53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:27.352040 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30d433-69a7-4aa1-a8c4-e69d87d16d53 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:27.364384 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 981/1968] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:09:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:09:27.368838 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee43b58-f47b-4dc8-93da-b8c048aaa1b4 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:27.378704 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee43b58-f47b-4dc8-93da-b8c048aaa1b4 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:27.385051 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f9428-8cd1-40ee-b4c0-425caa9fd89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:27.385766 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f9428-8cd1-40ee-b4c0-425caa9fd89e admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:27.386074 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f9428-8cd1-40ee-b4c0-425caa9fd89e admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:27.386337 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f9428-8cd1-40ee-b4c0-425caa9fd89e admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:27.387159 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f9428-8cd1-40ee-b4c0-425caa9fd89e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:27.389062 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f9428-8cd1-40ee-b4c0-425caa9fd89e admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:27.418082 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 988/1969] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:09:27 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:09:27.422052 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30d433-69a7-4aa1-a8c4-e69d87d16d53 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:27.432364 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30d433-69a7-4aa1-a8c4-e69d87d16d53 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:27.488175 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d7396-bec7-418b-8da4-5d00b485baf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:27.488883 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d7396-bec7-418b-8da4-5d00b485baf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:27.489162 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d7396-bec7-418b-8da4-5d00b485baf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:27.489501 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d7396-bec7-418b-8da4-5d00b485baf1 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:27.490265 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d7396-bec7-418b-8da4-5d00b485baf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:27.492062 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d7396-bec7-418b-8da4-5d00b485baf1 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:27.513947 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 982/1970] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:09:27 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:09:27.518248 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f9428-8cd1-40ee-b4c0-425caa9fd89e admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:27.529237 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f9428-8cd1-40ee-b4c0-425caa9fd89e admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:27.534888 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93333101-4154-492f-a33a-ac76f9916135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:27.535500 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93333101-4154-492f-a33a-ac76f9916135 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:27.535782 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93333101-4154-492f-a33a-ac76f9916135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:27.536060 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93333101-4154-492f-a33a-ac76f9916135 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:27.537005 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93333101-4154-492f-a33a-ac76f9916135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:27.538947 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93333101-4154-492f-a33a-ac76f9916135 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:27.551440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 989/1971] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:09:27.555230 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d7396-bec7-418b-8da4-5d00b485baf1 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:27.565777 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d7396-bec7-418b-8da4-5d00b485baf1 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:27.574318 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439727ad-819b-4ce9-9a5f-0682fa839d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:27.575371 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439727ad-819b-4ce9-9a5f-0682fa839d52 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:27.575758 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439727ad-819b-4ce9-9a5f-0682fa839d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:27.576171 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439727ad-819b-4ce9-9a5f-0682fa839d52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:27.577672 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439727ad-819b-4ce9-9a5f-0682fa839d52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:27.579483 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439727ad-819b-4ce9-9a5f-0682fa839d52 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:27.591820 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 983/1972] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:09:27.596402 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93333101-4154-492f-a33a-ac76f9916135 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:27.606718 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93333101-4154-492f-a33a-ac76f9916135 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:27.613085 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053fec2-d72d-4c6b-b283-9d9d4a2b6e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:27.614115 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053fec2-d72d-4c6b-b283-9d9d4a2b6e76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:27.615773 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053fec2-d72d-4c6b-b283-9d9d4a2b6e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:27.616144 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053fec2-d72d-4c6b-b283-9d9d4a2b6e76 admin admin] PATH_INFO: `/v3/projects/053d1449368243acad7c389435ec357c/users/fa54a47a738c4b65b13f08921a7f76af/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:27.635894 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053fec2-d72d-4c6b-b283-9d9d4a2b6e76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=053d1449368243acad7c389435ec357c, user_id=fa54a47a738c4b65b13f08921a7f76af, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:27.638745 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053fec2-d72d-4c6b-b283-9d9d4a2b6e76 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:27.655243 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439727ad-819b-4ce9-9a5f-0682fa839d52 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:27.656691 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 990/1973] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:09:27 2022] PUT /identity/v3/projects/053d1449368243acad7c389435ec357c/users/fa54a47a738c4b65b13f08921a7f76af/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:09:27.658645 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-439727ad-819b-4ce9-9a5f-0682fa839d52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:27.666925 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88cc28-d3aa-438a-8eaa-24d40c99e162 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:27.667132 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88cc28-d3aa-438a-8eaa-24d40c99e162 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:27.667411 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88cc28-d3aa-438a-8eaa-24d40c99e162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:27.681896 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439727ad-819b-4ce9-9a5f-0682fa839d52 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:27.705851 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-0b88cc28-d3aa-438a-8eaa-24d40c99e162 None None] MFA Rules not processed for user `fa54a47a738c4b65b13f08921a7f76af`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:27.707426 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-0b88cc28-d3aa-438a-8eaa-24d40c99e162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:27.764451 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966d47d-284a-4549-97c4-72adc09df14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:27.766759 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966d47d-284a-4549-97c4-72adc09df14d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:27.767309 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966d47d-284a-4549-97c4-72adc09df14d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:27.767661 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966d47d-284a-4549-97c4-72adc09df14d admin admin] PATH_INFO: `/v3/users/34fc33c34e4f4e4d8279393334c9c4a2` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:27.770075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966d47d-284a-4549-97c4-72adc09df14d admin admin] RBAC: Authorizing `identity:delete_user(user_id=34fc33c34e4f4e4d8279393334c9c4a2)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:27.772465 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966d47d-284a-4549-97c4-72adc09df14d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:27.798050 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 991/1974] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:27.805522 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88cc28-d3aa-438a-8eaa-24d40c99e162 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:27.809075 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-0b88cc28-d3aa-438a-8eaa-24d40c99e162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:27.848938 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e966d47d-284a-4549-97c4-72adc09df14d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34fc33c34e4f4e4d8279393334c9c4a2'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:27.858901 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e966d47d-284a-4549-97c4-72adc09df14d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34fc33c34e4f4e4d8279393334c9c4a2'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:27.871656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e966d47d-284a-4549-97c4-72adc09df14d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34fc33c34e4f4e4d8279393334c9c4a2'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:27.881864 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88cc28-d3aa-438a-8eaa-24d40c99e162 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:27.885816 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db55cbd-2380-435f-9cd8-79843de163d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:27.886491 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db55cbd-2380-435f-9cd8-79843de163d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:27.886779 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db55cbd-2380-435f-9cd8-79843de163d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:27.887936 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db55cbd-2380-435f-9cd8-79843de163d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:27.889384 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e966d47d-284a-4549-97c4-72adc09df14d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34fc33c34e4f4e4d8279393334c9c4a2'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:27.891047 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e966d47d-284a-4549-97c4-72adc09df14d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34fc33c34e4f4e4d8279393334c9c4a2'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:27.898196 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db55cbd-2380-435f-9cd8-79843de163d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:27.898779 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 984/1975] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:09:27 2022] DELETE /identity/v3/users/34fc33c34e4f4e4d8279393334c9c4a2 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:09:27.903280 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db55cbd-2380-435f-9cd8-79843de163d1 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:27.903618 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95603c97-190f-44e3-ba0d-d2fad2d68923 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:27.903974 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95603c97-190f-44e3-ba0d-d2fad2d68923 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:27.904312 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95603c97-190f-44e3-ba0d-d2fad2d68923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:27.925000 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-95603c97-190f-44e3-ba0d-d2fad2d68923 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:27.926381 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-95603c97-190f-44e3-ba0d-d2fad2d68923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:27.926906 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 992/1976] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:09:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:09:28.036657 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 985/1977] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:28.048005 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db55cbd-2380-435f-9cd8-79843de163d1 service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:28.049598 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-5db55cbd-2380-435f-9cd8-79843de163d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:28.130339 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db55cbd-2380-435f-9cd8-79843de163d1 service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:28.192640 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892f61f-d8e0-4c21-bf51-7f7cc6279a3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:28.193310 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892f61f-d8e0-4c21-bf51-7f7cc6279a3d service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:28.193636 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892f61f-d8e0-4c21-bf51-7f7cc6279a3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:28.193910 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892f61f-d8e0-4c21-bf51-7f7cc6279a3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:28.205016 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892f61f-d8e0-4c21-bf51-7f7cc6279a3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:28.206781 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892f61f-d8e0-4c21-bf51-7f7cc6279a3d service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:28.217859 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 993/1978] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:09:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:09:28.531865 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95603c97-190f-44e3-ba0d-d2fad2d68923 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:28.534461 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-95603c97-190f-44e3-ba0d-d2fad2d68923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:28.563715 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95603c97-190f-44e3-ba0d-d2fad2d68923 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:28.571155 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163636fc-8581-46bd-8f38-fea45847a637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:28.571916 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163636fc-8581-46bd-8f38-fea45847a637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:28.572197 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163636fc-8581-46bd-8f38-fea45847a637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:28.572638 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163636fc-8581-46bd-8f38-fea45847a637 admin admin] PATH_INFO: `/v3/projects/8f60e317c8664f9e9c1990413a6a6aef` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:28.574314 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163636fc-8581-46bd-8f38-fea45847a637 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f60e317c8664f9e9c1990413a6a6aef)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:28.574422 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892f61f-d8e0-4c21-bf51-7f7cc6279a3d service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:28.576032 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a892f61f-d8e0-4c21-bf51-7f7cc6279a3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:28.576318 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163636fc-8581-46bd-8f38-fea45847a637 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:28.590784 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892f61f-d8e0-4c21-bf51-7f7cc6279a3d service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:28.597284 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386b2a5-8665-4ea1-aaee-9679533b1aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:28.598223 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386b2a5-8665-4ea1-aaee-9679533b1aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:28.598503 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386b2a5-8665-4ea1-aaee-9679533b1aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:28.598776 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386b2a5-8665-4ea1-aaee-9679533b1aa0 admin admin] PATH_INFO: `/v3/users/e6a312fd71b944188c56c42c94e15324` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:28.600272 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386b2a5-8665-4ea1-aaee-9679533b1aa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6a312fd71b944188c56c42c94e15324)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:28.602360 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386b2a5-8665-4ea1-aaee-9679533b1aa0 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:28.644348 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-163636fc-8581-46bd-8f38-fea45847a637 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f60e317c8664f9e9c1990413a6a6aef', 'request_id': 'req-163636fc-8581-46bd-8f38-fea45847a637'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:28.654649 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-163636fc-8581-46bd-8f38-fea45847a637 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f60e317c8664f9e9c1990413a6a6aef', 'request_id': 'req-163636fc-8581-46bd-8f38-fea45847a637'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:28.659336 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-8386b2a5-8665-4ea1-aaee-9679533b1aa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6a312fd71b944188c56c42c94e15324'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:28.661012 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-163636fc-8581-46bd-8f38-fea45847a637 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f60e317c8664f9e9c1990413a6a6aef', 'request_id': 'req-163636fc-8581-46bd-8f38-fea45847a637'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:28.672331 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-8386b2a5-8665-4ea1-aaee-9679533b1aa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6a312fd71b944188c56c42c94e15324'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:28.672963 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-163636fc-8581-46bd-8f38-fea45847a637 admin admin] The token cache is being invalidate because project 8f60e317c8664f9e9c1990413a6a6aef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:09:28.673429 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-163636fc-8581-46bd-8f38-fea45847a637 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:28.674117 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-163636fc-8581-46bd-8f38-fea45847a637 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:28.675909 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 986/1979] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:09:28 2022] DELETE /identity/v3/projects/8f60e317c8664f9e9c1990413a6a6aef => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:09:28.680775 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163636fc-8581-46bd-8f38-fea45847a637 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:28.683409 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-163636fc-8581-46bd-8f38-fea45847a637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:28.683973 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-8386b2a5-8665-4ea1-aaee-9679533b1aa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6a312fd71b944188c56c42c94e15324'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:28.684831 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-8386b2a5-8665-4ea1-aaee-9679533b1aa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6a312fd71b944188c56c42c94e15324'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:28.698521 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-8386b2a5-8665-4ea1-aaee-9679533b1aa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6a312fd71b944188c56c42c94e15324'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:28.705446 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 994/1980] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:09:28 2022] DELETE /identity/v3/users/e6a312fd71b944188c56c42c94e15324 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:28.757235 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163636fc-8581-46bd-8f38-fea45847a637 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:28.811515 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236562af-370a-44da-9191-290097ef4dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:28.812902 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236562af-370a-44da-9191-290097ef4dd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:28.813265 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236562af-370a-44da-9191-290097ef4dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:28.813542 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236562af-370a-44da-9191-290097ef4dd2 admin admin] PATH_INFO: `/v3/users/de74e4d1261544e4b2b49c3cdb25d8a4` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:28.815263 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236562af-370a-44da-9191-290097ef4dd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de74e4d1261544e4b2b49c3cdb25d8a4)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:28.817374 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236562af-370a-44da-9191-290097ef4dd2 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:28.866549 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-236562af-370a-44da-9191-290097ef4dd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de74e4d1261544e4b2b49c3cdb25d8a4'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:28.875904 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-236562af-370a-44da-9191-290097ef4dd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de74e4d1261544e4b2b49c3cdb25d8a4'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:28.881483 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386b2a5-8665-4ea1-aaee-9679533b1aa0 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:28.883336 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-8386b2a5-8665-4ea1-aaee-9679533b1aa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:28.885230 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-236562af-370a-44da-9191-290097ef4dd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de74e4d1261544e4b2b49c3cdb25d8a4'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:28.899989 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-236562af-370a-44da-9191-290097ef4dd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de74e4d1261544e4b2b49c3cdb25d8a4'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:28.900415 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386b2a5-8665-4ea1-aaee-9679533b1aa0 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:28.900869 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-236562af-370a-44da-9191-290097ef4dd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de74e4d1261544e4b2b49c3cdb25d8a4'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:28.906324 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04304867-d973-4c86-ae1d-cfd96059803d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:28.907224 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04304867-d973-4c86-ae1d-cfd96059803d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:28.907553 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04304867-d973-4c86-ae1d-cfd96059803d admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:28.907836 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04304867-d973-4c86-ae1d-cfd96059803d admin admin] PATH_INFO: `/v3/projects/6c29e44eba604e6389ecb2ee2b1059a0` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:28.908708 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 987/1981] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:09:28 2022] DELETE /identity/v3/users/de74e4d1261544e4b2b49c3cdb25d8a4 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:28.910185 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04304867-d973-4c86-ae1d-cfd96059803d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c29e44eba604e6389ecb2ee2b1059a0)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:28.912042 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04304867-d973-4c86-ae1d-cfd96059803d admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:28.962477 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-04304867-d973-4c86-ae1d-cfd96059803d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c29e44eba604e6389ecb2ee2b1059a0', 'request_id': 'req-04304867-d973-4c86-ae1d-cfd96059803d'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:28.969630 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-04304867-d973-4c86-ae1d-cfd96059803d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c29e44eba604e6389ecb2ee2b1059a0', 'request_id': 'req-04304867-d973-4c86-ae1d-cfd96059803d'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:28.976207 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-04304867-d973-4c86-ae1d-cfd96059803d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c29e44eba604e6389ecb2ee2b1059a0', 'request_id': 'req-04304867-d973-4c86-ae1d-cfd96059803d'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:28.989592 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-04304867-d973-4c86-ae1d-cfd96059803d admin admin] The token cache is being invalidate because project 6c29e44eba604e6389ecb2ee2b1059a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:09:28.989884 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-04304867-d973-4c86-ae1d-cfd96059803d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:28.990535 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-04304867-d973-4c86-ae1d-cfd96059803d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:28.992128 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 995/1982] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:09:28 2022] DELETE /identity/v3/projects/6c29e44eba604e6389ecb2ee2b1059a0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:28.997155 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ffc30-28d1-405a-b2da-095c042c605e None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:28.997450 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ffc30-28d1-405a-b2da-095c042c605e None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:28.997768 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ffc30-28d1-405a-b2da-095c042c605e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:29.016704 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-726ffc30-28d1-405a-b2da-095c042c605e None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:29.017937 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-726ffc30-28d1-405a-b2da-095c042c605e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:29.091886 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 988/1983] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:29.099611 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c240ca4-0e1f-4d79-b5de-13a166786a0e None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:29.099893 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c240ca4-0e1f-4d79-b5de-13a166786a0e None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:29.100185 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c240ca4-0e1f-4d79-b5de-13a166786a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:29.123379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-9c240ca4-0e1f-4d79-b5de-13a166786a0e None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:29.124733 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-9c240ca4-0e1f-4d79-b5de-13a166786a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:29.136951 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 996/1984] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:29.141094 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ffc30-28d1-405a-b2da-095c042c605e None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:29.151512 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ffc30-28d1-405a-b2da-095c042c605e None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:29.157041 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b8dad9-e151-469c-ac18-e906a96eafca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:29.157848 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8dad9-e151-469c-ac18-e906a96eafca admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:29.158030 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8dad9-e151-469c-ac18-e906a96eafca admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:29.158305 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8dad9-e151-469c-ac18-e906a96eafca admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:29.164322 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b8dad9-e151-469c-ac18-e906a96eafca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:09:29.164943 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b8dad9-e151-469c-ac18-e906a96eafca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:29.166877 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b8dad9-e151-469c-ac18-e906a96eafca admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:29.181826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 989/1985] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:09:29.189718 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c240ca4-0e1f-4d79-b5de-13a166786a0e None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:29.200417 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c240ca4-0e1f-4d79-b5de-13a166786a0e None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:29.205104 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69679af-79e8-4116-b46b-25a15891ed15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:29.205804 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69679af-79e8-4116-b46b-25a15891ed15 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:29.206112 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69679af-79e8-4116-b46b-25a15891ed15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:29.206399 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69679af-79e8-4116-b46b-25a15891ed15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:29.207103 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69679af-79e8-4116-b46b-25a15891ed15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:29.209054 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69679af-79e8-4116-b46b-25a15891ed15 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:29.237796 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b8dad9-e151-469c-ac18-e906a96eafca admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:29.239540 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-22b8dad9-e151-469c-ac18-e906a96eafca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:29.249792 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 997/1986] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:09:29 2022] POST /identity/v3/projects => generated 365 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:09:29.251198 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69679af-79e8-4116-b46b-25a15891ed15 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:29.252680 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b8dad9-e151-469c-ac18-e906a96eafca admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:29.323860 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69679af-79e8-4116-b46b-25a15891ed15 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:29.330212 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8060e-222e-44fe-ac72-684db579c236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:29.330969 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8060e-222e-44fe-ac72-684db579c236 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:29.331323 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8060e-222e-44fe-ac72-684db579c236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:29.331671 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8060e-222e-44fe-ac72-684db579c236 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:29.332550 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f8060e-222e-44fe-ac72-684db579c236 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:29.334600 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f8060e-222e-44fe-ac72-684db579c236 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:29.336852 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e7929-87d5-4b0b-b1fd-668ff7082b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:29.337789 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e7929-87d5-4b0b-b1fd-668ff7082b23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:29.338086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e7929-87d5-4b0b-b1fd-668ff7082b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:29.338532 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e7929-87d5-4b0b-b1fd-668ff7082b23 admin admin] PATH_INFO: `/v3/projects/2e677c1909f546bc96d4b50e107a411d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:29.339704 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e7929-87d5-4b0b-b1fd-668ff7082b23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e677c1909f546bc96d4b50e107a411d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:29.342023 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e7929-87d5-4b0b-b1fd-668ff7082b23 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:29.363017 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 998/1987] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:09:29 2022] POST /identity/v3/users => generated 283 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:09:29.365812 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8060e-222e-44fe-ac72-684db579c236 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:29.377984 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8060e-222e-44fe-ac72-684db579c236 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:29.386166 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b16762-7ba5-4b40-a048-b10770b04e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:29.386846 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b16762-7ba5-4b40-a048-b10770b04e1b admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:29.387081 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b16762-7ba5-4b40-a048-b10770b04e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:29.387391 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b16762-7ba5-4b40-a048-b10770b04e1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:29.388365 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b16762-7ba5-4b40-a048-b10770b04e1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:29.389763 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b16762-7ba5-4b40-a048-b10770b04e1b admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:29.409424 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-832e7929-87d5-4b0b-b1fd-668ff7082b23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e677c1909f546bc96d4b50e107a411d', 'request_id': 'req-832e7929-87d5-4b0b-b1fd-668ff7082b23'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:29.412749 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 999/1988] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:09:29.412749 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343c389-b2c3-4f99-8a17-76454e24eaf0 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:29.412749 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343c389-b2c3-4f99-8a17-76454e24eaf0 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:29.412749 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343c389-b2c3-4f99-8a17-76454e24eaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:29.421358 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-832e7929-87d5-4b0b-b1fd-668ff7082b23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e677c1909f546bc96d4b50e107a411d', 'request_id': 'req-832e7929-87d5-4b0b-b1fd-668ff7082b23'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:29.427151 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-832e7929-87d5-4b0b-b1fd-668ff7082b23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e677c1909f546bc96d4b50e107a411d', 'request_id': 'req-832e7929-87d5-4b0b-b1fd-668ff7082b23'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:29.433286 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-9343c389-b2c3-4f99-8a17-76454e24eaf0 None None] MFA Rules not processed for user `fa54a47a738c4b65b13f08921a7f76af`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:29.434717 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-9343c389-b2c3-4f99-8a17-76454e24eaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:29.439053 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-832e7929-87d5-4b0b-b1fd-668ff7082b23 admin admin] The token cache is being invalidate because project 2e677c1909f546bc96d4b50e107a411d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:09:29.439441 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-832e7929-87d5-4b0b-b1fd-668ff7082b23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:29.440213 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-832e7929-87d5-4b0b-b1fd-668ff7082b23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:29.442233 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 990/1989] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:09:29 2022] DELETE /identity/v3/projects/2e677c1909f546bc96d4b50e107a411d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:29.443074 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e7929-87d5-4b0b-b1fd-668ff7082b23 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:29.444395 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-832e7929-87d5-4b0b-b1fd-668ff7082b23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:29.493092 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1000/1990] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:29.494541 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aaba74-3e24-4664-9042-e59fb1f2a908 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:29.494832 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aaba74-3e24-4664-9042-e59fb1f2a908 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:29.495106 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aaba74-3e24-4664-9042-e59fb1f2a908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:29.507075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e7929-87d5-4b0b-b1fd-668ff7082b23 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:29.511994 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbed25-f16a-42c8-a419-005c9f849213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:29.512667 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbed25-f16a-42c8-a419-005c9f849213 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:29.512950 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbed25-f16a-42c8-a419-005c9f849213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:29.513220 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbed25-f16a-42c8-a419-005c9f849213 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:29.513503 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-21aaba74-3e24-4664-9042-e59fb1f2a908 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:29.513978 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bbed25-f16a-42c8-a419-005c9f849213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:29.515043 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-21aaba74-3e24-4664-9042-e59fb1f2a908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:29.515592 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bbed25-f16a-42c8-a419-005c9f849213 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:29.525675 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1001/1991] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:29.529426 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 991/1992] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:09:29.530370 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aaba74-3e24-4664-9042-e59fb1f2a908 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:29.532472 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c4a92-8a70-482b-b42e-48c23fb09a32 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:29.532941 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c4a92-8a70-482b-b42e-48c23fb09a32 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:29.533033 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c4a92-8a70-482b-b42e-48c23fb09a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:29.540725 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aaba74-3e24-4664-9042-e59fb1f2a908 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:29.548956 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1923232-cfef-4372-bd15-98c9a5e2fbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:29.549994 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1923232-cfef-4372-bd15-98c9a5e2fbaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:29.550370 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1923232-cfef-4372-bd15-98c9a5e2fbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:29.550658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1923232-cfef-4372-bd15-98c9a5e2fbaa admin admin] PATH_INFO: `/v3/projects/e8107c761f954fd5b694301571927271/users/5e710af78da34b0c9b33b4d591c13ddc/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:29.551928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-ef5c4a92-8a70-482b-b42e-48c23fb09a32 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:29.553111 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ef5c4a92-8a70-482b-b42e-48c23fb09a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:29.561257 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 992/1993] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:29.565338 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c4a92-8a70-482b-b42e-48c23fb09a32 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:29.566409 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1923232-cfef-4372-bd15-98c9a5e2fbaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8107c761f954fd5b694301571927271, user_id=5e710af78da34b0c9b33b4d591c13ddc, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:29.569087 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1923232-cfef-4372-bd15-98c9a5e2fbaa admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:29.574347 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c4a92-8a70-482b-b42e-48c23fb09a32 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:29.579428 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6490cf-03d1-405f-977b-10fa7f4cc4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:29.579857 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6490cf-03d1-405f-977b-10fa7f4cc4f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:29.580138 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6490cf-03d1-405f-977b-10fa7f4cc4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:29.580406 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6490cf-03d1-405f-977b-10fa7f4cc4f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:29.581829 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6490cf-03d1-405f-977b-10fa7f4cc4f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:09:29.581829 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6490cf-03d1-405f-977b-10fa7f4cc4f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:29.583033 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6490cf-03d1-405f-977b-10fa7f4cc4f9 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:29.585004 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1002/1994] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:09:29 2022] PUT /identity/v3/projects/e8107c761f954fd5b694301571927271/users/5e710af78da34b0c9b33b4d591c13ddc/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:09:29.596259 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea174e-5563-415e-89c4-d73c31fabcd7 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:29.596652 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea174e-5563-415e-89c4-d73c31fabcd7 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:29.597003 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea174e-5563-415e-89c4-d73c31fabcd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:29.597700 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 993/1995] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 19:09:29.599237 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6490cf-03d1-405f-977b-10fa7f4cc4f9 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:29.610259 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6490cf-03d1-405f-977b-10fa7f4cc4f9 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:29.626400 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-23ea174e-5563-415e-89c4-d73c31fabcd7 None None] MFA Rules not processed for user `5e710af78da34b0c9b33b4d591c13ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:29.627703 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-23ea174e-5563-415e-89c4-d73c31fabcd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:29.669020 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8a73a-fbe2-4d3c-a824-d95f2c437dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:29.669729 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8a73a-fbe2-4d3c-a824-d95f2c437dd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:29.670022 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8a73a-fbe2-4d3c-a824-d95f2c437dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:29.670298 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8a73a-fbe2-4d3c-a824-d95f2c437dd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:29.670996 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8a73a-fbe2-4d3c-a824-d95f2c437dd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:29.673301 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8a73a-fbe2-4d3c-a824-d95f2c437dd2 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:29.698040 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1003/1996] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:29 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:09:29.702836 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea174e-5563-415e-89c4-d73c31fabcd7 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:29.707039 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 994/1997] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:09:29 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:09:29.708188 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8a73a-fbe2-4d3c-a824-d95f2c437dd2 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:29.713107 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea174e-5563-415e-89c4-d73c31fabcd7 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:29.771050 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8a73a-fbe2-4d3c-a824-d95f2c437dd2 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:29.771700 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557e69b-c007-4ba1-9fc1-3c2ec5da52ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:29.772382 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557e69b-c007-4ba1-9fc1-3c2ec5da52ef admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:29.772666 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557e69b-c007-4ba1-9fc1-3c2ec5da52ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:29.772940 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557e69b-c007-4ba1-9fc1-3c2ec5da52ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:29.773672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3557e69b-c007-4ba1-9fc1-3c2ec5da52ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:29.775794 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3557e69b-c007-4ba1-9fc1-3c2ec5da52ef admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:29.776346 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457859b-9e1e-4e73-9c6c-14522d57b15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:29.777083 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457859b-9e1e-4e73-9c6c-14522d57b15e admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:29.777471 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457859b-9e1e-4e73-9c6c-14522d57b15e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:29.778137 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457859b-9e1e-4e73-9c6c-14522d57b15e admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:29.779008 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457859b-9e1e-4e73-9c6c-14522d57b15e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:29.780980 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457859b-9e1e-4e73-9c6c-14522d57b15e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:29.803122 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1004/1998] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:09:29 2022] POST /identity/v3/projects => generated 367 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:09:29.806183 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 995/1999] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:09:29 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:09:29.807209 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457859b-9e1e-4e73-9c6c-14522d57b15e admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:29.807453 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557e69b-c007-4ba1-9fc1-3c2ec5da52ef admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:29.817285 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457859b-9e1e-4e73-9c6c-14522d57b15e admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:29.877910 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557e69b-c007-4ba1-9fc1-3c2ec5da52ef admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:29.878556 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38df7e-c44a-4315-a1a4-cbfb03c64082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:29.879304 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38df7e-c44a-4315-a1a4-cbfb03c64082 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:29.879646 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38df7e-c44a-4315-a1a4-cbfb03c64082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:29.880111 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38df7e-c44a-4315-a1a4-cbfb03c64082 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:29.880844 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38df7e-c44a-4315-a1a4-cbfb03c64082 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:29.882474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d68c4-406a-41b3-bb23-c39989d87b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:29.883245 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d68c4-406a-41b3-bb23-c39989d87b8f admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:29.883423 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d68c4-406a-41b3-bb23-c39989d87b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:29.883691 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d68c4-406a-41b3-bb23-c39989d87b8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:29.884221 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38df7e-c44a-4315-a1a4-cbfb03c64082 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:29.884409 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d68c4-406a-41b3-bb23-c39989d87b8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:29.886495 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d68c4-406a-41b3-bb23-c39989d87b8f admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:29.897226 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1005/2000] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:09:29.901078 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d68c4-406a-41b3-bb23-c39989d87b8f admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:29.911004 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 996/2001] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:09:29 2022] POST /identity/v3/users => generated 290 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:09:29.911780 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d68c4-406a-41b3-bb23-c39989d87b8f admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:29.915184 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38df7e-c44a-4315-a1a4-cbfb03c64082 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:29.917562 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3555c2-80d0-48de-8429-3553de327f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:29.918076 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3555c2-80d0-48de-8429-3553de327f2f admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:29.918322 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3555c2-80d0-48de-8429-3553de327f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:29.918586 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3555c2-80d0-48de-8429-3553de327f2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:29.919383 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3555c2-80d0-48de-8429-3553de327f2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:29.920979 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3555c2-80d0-48de-8429-3553de327f2f admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:29.927601 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38df7e-c44a-4315-a1a4-cbfb03c64082 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:29.935601 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1006/2002] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 19:09:29.935747 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a18903-58d6-4818-9a58-7b561a1d67d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:29.935747 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a18903-58d6-4818-9a58-7b561a1d67d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:29.935747 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a18903-58d6-4818-9a58-7b561a1d67d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:29.935747 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a18903-58d6-4818-9a58-7b561a1d67d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:29.936057 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a18903-58d6-4818-9a58-7b561a1d67d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:29.936489 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a18903-58d6-4818-9a58-7b561a1d67d2 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:29.938646 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3555c2-80d0-48de-8429-3553de327f2f admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:29.950623 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3555c2-80d0-48de-8429-3553de327f2f admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:29.955512 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0bacd7-b2bc-4e62-8fd1-f59723edd295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:29.956412 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bacd7-b2bc-4e62-8fd1-f59723edd295 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:29.956694 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bacd7-b2bc-4e62-8fd1-f59723edd295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:29.956972 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bacd7-b2bc-4e62-8fd1-f59723edd295 admin admin] PATH_INFO: `/v3/projects/b07cac5075bc4b3a8bd40ac07165b29b/users/fdc47f5b66d849dd9c03bdcaf6a428b6/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:29.958739 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 997/2003] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:09:29.962576 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a18903-58d6-4818-9a58-7b561a1d67d2 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:29.973490 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a18903-58d6-4818-9a58-7b561a1d67d2 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:29.979271 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964cb1d-e671-40c9-af78-344717f3c63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:29.980311 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964cb1d-e671-40c9-af78-344717f3c63f admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:29.980654 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964cb1d-e671-40c9-af78-344717f3c63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:29.980987 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964cb1d-e671-40c9-af78-344717f3c63f admin admin] PATH_INFO: `/v3/projects/a473a28ae8f74ed1a3037bb7e310266f/users/996f127d8f9a47f3a1b7c1d859678684/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:29.983215 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0bacd7-b2bc-4e62-8fd1-f59723edd295 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b07cac5075bc4b3a8bd40ac07165b29b, user_id=fdc47f5b66d849dd9c03bdcaf6a428b6, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:29.986263 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0bacd7-b2bc-4e62-8fd1-f59723edd295 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:29.999188 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964cb1d-e671-40c9-af78-344717f3c63f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a473a28ae8f74ed1a3037bb7e310266f, user_id=996f127d8f9a47f3a1b7c1d859678684, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:30.001142 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1007/2004] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:09:29 2022] PUT /identity/v3/projects/b07cac5075bc4b3a8bd40ac07165b29b/users/fdc47f5b66d849dd9c03bdcaf6a428b6/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:30.002376 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964cb1d-e671-40c9-af78-344717f3c63f admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:30.020261 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 998/2005] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:09:29 2022] PUT /identity/v3/projects/a473a28ae8f74ed1a3037bb7e310266f/users/996f127d8f9a47f3a1b7c1d859678684/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:09:30.020721 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca2581-83b1-4b84-9e10-ee91ad0c6f3d None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:30.021217 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca2581-83b1-4b84-9e10-ee91ad0c6f3d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:30.021655 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964cb1d-e671-40c9-af78-344717f3c63f admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:30.021849 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca2581-83b1-4b84-9e10-ee91ad0c6f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:30.055009 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-30ca2581-83b1-4b84-9e10-ee91ad0c6f3d None None] MFA Rules not processed for user `fdc47f5b66d849dd9c03bdcaf6a428b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:30.056248 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-30ca2581-83b1-4b84-9e10-ee91ad0c6f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:30.107129 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964cb1d-e671-40c9-af78-344717f3c63f admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:30.112124 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b681165-073c-4449-9460-0a4e0ecb873d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:30.112802 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b681165-073c-4449-9460-0a4e0ecb873d admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:30.113075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b681165-073c-4449-9460-0a4e0ecb873d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:30.113342 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b681165-073c-4449-9460-0a4e0ecb873d admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:30.114106 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b681165-073c-4449-9460-0a4e0ecb873d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:30.115821 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b681165-073c-4449-9460-0a4e0ecb873d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:30.128818 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 999/2006] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:09:30.130706 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1008/2007] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:30.136409 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b681165-073c-4449-9460-0a4e0ecb873d admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:30.136671 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca2581-83b1-4b84-9e10-ee91ad0c6f3d None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:30.147548 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b681165-073c-4449-9460-0a4e0ecb873d admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:30.148445 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca2581-83b1-4b84-9e10-ee91ad0c6f3d None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:30.152429 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e0008-53c0-4fe1-b32d-3e75d5666881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:30.153523 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e0008-53c0-4fe1-b32d-3e75d5666881 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:30.153725 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31e0fc-3997-4665-96fc-5cd70d015a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:30.154132 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e0008-53c0-4fe1-b32d-3e75d5666881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:30.154474 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e0008-53c0-4fe1-b32d-3e75d5666881 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:30.154885 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31e0fc-3997-4665-96fc-5cd70d015a4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:30.155224 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31e0fc-3997-4665-96fc-5cd70d015a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:30.155318 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e0008-53c0-4fe1-b32d-3e75d5666881 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:30.155605 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31e0fc-3997-4665-96fc-5cd70d015a4c admin admin] PATH_INFO: `/v3/projects/a473a28ae8f74ed1a3037bb7e310266f/users/996f127d8f9a47f3a1b7c1d859678684/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:30.157969 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d31e0fc-3997-4665-96fc-5cd70d015a4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a473a28ae8f74ed1a3037bb7e310266f, user_id=996f127d8f9a47f3a1b7c1d859678684, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:30.160999 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d31e0fc-3997-4665-96fc-5cd70d015a4c admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:30.162236 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e0008-53c0-4fe1-b32d-3e75d5666881 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:30.172674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1009/2008] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:09:30 2022] PUT /identity/v3/projects/a473a28ae8f74ed1a3037bb7e310266f/users/996f127d8f9a47f3a1b7c1d859678684/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:09:30.183783 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5e6c3-4587-402d-98f4-912ff1e11e26 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:30.184124 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5e6c3-4587-402d-98f4-912ff1e11e26 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:30.184404 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5e6c3-4587-402d-98f4-912ff1e11e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:30.201954 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1000/2009] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:09:30 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:09:30.203030 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e0008-53c0-4fe1-b32d-3e75d5666881 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:30.214981 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-7bb5e6c3-4587-402d-98f4-912ff1e11e26 None None] MFA Rules not processed for user `996f127d8f9a47f3a1b7c1d859678684`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:30.216396 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-7bb5e6c3-4587-402d-98f4-912ff1e11e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:30.271750 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e0008-53c0-4fe1-b32d-3e75d5666881 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:30.276603 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b93f3-8412-4ef8-a4a3-3d433d958db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:30.277407 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b93f3-8412-4ef8-a4a3-3d433d958db7 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:30.278337 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b93f3-8412-4ef8-a4a3-3d433d958db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:30.278583 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b93f3-8412-4ef8-a4a3-3d433d958db7 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:30.279378 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b93f3-8412-4ef8-a4a3-3d433d958db7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:30.281550 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b93f3-8412-4ef8-a4a3-3d433d958db7 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:30.293034 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1010/2010] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:30 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:30.305485 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5e6c3-4587-402d-98f4-912ff1e11e26 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:30.305642 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1001/2011] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:09:30 2022] POST /identity/v3/users => generated 299 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:09:30.307091 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-7bb5e6c3-4587-402d-98f4-912ff1e11e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:30.309606 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b93f3-8412-4ef8-a4a3-3d433d958db7 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:30.320902 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b93f3-8412-4ef8-a4a3-3d433d958db7 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:30.327121 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ca742-76a1-4fa3-be17-339f8c9fbc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:30.328164 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ca742-76a1-4fa3-be17-339f8c9fbc1a admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:30.328881 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ca742-76a1-4fa3-be17-339f8c9fbc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:30.328881 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ca742-76a1-4fa3-be17-339f8c9fbc1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:30.329735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1ca742-76a1-4fa3-be17-339f8c9fbc1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:30.332094 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1ca742-76a1-4fa3-be17-339f8c9fbc1a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:30.343105 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1002/2012] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 19:09:30.348495 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ca742-76a1-4fa3-be17-339f8c9fbc1a admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:30.359502 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ca742-76a1-4fa3-be17-339f8c9fbc1a admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:30.365615 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab672cc-c414-420b-9d05-6b4779e1cd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:30.366670 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab672cc-c414-420b-9d05-6b4779e1cd12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:30.366986 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab672cc-c414-420b-9d05-6b4779e1cd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:30.367264 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab672cc-c414-420b-9d05-6b4779e1cd12 admin admin] PATH_INFO: `/v3/projects/6c4a34407ed046e4a5179aee3e1b62a1/users/a02f23c44908424992844383a5109dc2/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:30.386404 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab672cc-c414-420b-9d05-6b4779e1cd12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c4a34407ed046e4a5179aee3e1b62a1, user_id=a02f23c44908424992844383a5109dc2, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:30.389166 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab672cc-c414-420b-9d05-6b4779e1cd12 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:30.392079 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5e6c3-4587-402d-98f4-912ff1e11e26 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:30.398289 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f62f3-002c-495d-850e-6a01aa21f9b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:30.399041 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f62f3-002c-495d-850e-6a01aa21f9b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:30.399271 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f62f3-002c-495d-850e-6a01aa21f9b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:30.399573 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f62f3-002c-495d-850e-6a01aa21f9b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:30.405897 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1003/2013] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:09:30 2022] PUT /identity/v3/projects/6c4a34407ed046e4a5179aee3e1b62a1/users/a02f23c44908424992844383a5109dc2/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:30.413615 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab672cc-c414-420b-9d05-6b4779e1cd12 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:30.418048 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f62f3-002c-495d-850e-6a01aa21f9b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:30.419960 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f62f3-002c-495d-850e-6a01aa21f9b6 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:30.433305 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1011/2014] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:09:30 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 19:09:30.496309 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f62f3-002c-495d-850e-6a01aa21f9b6 service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:30.497807 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-930f62f3-002c-495d-850e-6a01aa21f9b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:30.521221 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f62f3-002c-495d-850e-6a01aa21f9b6 service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:30.541487 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab672cc-c414-420b-9d05-6b4779e1cd12 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:30.547246 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f392e-5503-48b4-9996-6f426038774c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:30.548151 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f392e-5503-48b4-9996-6f426038774c admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:30.548629 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f392e-5503-48b4-9996-6f426038774c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:30.548905 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f392e-5503-48b4-9996-6f426038774c admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:30.549818 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f392e-5503-48b4-9996-6f426038774c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:30.551512 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f392e-5503-48b4-9996-6f426038774c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:30.563351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1004/2015] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 19:09:30.567370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f392e-5503-48b4-9996-6f426038774c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:30.587158 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f392e-5503-48b4-9996-6f426038774c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:30.592284 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b48269-660c-40b5-849b-c30cf5511b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:30.593615 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b48269-660c-40b5-849b-c30cf5511b54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:30.593992 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b48269-660c-40b5-849b-c30cf5511b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:30.594273 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b48269-660c-40b5-849b-c30cf5511b54 admin admin] PATH_INFO: `/v3/projects/6c4a34407ed046e4a5179aee3e1b62a1/users/a02f23c44908424992844383a5109dc2/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:30.596806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b48269-660c-40b5-849b-c30cf5511b54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c4a34407ed046e4a5179aee3e1b62a1, user_id=a02f23c44908424992844383a5109dc2, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:30.599519 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b48269-660c-40b5-849b-c30cf5511b54 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:30.611527 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1005/2016] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:09:30 2022] PUT /identity/v3/projects/6c4a34407ed046e4a5179aee3e1b62a1/users/a02f23c44908424992844383a5109dc2/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:09:30.622424 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17bd3de-3581-4fe1-842b-df3e6dce1d1a None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:30.622828 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17bd3de-3581-4fe1-842b-df3e6dce1d1a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:30.622928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17bd3de-3581-4fe1-842b-df3e6dce1d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:30.658159 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7087ba-92c0-41ee-86da-591873ef9d06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:30.659482 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7087ba-92c0-41ee-86da-591873ef9d06 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:30.660250 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7087ba-92c0-41ee-86da-591873ef9d06 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:30.660979 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7087ba-92c0-41ee-86da-591873ef9d06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:30.661976 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-e17bd3de-3581-4fe1-842b-df3e6dce1d1a None None] MFA Rules not processed for user `a02f23c44908424992844383a5109dc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:30.663525 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e17bd3de-3581-4fe1-842b-df3e6dce1d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:30.753947 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1006/2017] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:09:30.764570 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17bd3de-3581-4fe1-842b-df3e6dce1d1a None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:30.766068 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7087ba-92c0-41ee-86da-591873ef9d06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:30.768828 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7087ba-92c0-41ee-86da-591873ef9d06 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:30.785600 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1012/2018] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:09:30 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:09:30.835138 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17bd3de-3581-4fe1-842b-df3e6dce1d1a None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:30.839074 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c25065-e748-40c8-8673-11bd2aab7943 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:30.840017 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c25065-e748-40c8-8673-11bd2aab7943 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:30.840222 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c25065-e748-40c8-8673-11bd2aab7943 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:30.840502 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c25065-e748-40c8-8673-11bd2aab7943 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:30.851030 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c25065-e748-40c8-8673-11bd2aab7943 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:30.852557 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c25065-e748-40c8-8673-11bd2aab7943 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:30.863717 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1007/2019] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:09:30 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 19:09:31.434728 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7087ba-92c0-41ee-86da-591873ef9d06 service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:31.446533 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7087ba-92c0-41ee-86da-591873ef9d06 service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:31.504101 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215851f0-e4f9-49c6-840b-fffb31f8d7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:31.504981 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215851f0-e4f9-49c6-840b-fffb31f8d7a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:31.505262 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215851f0-e4f9-49c6-840b-fffb31f8d7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:31.505560 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215851f0-e4f9-49c6-840b-fffb31f8d7a8 admin admin] PATH_INFO: `/v3/users/fdc47f5b66d849dd9c03bdcaf6a428b6` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:31.506763 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215851f0-e4f9-49c6-840b-fffb31f8d7a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdc47f5b66d849dd9c03bdcaf6a428b6)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:31.508726 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215851f0-e4f9-49c6-840b-fffb31f8d7a8 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:31.578823 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-215851f0-e4f9-49c6-840b-fffb31f8d7a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdc47f5b66d849dd9c03bdcaf6a428b6'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:31.586706 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-215851f0-e4f9-49c6-840b-fffb31f8d7a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdc47f5b66d849dd9c03bdcaf6a428b6'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:31.594735 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-215851f0-e4f9-49c6-840b-fffb31f8d7a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdc47f5b66d849dd9c03bdcaf6a428b6'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:31.595404 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-215851f0-e4f9-49c6-840b-fffb31f8d7a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdc47f5b66d849dd9c03bdcaf6a428b6'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:31.610028 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-215851f0-e4f9-49c6-840b-fffb31f8d7a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdc47f5b66d849dd9c03bdcaf6a428b6'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:31.616259 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1013/2020] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:09:31 2022] DELETE /identity/v3/users/fdc47f5b66d849dd9c03bdcaf6a428b6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:31.621090 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eebe55-01d3-4e70-90ca-6f94e18a3b14 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:31.621641 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eebe55-01d3-4e70-90ca-6f94e18a3b14 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:31.621641 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eebe55-01d3-4e70-90ca-6f94e18a3b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:31.644613 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-70eebe55-01d3-4e70-90ca-6f94e18a3b14 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:31.645917 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-70eebe55-01d3-4e70-90ca-6f94e18a3b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:31.709848 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1008/2021] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:31.715972 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215851f0-e4f9-49c6-840b-fffb31f8d7a8 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:31.717421 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-215851f0-e4f9-49c6-840b-fffb31f8d7a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:31.783330 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215851f0-e4f9-49c6-840b-fffb31f8d7a8 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:31.787581 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f7a41-e2c0-42b5-a0e3-ef2c3c857d9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:31.788336 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f7a41-e2c0-42b5-a0e3-ef2c3c857d9b service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:31.788686 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f7a41-e2c0-42b5-a0e3-ef2c3c857d9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:31.788963 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f7a41-e2c0-42b5-a0e3-ef2c3c857d9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:31.799380 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f7a41-e2c0-42b5-a0e3-ef2c3c857d9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:31.800831 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f7a41-e2c0-42b5-a0e3-ef2c3c857d9b service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:31.811565 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1014/2022] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:09:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:09:32.261867 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eebe55-01d3-4e70-90ca-6f94e18a3b14 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:32.263854 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-70eebe55-01d3-4e70-90ca-6f94e18a3b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:32.275984 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eebe55-01d3-4e70-90ca-6f94e18a3b14 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:32.281317 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e4ff2-a724-4551-a624-61e1d9533d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:32.282278 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e4ff2-a724-4551-a624-61e1d9533d94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:32.282642 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e4ff2-a724-4551-a624-61e1d9533d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:32.282922 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e4ff2-a724-4551-a624-61e1d9533d94 admin admin] PATH_INFO: `/v3/projects/b07cac5075bc4b3a8bd40ac07165b29b` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:32.284643 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03e4ff2-a724-4551-a624-61e1d9533d94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b07cac5075bc4b3a8bd40ac07165b29b)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:32.286655 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03e4ff2-a724-4551-a624-61e1d9533d94 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:32.354729 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d03e4ff2-a724-4551-a624-61e1d9533d94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b07cac5075bc4b3a8bd40ac07165b29b', 'request_id': 'req-d03e4ff2-a724-4551-a624-61e1d9533d94'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:32.371336 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d03e4ff2-a724-4551-a624-61e1d9533d94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b07cac5075bc4b3a8bd40ac07165b29b', 'request_id': 'req-d03e4ff2-a724-4551-a624-61e1d9533d94'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:32.378369 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d03e4ff2-a724-4551-a624-61e1d9533d94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b07cac5075bc4b3a8bd40ac07165b29b', 'request_id': 'req-d03e4ff2-a724-4551-a624-61e1d9533d94'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:32.393928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d03e4ff2-a724-4551-a624-61e1d9533d94 admin admin] The token cache is being invalidate because project b07cac5075bc4b3a8bd40ac07165b29b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:09:32.394231 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d03e4ff2-a724-4551-a624-61e1d9533d94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:32.396097 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d03e4ff2-a724-4551-a624-61e1d9533d94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:32.398322 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1009/2023] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:09:32 2022] DELETE /identity/v3/projects/b07cac5075bc4b3a8bd40ac07165b29b => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:32.403411 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f7a41-e2c0-42b5-a0e3-ef2c3c857d9b service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:32.417670 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f7a41-e2c0-42b5-a0e3-ef2c3c857d9b service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:32.565023 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34bda1-9f75-480a-a0a2-8c806b95f482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:32.565723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34bda1-9f75-480a-a0a2-8c806b95f482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:32.566062 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34bda1-9f75-480a-a0a2-8c806b95f482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:32.566326 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34bda1-9f75-480a-a0a2-8c806b95f482 admin admin] PATH_INFO: `/v3/users/a02f23c44908424992844383a5109dc2` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:32.567588 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34bda1-9f75-480a-a0a2-8c806b95f482 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a02f23c44908424992844383a5109dc2)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:32.569864 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34bda1-9f75-480a-a0a2-8c806b95f482 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:32.626438 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-2b34bda1-9f75-480a-a0a2-8c806b95f482 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a02f23c44908424992844383a5109dc2'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:32.636078 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-2b34bda1-9f75-480a-a0a2-8c806b95f482 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a02f23c44908424992844383a5109dc2'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:32.645620 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-2b34bda1-9f75-480a-a0a2-8c806b95f482 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a02f23c44908424992844383a5109dc2'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:32.646443 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-2b34bda1-9f75-480a-a0a2-8c806b95f482 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a02f23c44908424992844383a5109dc2'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:32.659797 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-2b34bda1-9f75-480a-a0a2-8c806b95f482 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a02f23c44908424992844383a5109dc2'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:32.668608 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1015/2024] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:09:32 2022] DELETE /identity/v3/users/a02f23c44908424992844383a5109dc2 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:33.032754 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e4ff2-a724-4551-a624-61e1d9533d94 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:33.037867 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d03e4ff2-a724-4551-a624-61e1d9533d94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:33.074434 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e4ff2-a724-4551-a624-61e1d9533d94 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:33.140404 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e707921-c898-4cb6-bf9e-18140b3ad23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:33.141285 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e707921-c898-4cb6-bf9e-18140b3ad23e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:33.141582 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e707921-c898-4cb6-bf9e-18140b3ad23e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:33.141859 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e707921-c898-4cb6-bf9e-18140b3ad23e admin admin] PATH_INFO: `/v3/projects/6c4a34407ed046e4a5179aee3e1b62a1` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:33.143185 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e707921-c898-4cb6-bf9e-18140b3ad23e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c4a34407ed046e4a5179aee3e1b62a1)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:33.145102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e707921-c898-4cb6-bf9e-18140b3ad23e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:33.198111 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6e707921-c898-4cb6-bf9e-18140b3ad23e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c4a34407ed046e4a5179aee3e1b62a1', 'request_id': 'req-6e707921-c898-4cb6-bf9e-18140b3ad23e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:33.208794 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6e707921-c898-4cb6-bf9e-18140b3ad23e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c4a34407ed046e4a5179aee3e1b62a1', 'request_id': 'req-6e707921-c898-4cb6-bf9e-18140b3ad23e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:33.216072 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6e707921-c898-4cb6-bf9e-18140b3ad23e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c4a34407ed046e4a5179aee3e1b62a1', 'request_id': 'req-6e707921-c898-4cb6-bf9e-18140b3ad23e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:33.234109 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6e707921-c898-4cb6-bf9e-18140b3ad23e admin admin] The token cache is being invalidate because project 6c4a34407ed046e4a5179aee3e1b62a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:09:33.234563 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6e707921-c898-4cb6-bf9e-18140b3ad23e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:33.235701 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6e707921-c898-4cb6-bf9e-18140b3ad23e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:33.241581 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1010/2025] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:09:33 2022] DELETE /identity/v3/projects/6c4a34407ed046e4a5179aee3e1b62a1 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:33.243871 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c38cb-bf42-402c-a463-da29939488ee None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:33.244413 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c38cb-bf42-402c-a463-da29939488ee None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:33.244499 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c38cb-bf42-402c-a463-da29939488ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:33.266971 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-cc6c38cb-bf42-402c-a463-da29939488ee None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:33.268438 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-cc6c38cb-bf42-402c-a463-da29939488ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:33.376283 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1016/2026] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:33.384073 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25818039-7b2c-40f0-89e2-b349355999bd None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:33.384391 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25818039-7b2c-40f0-89e2-b349355999bd None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:33.384674 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25818039-7b2c-40f0-89e2-b349355999bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:33.406424 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-25818039-7b2c-40f0-89e2-b349355999bd None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:33.407649 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-25818039-7b2c-40f0-89e2-b349355999bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:33.418890 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1011/2027] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:33.420449 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c38cb-bf42-402c-a463-da29939488ee None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:33.431047 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c38cb-bf42-402c-a463-da29939488ee None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:33.438329 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeba3cf-d6f1-4bcb-ba9d-9275f1182fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:33.440149 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeba3cf-d6f1-4bcb-ba9d-9275f1182fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:33.440506 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeba3cf-d6f1-4bcb-ba9d-9275f1182fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:33.440923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeba3cf-d6f1-4bcb-ba9d-9275f1182fb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:33.441774 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeba3cf-d6f1-4bcb-ba9d-9275f1182fb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:09:33.442085 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeba3cf-d6f1-4bcb-ba9d-9275f1182fb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:33.443739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeba3cf-d6f1-4bcb-ba9d-9275f1182fb9 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:33.458893 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1017/2028] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:09:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 19:09:33.464491 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25818039-7b2c-40f0-89e2-b349355999bd None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:33.473797 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25818039-7b2c-40f0-89e2-b349355999bd None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:33.478481 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee9e7a-8fe5-4f24-bb07-cf14a606efc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:33.479145 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee9e7a-8fe5-4f24-bb07-cf14a606efc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:33.479422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee9e7a-8fe5-4f24-bb07-cf14a606efc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:33.479694 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee9e7a-8fe5-4f24-bb07-cf14a606efc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:33.480395 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee9e7a-8fe5-4f24-bb07-cf14a606efc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:33.482362 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee9e7a-8fe5-4f24-bb07-cf14a606efc6 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:33.509565 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1012/2029] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:09:33 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:09:33.513496 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeba3cf-d6f1-4bcb-ba9d-9275f1182fb9 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:33.523704 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeba3cf-d6f1-4bcb-ba9d-9275f1182fb9 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:33.585320 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda2d7d-4ffa-4e06-b364-3f0bb62107e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:33.585320 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda2d7d-4ffa-4e06-b364-3f0bb62107e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:33.585320 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda2d7d-4ffa-4e06-b364-3f0bb62107e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:33.585320 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda2d7d-4ffa-4e06-b364-3f0bb62107e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:33.585764 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda2d7d-4ffa-4e06-b364-3f0bb62107e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:33.585764 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda2d7d-4ffa-4e06-b364-3f0bb62107e9 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:33.617983 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1018/2030] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:09:33 2022] POST /identity/v3/users => generated 285 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:09:33.619628 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee9e7a-8fe5-4f24-bb07-cf14a606efc6 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:33.630049 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee9e7a-8fe5-4f24-bb07-cf14a606efc6 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:33.651644 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3adbc9-847c-43f7-9e8c-0569bd3caae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:33.651644 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3adbc9-847c-43f7-9e8c-0569bd3caae0 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:33.651644 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3adbc9-847c-43f7-9e8c-0569bd3caae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:33.651644 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3adbc9-847c-43f7-9e8c-0569bd3caae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:33.652080 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3adbc9-847c-43f7-9e8c-0569bd3caae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:33.652080 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3adbc9-847c-43f7-9e8c-0569bd3caae0 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:33.664065 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1013/2031] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:09:33.668230 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda2d7d-4ffa-4e06-b364-3f0bb62107e9 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:33.684103 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda2d7d-4ffa-4e06-b364-3f0bb62107e9 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:33.699170 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd7627-38be-4378-8fdb-172860fe29ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:33.700466 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd7627-38be-4378-8fdb-172860fe29ae admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:33.701258 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd7627-38be-4378-8fdb-172860fe29ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:33.701258 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd7627-38be-4378-8fdb-172860fe29ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:33.702020 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd7627-38be-4378-8fdb-172860fe29ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:33.703916 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd7627-38be-4378-8fdb-172860fe29ae admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:33.719365 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1019/2032] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:09:33.720343 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3adbc9-847c-43f7-9e8c-0569bd3caae0 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:33.730625 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3adbc9-847c-43f7-9e8c-0569bd3caae0 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:33.736242 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0fbb5-711f-4276-9d7e-430b2a897399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:33.737628 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0fbb5-711f-4276-9d7e-430b2a897399 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:33.738365 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0fbb5-711f-4276-9d7e-430b2a897399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:33.738713 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0fbb5-711f-4276-9d7e-430b2a897399 admin admin] PATH_INFO: `/v3/projects/5da41ec945a74bf7a2e2ea7eaf112b5f/users/53266915261a4b4fa5fce16a34de8bc7/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:33.761594 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0fbb5-711f-4276-9d7e-430b2a897399 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5da41ec945a74bf7a2e2ea7eaf112b5f, user_id=53266915261a4b4fa5fce16a34de8bc7, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:33.764274 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0fbb5-711f-4276-9d7e-430b2a897399 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:33.779187 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1014/2033] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:09:33 2022] PUT /identity/v3/projects/5da41ec945a74bf7a2e2ea7eaf112b5f/users/53266915261a4b4fa5fce16a34de8bc7/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:33.790665 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d7fa8-560d-4267-9f69-85f59e92338e None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:33.790949 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d7fa8-560d-4267-9f69-85f59e92338e None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:33.791227 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d7fa8-560d-4267-9f69-85f59e92338e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:33.819576 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-0f1d7fa8-560d-4267-9f69-85f59e92338e None None] MFA Rules not processed for user `53266915261a4b4fa5fce16a34de8bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:33.820795 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-0f1d7fa8-560d-4267-9f69-85f59e92338e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:33.887662 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1020/2034] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:33 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:33.899227 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0fbb5-711f-4276-9d7e-430b2a897399 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:33.900998 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e2a0fbb5-711f-4276-9d7e-430b2a897399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:33.956973 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0fbb5-711f-4276-9d7e-430b2a897399 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:33.960565 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758f0b2-a15d-45be-bc21-62ca6c701331 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dfa8e8908804c0e8908e2a8c6b377e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:33.961273 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758f0b2-a15d-45be-bc21-62ca6c701331 service glance] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:33.961489 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758f0b2-a15d-45be-bc21-62ca6c701331 service glance] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:33.961812 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758f0b2-a15d-45be-bc21-62ca6c701331 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:33.970458 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758f0b2-a15d-45be-bc21-62ca6c701331 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:33.971889 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758f0b2-a15d-45be-bc21-62ca6c701331 service glance] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:33.980675 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1015/2035] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:09:33 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:09:34.170286 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d7fa8-560d-4267-9f69-85f59e92338e None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:34.171839 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-0f1d7fa8-560d-4267-9f69-85f59e92338e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:34.236467 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d7fa8-560d-4267-9f69-85f59e92338e None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:34.242944 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a5929-dfa4-401b-85a5-927c13668bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:34.243693 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a5929-dfa4-401b-85a5-927c13668bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:34.243970 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a5929-dfa4-401b-85a5-927c13668bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:34.244497 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a5929-dfa4-401b-85a5-927c13668bd1 admin admin] PATH_INFO: `/v3/users/5e710af78da34b0c9b33b4d591c13ddc` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:34.245646 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a5929-dfa4-401b-85a5-927c13668bd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e710af78da34b0c9b33b4d591c13ddc)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:34.248474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a5929-dfa4-401b-85a5-927c13668bd1 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:34.301824 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-1c9a5929-dfa4-401b-85a5-927c13668bd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e710af78da34b0c9b33b4d591c13ddc'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:34.311305 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-1c9a5929-dfa4-401b-85a5-927c13668bd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e710af78da34b0c9b33b4d591c13ddc'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:34.318797 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-1c9a5929-dfa4-401b-85a5-927c13668bd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e710af78da34b0c9b33b4d591c13ddc'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:34.319798 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-1c9a5929-dfa4-401b-85a5-927c13668bd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e710af78da34b0c9b33b4d591c13ddc'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:34.334617 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-1c9a5929-dfa4-401b-85a5-927c13668bd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e710af78da34b0c9b33b4d591c13ddc'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:34.342203 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1021/2036] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:09:34 2022] DELETE /identity/v3/users/5e710af78da34b0c9b33b4d591c13ddc => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:09:34.347000 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6738f-5a5b-4fb0-b7ca-2ccea16614eb None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:34.347506 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6738f-5a5b-4fb0-b7ca-2ccea16614eb None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:34.347607 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6738f-5a5b-4fb0-b7ca-2ccea16614eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:34.365974 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-45a6738f-5a5b-4fb0-b7ca-2ccea16614eb None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:34.367171 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-45a6738f-5a5b-4fb0-b7ca-2ccea16614eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:34.433630 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1016/2037] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:34.443764 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a5929-dfa4-401b-85a5-927c13668bd1 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:34.445624 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-1c9a5929-dfa4-401b-85a5-927c13668bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:34.509456 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a5929-dfa4-401b-85a5-927c13668bd1 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:34.513052 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba1822-6e02-48d2-83bb-8e63c6a6a0bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:34.513846 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba1822-6e02-48d2-83bb-8e63c6a6a0bc service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:34.514083 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba1822-6e02-48d2-83bb-8e63c6a6a0bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:34.514332 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba1822-6e02-48d2-83bb-8e63c6a6a0bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:34.524684 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba1822-6e02-48d2-83bb-8e63c6a6a0bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:34.526370 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba1822-6e02-48d2-83bb-8e63c6a6a0bc service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:34.536653 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1022/2038] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:09:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:09:34.852045 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6738f-5a5b-4fb0-b7ca-2ccea16614eb None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:34.853675 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-45a6738f-5a5b-4fb0-b7ca-2ccea16614eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:34.877809 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6738f-5a5b-4fb0-b7ca-2ccea16614eb None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:34.883106 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc2d0cb-6055-492a-b8f7-5ac906340966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:34.884049 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2d0cb-6055-492a-b8f7-5ac906340966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:34.884394 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2d0cb-6055-492a-b8f7-5ac906340966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:34.884693 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2d0cb-6055-492a-b8f7-5ac906340966 admin admin] PATH_INFO: `/v3/projects/e8107c761f954fd5b694301571927271` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:34.885911 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc2d0cb-6055-492a-b8f7-5ac906340966 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8107c761f954fd5b694301571927271)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:34.887820 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc2d0cb-6055-492a-b8f7-5ac906340966 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:34.934573 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-edc2d0cb-6055-492a-b8f7-5ac906340966 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8107c761f954fd5b694301571927271', 'request_id': 'req-edc2d0cb-6055-492a-b8f7-5ac906340966'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:34.942600 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-edc2d0cb-6055-492a-b8f7-5ac906340966 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8107c761f954fd5b694301571927271', 'request_id': 'req-edc2d0cb-6055-492a-b8f7-5ac906340966'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:34.948716 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-edc2d0cb-6055-492a-b8f7-5ac906340966 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8107c761f954fd5b694301571927271', 'request_id': 'req-edc2d0cb-6055-492a-b8f7-5ac906340966'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:34.959861 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-edc2d0cb-6055-492a-b8f7-5ac906340966 admin admin] The token cache is being invalidate because project e8107c761f954fd5b694301571927271 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:09:34.960149 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-edc2d0cb-6055-492a-b8f7-5ac906340966 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:34.960932 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-edc2d0cb-6055-492a-b8f7-5ac906340966 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:34.962609 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1017/2039] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:09:34 2022] DELETE /identity/v3/projects/e8107c761f954fd5b694301571927271 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:34.967531 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba1822-6e02-48d2-83bb-8e63c6a6a0bc service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:34.979204 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba1822-6e02-48d2-83bb-8e63c6a6a0bc service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:35.040433 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cfff27-9d72-4096-a1c9-a9429528cf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:35.041713 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cfff27-9d72-4096-a1c9-a9429528cf88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:35.042180 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cfff27-9d72-4096-a1c9-a9429528cf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:35.042613 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cfff27-9d72-4096-a1c9-a9429528cf88 admin admin] PATH_INFO: `/v3/users/996f127d8f9a47f3a1b7c1d859678684` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:35.044174 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cfff27-9d72-4096-a1c9-a9429528cf88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=996f127d8f9a47f3a1b7c1d859678684)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:35.046615 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cfff27-9d72-4096-a1c9-a9429528cf88 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:35.099585 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-40cfff27-9d72-4096-a1c9-a9429528cf88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '996f127d8f9a47f3a1b7c1d859678684'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:35.106979 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-40cfff27-9d72-4096-a1c9-a9429528cf88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '996f127d8f9a47f3a1b7c1d859678684'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:35.115318 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-40cfff27-9d72-4096-a1c9-a9429528cf88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '996f127d8f9a47f3a1b7c1d859678684'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:35.116314 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-40cfff27-9d72-4096-a1c9-a9429528cf88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '996f127d8f9a47f3a1b7c1d859678684'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:35.130107 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-40cfff27-9d72-4096-a1c9-a9429528cf88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '996f127d8f9a47f3a1b7c1d859678684'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:35.135955 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1023/2040] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:09:34 2022] DELETE /identity/v3/users/996f127d8f9a47f3a1b7c1d859678684 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:35.629278 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc2d0cb-6055-492a-b8f7-5ac906340966 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:35.630902 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-edc2d0cb-6055-492a-b8f7-5ac906340966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:35.644851 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc2d0cb-6055-492a-b8f7-5ac906340966 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:35.704850 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a578fb-18a6-4eea-84e5-1df75fe6f14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:35.705753 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a578fb-18a6-4eea-84e5-1df75fe6f14e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:35.706031 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a578fb-18a6-4eea-84e5-1df75fe6f14e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:35.706300 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a578fb-18a6-4eea-84e5-1df75fe6f14e admin admin] PATH_INFO: `/v3/projects/a473a28ae8f74ed1a3037bb7e310266f` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:35.707501 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a578fb-18a6-4eea-84e5-1df75fe6f14e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a473a28ae8f74ed1a3037bb7e310266f)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:35.709400 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a578fb-18a6-4eea-84e5-1df75fe6f14e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:35.757080 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d7a578fb-18a6-4eea-84e5-1df75fe6f14e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a473a28ae8f74ed1a3037bb7e310266f', 'request_id': 'req-d7a578fb-18a6-4eea-84e5-1df75fe6f14e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:35.765294 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d7a578fb-18a6-4eea-84e5-1df75fe6f14e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a473a28ae8f74ed1a3037bb7e310266f', 'request_id': 'req-d7a578fb-18a6-4eea-84e5-1df75fe6f14e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:35.770632 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d7a578fb-18a6-4eea-84e5-1df75fe6f14e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a473a28ae8f74ed1a3037bb7e310266f', 'request_id': 'req-d7a578fb-18a6-4eea-84e5-1df75fe6f14e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:35.782229 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d7a578fb-18a6-4eea-84e5-1df75fe6f14e admin admin] The token cache is being invalidate because project a473a28ae8f74ed1a3037bb7e310266f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:09:35.782543 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d7a578fb-18a6-4eea-84e5-1df75fe6f14e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:35.783338 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d7a578fb-18a6-4eea-84e5-1df75fe6f14e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:35.785073 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1018/2041] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:09:35 2022] DELETE /identity/v3/projects/a473a28ae8f74ed1a3037bb7e310266f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:35.790034 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7ae70-7cef-418a-a1a9-425e8eab73fe None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:35.790562 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7ae70-7cef-418a-a1a9-425e8eab73fe None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:35.790667 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7ae70-7cef-418a-a1a9-425e8eab73fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:35.810114 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-41d7ae70-7cef-418a-a1a9-425e8eab73fe None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:35.811318 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-41d7ae70-7cef-418a-a1a9-425e8eab73fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:35.870584 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1024/2042] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:09:35.878210 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe2714-e843-4884-b8b0-6362279aebcc None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:35.878566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe2714-e843-4884-b8b0-6362279aebcc None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:35.878848 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe2714-e843-4884-b8b0-6362279aebcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:35.896746 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-bebe2714-e843-4884-b8b0-6362279aebcc None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:35.897974 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-bebe2714-e843-4884-b8b0-6362279aebcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:35.906306 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1019/2043] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:35.910802 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7ae70-7cef-418a-a1a9-425e8eab73fe None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:35.923234 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7ae70-7cef-418a-a1a9-425e8eab73fe None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:35.928089 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b365b62-409e-4e08-bf2b-1a391af14e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:35.928759 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b365b62-409e-4e08-bf2b-1a391af14e55 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:35.929096 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b365b62-409e-4e08-bf2b-1a391af14e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:35.929330 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b365b62-409e-4e08-bf2b-1a391af14e55 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:35.930126 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b365b62-409e-4e08-bf2b-1a391af14e55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:09:35.930430 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b365b62-409e-4e08-bf2b-1a391af14e55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:35.932040 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b365b62-409e-4e08-bf2b-1a391af14e55 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:35.943914 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1025/2044] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:09:35.948313 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe2714-e843-4884-b8b0-6362279aebcc None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:35.957984 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe2714-e843-4884-b8b0-6362279aebcc None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:35.962906 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be969e6-c9dc-450a-8dd2-8566d9073e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:35.963565 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be969e6-c9dc-450a-8dd2-8566d9073e2b admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:35.963848 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be969e6-c9dc-450a-8dd2-8566d9073e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:35.964120 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be969e6-c9dc-450a-8dd2-8566d9073e2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:35.964853 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be969e6-c9dc-450a-8dd2-8566d9073e2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:35.966824 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be969e6-c9dc-450a-8dd2-8566d9073e2b admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:35.996414 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1020/2045] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:09:35 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:09:35.997573 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b365b62-409e-4e08-bf2b-1a391af14e55 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:36.008743 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b365b62-409e-4e08-bf2b-1a391af14e55 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:36.070217 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa06cec-55d5-43bc-94a9-640d60bcd784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:36.071319 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa06cec-55d5-43bc-94a9-640d60bcd784 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:36.071615 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa06cec-55d5-43bc-94a9-640d60bcd784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:36.071894 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa06cec-55d5-43bc-94a9-640d60bcd784 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:36.072596 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa06cec-55d5-43bc-94a9-640d60bcd784 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:36.074574 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa06cec-55d5-43bc-94a9-640d60bcd784 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:36.095701 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1026/2046] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:09:35 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:09:36.100009 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be969e6-c9dc-450a-8dd2-8566d9073e2b admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:36.111293 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be969e6-c9dc-450a-8dd2-8566d9073e2b admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:36.116411 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa3b8a-3087-43cd-8031-25fc4b86b4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:36.117081 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa3b8a-3087-43cd-8031-25fc4b86b4c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:36.117366 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa3b8a-3087-43cd-8031-25fc4b86b4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:36.117885 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa3b8a-3087-43cd-8031-25fc4b86b4c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:36.118615 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fa3b8a-3087-43cd-8031-25fc4b86b4c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:36.120218 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fa3b8a-3087-43cd-8031-25fc4b86b4c2 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:36.131727 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1021/2047] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:09:36.135912 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa06cec-55d5-43bc-94a9-640d60bcd784 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:36.146365 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa06cec-55d5-43bc-94a9-640d60bcd784 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:36.151335 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8578377-71de-4b2c-9e48-be5b553c63ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:36.151979 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8578377-71de-4b2c-9e48-be5b553c63ee admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:36.152260 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8578377-71de-4b2c-9e48-be5b553c63ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:36.152533 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8578377-71de-4b2c-9e48-be5b553c63ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:36.153668 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8578377-71de-4b2c-9e48-be5b553c63ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:36.155276 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8578377-71de-4b2c-9e48-be5b553c63ee admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:36.165655 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1027/2048] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:09:36.170015 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa3b8a-3087-43cd-8031-25fc4b86b4c2 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:36.180331 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa3b8a-3087-43cd-8031-25fc4b86b4c2 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:36.185820 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f72d21-56bc-4473-b422-34fbab509b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:36.186722 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f72d21-56bc-4473-b422-34fbab509b8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:36.187091 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f72d21-56bc-4473-b422-34fbab509b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:36.187370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f72d21-56bc-4473-b422-34fbab509b8d admin admin] PATH_INFO: `/v3/projects/302454b20eb344f7a79e8af3b4a15135/users/4c75e96fd29b44aca7b655106f20bc6a/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:36.204007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f72d21-56bc-4473-b422-34fbab509b8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=302454b20eb344f7a79e8af3b4a15135, user_id=4c75e96fd29b44aca7b655106f20bc6a, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:36.206734 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f72d21-56bc-4473-b422-34fbab509b8d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:36.222200 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1022/2049] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:09:36 2022] PUT /identity/v3/projects/302454b20eb344f7a79e8af3b4a15135/users/4c75e96fd29b44aca7b655106f20bc6a/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:36.233806 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7fd45-566f-44c6-ab6c-cef53d84c329 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:36.234104 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7fd45-566f-44c6-ab6c-cef53d84c329 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:36.234378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7fd45-566f-44c6-ab6c-cef53d84c329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:36.260627 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-61d7fd45-566f-44c6-ab6c-cef53d84c329 None None] MFA Rules not processed for user `4c75e96fd29b44aca7b655106f20bc6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:36.261900 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-61d7fd45-566f-44c6-ab6c-cef53d84c329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:36.330795 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1028/2050] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:36.335667 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f72d21-56bc-4473-b422-34fbab509b8d admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:36.398118 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f72d21-56bc-4473-b422-34fbab509b8d admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:36.403663 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03dea00-5079-4f54-9e86-d1664570d9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:36.404352 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03dea00-5079-4f54-9e86-d1664570d9bf admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:36.404719 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03dea00-5079-4f54-9e86-d1664570d9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:36.404999 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03dea00-5079-4f54-9e86-d1664570d9bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:36.405735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03dea00-5079-4f54-9e86-d1664570d9bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:36.407646 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03dea00-5079-4f54-9e86-d1664570d9bf admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:36.444919 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1023/2051] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:09:36 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:09:36.449346 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7fd45-566f-44c6-ab6c-cef53d84c329 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:36.462464 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7fd45-566f-44c6-ab6c-cef53d84c329 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:36.547831 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4976e9-5402-45ce-b860-aa2925e532c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:36.548534 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4976e9-5402-45ce-b860-aa2925e532c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:36.548875 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4976e9-5402-45ce-b860-aa2925e532c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:36.549149 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4976e9-5402-45ce-b860-aa2925e532c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:36.549900 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4976e9-5402-45ce-b860-aa2925e532c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:36.552358 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4976e9-5402-45ce-b860-aa2925e532c4 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:36.584272 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1029/2052] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:09:36 2022] POST /identity/v3/users => generated 299 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:09:36.585734 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03dea00-5079-4f54-9e86-d1664570d9bf admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:36.602058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03dea00-5079-4f54-9e86-d1664570d9bf admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:36.613110 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5b3a5-a6dd-4ebf-b1b2-2b6a15499441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:36.614380 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5b3a5-a6dd-4ebf-b1b2-2b6a15499441 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:36.614664 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5b3a5-a6dd-4ebf-b1b2-2b6a15499441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:36.614936 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5b3a5-a6dd-4ebf-b1b2-2b6a15499441 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:36.615812 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef5b3a5-a6dd-4ebf-b1b2-2b6a15499441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:36.618030 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef5b3a5-a6dd-4ebf-b1b2-2b6a15499441 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:36.637415 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1024/2053] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:09:36.642497 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4976e9-5402-45ce-b860-aa2925e532c4 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:36.657129 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4976e9-5402-45ce-b860-aa2925e532c4 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:36.662975 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a3481-bafd-4fc0-8771-14c5cb26709d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:36.663882 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a3481-bafd-4fc0-8771-14c5cb26709d admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:36.664160 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a3481-bafd-4fc0-8771-14c5cb26709d admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:36.664483 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a3481-bafd-4fc0-8771-14c5cb26709d admin admin] PATH_INFO: `/v3/projects/96a8611afa0c43598f5c4b1c177cc39d/users/8e7952a445d94ddb8ec0e49573a1cf29/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:36.682025 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a3481-bafd-4fc0-8771-14c5cb26709d admin admin] RBAC: Authorizing `identity:create_grant(project_id=96a8611afa0c43598f5c4b1c177cc39d, user_id=8e7952a445d94ddb8ec0e49573a1cf29, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:36.685599 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a3481-bafd-4fc0-8771-14c5cb26709d admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:36.702341 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1030/2054] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:09:36 2022] PUT /identity/v3/projects/96a8611afa0c43598f5c4b1c177cc39d/users/8e7952a445d94ddb8ec0e49573a1cf29/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:36.706606 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5b3a5-a6dd-4ebf-b1b2-2b6a15499441 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:36.719618 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5b3a5-a6dd-4ebf-b1b2-2b6a15499441 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:36.778765 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70be39-2dfb-43ff-b3fa-d4de220354dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:36.779529 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70be39-2dfb-43ff-b3fa-d4de220354dd admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:36.779808 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70be39-2dfb-43ff-b3fa-d4de220354dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:36.780047 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70be39-2dfb-43ff-b3fa-d4de220354dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:36.780839 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70be39-2dfb-43ff-b3fa-d4de220354dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:36.782585 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70be39-2dfb-43ff-b3fa-d4de220354dd admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:36.795569 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1025/2055] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:09:36.800337 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a3481-bafd-4fc0-8771-14c5cb26709d admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:36.814738 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a3481-bafd-4fc0-8771-14c5cb26709d admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:36.822282 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0623ad-5aa4-46d7-9fa4-f12d0c95edac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:36.823165 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0623ad-5aa4-46d7-9fa4-f12d0c95edac admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:36.823468 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0623ad-5aa4-46d7-9fa4-f12d0c95edac admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:36.823742 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0623ad-5aa4-46d7-9fa4-f12d0c95edac admin admin] PATH_INFO: `/v3/projects/96a8611afa0c43598f5c4b1c177cc39d/users/8e7952a445d94ddb8ec0e49573a1cf29/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:36.825914 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0623ad-5aa4-46d7-9fa4-f12d0c95edac admin admin] RBAC: Authorizing `identity:create_grant(project_id=96a8611afa0c43598f5c4b1c177cc39d, user_id=8e7952a445d94ddb8ec0e49573a1cf29, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:36.828587 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0623ad-5aa4-46d7-9fa4-f12d0c95edac admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:36.839978 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1031/2056] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:09:36 2022] PUT /identity/v3/projects/96a8611afa0c43598f5c4b1c177cc39d/users/8e7952a445d94ddb8ec0e49573a1cf29/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:36.850666 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b383fd8-ad81-4305-8712-90c25bf3424d None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:36.850991 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b383fd8-ad81-4305-8712-90c25bf3424d None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:36.851394 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b383fd8-ad81-4305-8712-90c25bf3424d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:36.879886 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-2b383fd8-ad81-4305-8712-90c25bf3424d None None] MFA Rules not processed for user `8e7952a445d94ddb8ec0e49573a1cf29`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:36.881165 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2b383fd8-ad81-4305-8712-90c25bf3424d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:36.958473 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1026/2057] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:36.972911 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0623ad-5aa4-46d7-9fa4-f12d0c95edac admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:36.975452 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-dc0623ad-5aa4-46d7-9fa4-f12d0c95edac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:37.038152 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0623ad-5aa4-46d7-9fa4-f12d0c95edac admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:37.042034 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610034f-2a24-4890-802c-60212bf85b11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:37.042727 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610034f-2a24-4890-802c-60212bf85b11 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:37.043087 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610034f-2a24-4890-802c-60212bf85b11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:37.043364 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610034f-2a24-4890-802c-60212bf85b11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:37.054726 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b610034f-2a24-4890-802c-60212bf85b11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:37.056230 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b610034f-2a24-4890-802c-60212bf85b11 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:37.067433 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1032/2058] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:09:36 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:09:37.094619 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b383fd8-ad81-4305-8712-90c25bf3424d None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:37.164975 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b383fd8-ad81-4305-8712-90c25bf3424d None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:37.170236 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309efe0f-6e62-4b62-80ed-cb16fc78cff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:37.171383 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309efe0f-6e62-4b62-80ed-cb16fc78cff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:37.171622 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309efe0f-6e62-4b62-80ed-cb16fc78cff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:37.171891 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309efe0f-6e62-4b62-80ed-cb16fc78cff2 admin admin] PATH_INFO: `/v3/users/4c75e96fd29b44aca7b655106f20bc6a` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:37.173137 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309efe0f-6e62-4b62-80ed-cb16fc78cff2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c75e96fd29b44aca7b655106f20bc6a)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:37.175137 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309efe0f-6e62-4b62-80ed-cb16fc78cff2 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:37.237366 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-309efe0f-6e62-4b62-80ed-cb16fc78cff2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c75e96fd29b44aca7b655106f20bc6a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:37.247040 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-309efe0f-6e62-4b62-80ed-cb16fc78cff2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c75e96fd29b44aca7b655106f20bc6a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:37.255322 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-309efe0f-6e62-4b62-80ed-cb16fc78cff2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c75e96fd29b44aca7b655106f20bc6a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:37.271951 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-309efe0f-6e62-4b62-80ed-cb16fc78cff2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c75e96fd29b44aca7b655106f20bc6a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:37.272944 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-309efe0f-6e62-4b62-80ed-cb16fc78cff2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c75e96fd29b44aca7b655106f20bc6a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:37.279675 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1027/2059] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:09:37 2022] DELETE /identity/v3/users/4c75e96fd29b44aca7b655106f20bc6a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:37.284351 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf9919-7de3-4a12-80c7-6a879d33c3d8 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:37.284636 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf9919-7de3-4a12-80c7-6a879d33c3d8 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:37.285030 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf9919-7de3-4a12-80c7-6a879d33c3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:37.302191 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-59cf9919-7de3-4a12-80c7-6a879d33c3d8 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:37.303414 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-59cf9919-7de3-4a12-80c7-6a879d33c3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:37.373581 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1033/2060] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:37.383492 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309efe0f-6e62-4b62-80ed-cb16fc78cff2 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:37.384992 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-309efe0f-6e62-4b62-80ed-cb16fc78cff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:37.443676 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309efe0f-6e62-4b62-80ed-cb16fc78cff2 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:37.447836 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982af38-e55f-4bd8-b4c0-b1b5e7a687f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:37.448489 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982af38-e55f-4bd8-b4c0-b1b5e7a687f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:37.448772 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982af38-e55f-4bd8-b4c0-b1b5e7a687f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:37.449047 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982af38-e55f-4bd8-b4c0-b1b5e7a687f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:37.459789 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982af38-e55f-4bd8-b4c0-b1b5e7a687f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:37.462130 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982af38-e55f-4bd8-b4c0-b1b5e7a687f2 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:37.473010 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1028/2061] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:09:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:09:37.840715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf9919-7de3-4a12-80c7-6a879d33c3d8 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:37.843031 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-59cf9919-7de3-4a12-80c7-6a879d33c3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:37.857322 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf9919-7de3-4a12-80c7-6a879d33c3d8 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:37.862858 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e3b97-5d25-4131-9875-b2fc0219f99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:37.863888 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e3b97-5d25-4131-9875-b2fc0219f99e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:37.863888 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e3b97-5d25-4131-9875-b2fc0219f99e admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:37.864077 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e3b97-5d25-4131-9875-b2fc0219f99e admin admin] PATH_INFO: `/v3/projects/302454b20eb344f7a79e8af3b4a15135` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:37.865205 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37e3b97-5d25-4131-9875-b2fc0219f99e admin admin] RBAC: Authorizing `identity:delete_project(project_id=302454b20eb344f7a79e8af3b4a15135)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:37.867194 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37e3b97-5d25-4131-9875-b2fc0219f99e admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:37.915221 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a37e3b97-5d25-4131-9875-b2fc0219f99e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '302454b20eb344f7a79e8af3b4a15135', 'request_id': 'req-a37e3b97-5d25-4131-9875-b2fc0219f99e'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:37.920996 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a37e3b97-5d25-4131-9875-b2fc0219f99e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '302454b20eb344f7a79e8af3b4a15135', 'request_id': 'req-a37e3b97-5d25-4131-9875-b2fc0219f99e'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:37.931666 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a37e3b97-5d25-4131-9875-b2fc0219f99e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '302454b20eb344f7a79e8af3b4a15135', 'request_id': 'req-a37e3b97-5d25-4131-9875-b2fc0219f99e'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:37.953306 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a37e3b97-5d25-4131-9875-b2fc0219f99e admin admin] The token cache is being invalidate because project 302454b20eb344f7a79e8af3b4a15135 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:09:37.953306 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a37e3b97-5d25-4131-9875-b2fc0219f99e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:37.953306 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a37e3b97-5d25-4131-9875-b2fc0219f99e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:37.953306 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1034/2062] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:09:37 2022] DELETE /identity/v3/projects/302454b20eb344f7a79e8af3b4a15135 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:37.953950 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982af38-e55f-4bd8-b4c0-b1b5e7a687f2 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:37.961934 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982af38-e55f-4bd8-b4c0-b1b5e7a687f2 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:38.016775 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d4ab2-e8d0-4af3-96c8-0af33c22374c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:38.017698 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d4ab2-e8d0-4af3-96c8-0af33c22374c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:38.017982 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d4ab2-e8d0-4af3-96c8-0af33c22374c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:38.018255 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d4ab2-e8d0-4af3-96c8-0af33c22374c admin admin] PATH_INFO: `/v3/users/8e7952a445d94ddb8ec0e49573a1cf29` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:38.019534 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d4ab2-e8d0-4af3-96c8-0af33c22374c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e7952a445d94ddb8ec0e49573a1cf29)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:38.021507 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d4ab2-e8d0-4af3-96c8-0af33c22374c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:38.068089 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fc0d4ab2-e8d0-4af3-96c8-0af33c22374c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e7952a445d94ddb8ec0e49573a1cf29'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:38.074825 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fc0d4ab2-e8d0-4af3-96c8-0af33c22374c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e7952a445d94ddb8ec0e49573a1cf29'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:38.084333 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fc0d4ab2-e8d0-4af3-96c8-0af33c22374c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e7952a445d94ddb8ec0e49573a1cf29'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:38.099461 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fc0d4ab2-e8d0-4af3-96c8-0af33c22374c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e7952a445d94ddb8ec0e49573a1cf29'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:38.100244 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fc0d4ab2-e8d0-4af3-96c8-0af33c22374c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e7952a445d94ddb8ec0e49573a1cf29'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:38.106622 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1029/2063] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:09:37 2022] DELETE /identity/v3/users/8e7952a445d94ddb8ec0e49573a1cf29 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:38.489931 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e3b97-5d25-4131-9875-b2fc0219f99e admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:38.491454 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a37e3b97-5d25-4131-9875-b2fc0219f99e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:38.511432 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e3b97-5d25-4131-9875-b2fc0219f99e admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:38.586908 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ebcae-a178-4b21-b622-4adb0ca9a72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:38.587810 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ebcae-a178-4b21-b622-4adb0ca9a72c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:38.588102 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ebcae-a178-4b21-b622-4adb0ca9a72c admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:38.588359 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ebcae-a178-4b21-b622-4adb0ca9a72c admin admin] PATH_INFO: `/v3/projects/96a8611afa0c43598f5c4b1c177cc39d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:38.589582 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ebcae-a178-4b21-b622-4adb0ca9a72c admin admin] RBAC: Authorizing `identity:delete_project(project_id=96a8611afa0c43598f5c4b1c177cc39d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:38.591640 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ebcae-a178-4b21-b622-4adb0ca9a72c admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:38.641462 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-183ebcae-a178-4b21-b622-4adb0ca9a72c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96a8611afa0c43598f5c4b1c177cc39d', 'request_id': 'req-183ebcae-a178-4b21-b622-4adb0ca9a72c'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:38.648855 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-183ebcae-a178-4b21-b622-4adb0ca9a72c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96a8611afa0c43598f5c4b1c177cc39d', 'request_id': 'req-183ebcae-a178-4b21-b622-4adb0ca9a72c'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:38.656062 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-183ebcae-a178-4b21-b622-4adb0ca9a72c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96a8611afa0c43598f5c4b1c177cc39d', 'request_id': 'req-183ebcae-a178-4b21-b622-4adb0ca9a72c'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:38.670843 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-183ebcae-a178-4b21-b622-4adb0ca9a72c admin admin] The token cache is being invalidate because project 96a8611afa0c43598f5c4b1c177cc39d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:09:38.671135 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-183ebcae-a178-4b21-b622-4adb0ca9a72c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:38.672134 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-183ebcae-a178-4b21-b622-4adb0ca9a72c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:38.673796 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1035/2064] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:09:38 2022] DELETE /identity/v3/projects/96a8611afa0c43598f5c4b1c177cc39d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:38.678683 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00adef8-eac5-4be7-8bb4-b16085ba56b1 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:38.679041 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00adef8-eac5-4be7-8bb4-b16085ba56b1 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:38.679312 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00adef8-eac5-4be7-8bb4-b16085ba56b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:38.698211 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-b00adef8-eac5-4be7-8bb4-b16085ba56b1 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:38.699395 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b00adef8-eac5-4be7-8bb4-b16085ba56b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:38.769629 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1030/2065] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:38.777287 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64528a8b-8081-4cd2-b577-7630dc507747 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:38.778218 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64528a8b-8081-4cd2-b577-7630dc507747 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:38.778515 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64528a8b-8081-4cd2-b577-7630dc507747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:38.798257 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-64528a8b-8081-4cd2-b577-7630dc507747 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:38.799445 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-64528a8b-8081-4cd2-b577-7630dc507747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:38.811394 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1036/2066] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:38.815956 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00adef8-eac5-4be7-8bb4-b16085ba56b1 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:38.826990 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00adef8-eac5-4be7-8bb4-b16085ba56b1 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:38.831950 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a233e-7ba9-49c9-bdc8-472aee2d9373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:38.832617 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a233e-7ba9-49c9-bdc8-472aee2d9373 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:38.832895 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a233e-7ba9-49c9-bdc8-472aee2d9373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:38.833166 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a233e-7ba9-49c9-bdc8-472aee2d9373 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:38.833938 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a233e-7ba9-49c9-bdc8-472aee2d9373 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:09:38.834254 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a233e-7ba9-49c9-bdc8-472aee2d9373 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:38.835920 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a233e-7ba9-49c9-bdc8-472aee2d9373 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:38.847993 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1031/2067] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:09:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:09:38.852497 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64528a8b-8081-4cd2-b577-7630dc507747 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:38.861739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64528a8b-8081-4cd2-b577-7630dc507747 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:38.866259 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b76e3d-f9a7-463e-8e96-f3c32b5b7c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:38.866915 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b76e3d-f9a7-463e-8e96-f3c32b5b7c66 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:38.867194 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b76e3d-f9a7-463e-8e96-f3c32b5b7c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:38.867461 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b76e3d-f9a7-463e-8e96-f3c32b5b7c66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:38.868152 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b76e3d-f9a7-463e-8e96-f3c32b5b7c66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:38.870108 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b76e3d-f9a7-463e-8e96-f3c32b5b7c66 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:38.897554 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1037/2068] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:09:38 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:09:38.901994 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a233e-7ba9-49c9-bdc8-472aee2d9373 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:38.912335 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a233e-7ba9-49c9-bdc8-472aee2d9373 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:38.974718 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583b72c-9eef-4639-b77b-bb549b1fd985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:38.975398 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583b72c-9eef-4639-b77b-bb549b1fd985 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:38.975682 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583b72c-9eef-4639-b77b-bb549b1fd985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:38.975974 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583b72c-9eef-4639-b77b-bb549b1fd985 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:38.976653 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2583b72c-9eef-4639-b77b-bb549b1fd985 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:38.978947 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2583b72c-9eef-4639-b77b-bb549b1fd985 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:39.009836 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1032/2069] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:09:38 2022] POST /identity/v3/users => generated 294 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:09:39.011214 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b76e3d-f9a7-463e-8e96-f3c32b5b7c66 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:39.022214 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b76e3d-f9a7-463e-8e96-f3c32b5b7c66 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:39.033312 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309c160-f224-412a-9484-2a5530ae061b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:39.034155 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309c160-f224-412a-9484-2a5530ae061b admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:39.034498 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309c160-f224-412a-9484-2a5530ae061b admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:39.034837 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309c160-f224-412a-9484-2a5530ae061b admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:39.035646 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309c160-f224-412a-9484-2a5530ae061b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:39.037356 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309c160-f224-412a-9484-2a5530ae061b admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:39.049284 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1038/2070] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:09:39.053951 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583b72c-9eef-4639-b77b-bb549b1fd985 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:39.066820 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583b72c-9eef-4639-b77b-bb549b1fd985 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:39.082302 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a191802-beb7-426f-8a77-f89678cc3d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:39.083009 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a191802-beb7-426f-8a77-f89678cc3d49 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:39.083381 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a191802-beb7-426f-8a77-f89678cc3d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:39.083671 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a191802-beb7-426f-8a77-f89678cc3d49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:39.084451 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a191802-beb7-426f-8a77-f89678cc3d49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:39.086215 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a191802-beb7-426f-8a77-f89678cc3d49 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:39.101636 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1033/2071] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:09:39.109370 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309c160-f224-412a-9484-2a5530ae061b admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:39.119531 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309c160-f224-412a-9484-2a5530ae061b admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:39.124146 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa8649-b2b6-4b24-860c-add24d652f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:39.125114 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa8649-b2b6-4b24-860c-add24d652f43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:39.125391 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa8649-b2b6-4b24-860c-add24d652f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:39.125772 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa8649-b2b6-4b24-860c-add24d652f43 admin admin] PATH_INFO: `/v3/projects/b00216fb215644e39a4c8f76a3217d2b/users/769b0e5626b74406966fd6979d5229e9/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:39.140970 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfa8649-b2b6-4b24-860c-add24d652f43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b00216fb215644e39a4c8f76a3217d2b, user_id=769b0e5626b74406966fd6979d5229e9, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:39.143685 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfa8649-b2b6-4b24-860c-add24d652f43 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:39.158872 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1039/2072] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:09:39 2022] PUT /identity/v3/projects/b00216fb215644e39a4c8f76a3217d2b/users/769b0e5626b74406966fd6979d5229e9/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:39.173245 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696fbc3-9eb6-4e60-8e72-fe915da2850f None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:39.173716 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696fbc3-9eb6-4e60-8e72-fe915da2850f None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:39.173991 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696fbc3-9eb6-4e60-8e72-fe915da2850f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:39.203390 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-4696fbc3-9eb6-4e60-8e72-fe915da2850f None None] MFA Rules not processed for user `769b0e5626b74406966fd6979d5229e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:39.204621 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4696fbc3-9eb6-4e60-8e72-fe915da2850f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:39.275655 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1034/2073] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:39.280553 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa8649-b2b6-4b24-860c-add24d652f43 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:39.341897 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa8649-b2b6-4b24-860c-add24d652f43 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:39.351880 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2077b-5694-42f2-bbd9-efe6585534dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:39.352564 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2077b-5694-42f2-bbd9-efe6585534dc admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:39.352844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2077b-5694-42f2-bbd9-efe6585534dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:39.353115 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2077b-5694-42f2-bbd9-efe6585534dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:39.353957 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b2077b-5694-42f2-bbd9-efe6585534dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:39.356021 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b2077b-5694-42f2-bbd9-efe6585534dc admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:39.390746 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1040/2074] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:09:39 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:09:39.394957 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696fbc3-9eb6-4e60-8e72-fe915da2850f None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:39.406327 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696fbc3-9eb6-4e60-8e72-fe915da2850f None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:39.464804 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb2690-2408-4d3d-ba36-a495de0296ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:39.465512 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb2690-2408-4d3d-ba36-a495de0296ce admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:39.465835 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb2690-2408-4d3d-ba36-a495de0296ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:39.466107 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb2690-2408-4d3d-ba36-a495de0296ce admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:39.466834 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb2690-2408-4d3d-ba36-a495de0296ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:39.469002 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb2690-2408-4d3d-ba36-a495de0296ce admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:39.492516 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1035/2075] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:09:39 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:09:39.498251 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2077b-5694-42f2-bbd9-efe6585534dc admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:39.508545 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2077b-5694-42f2-bbd9-efe6585534dc admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:39.513474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67421754-5707-4bd6-8c49-f655ddb2de5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:39.514163 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67421754-5707-4bd6-8c49-f655ddb2de5b admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:39.514442 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67421754-5707-4bd6-8c49-f655ddb2de5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:39.514729 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67421754-5707-4bd6-8c49-f655ddb2de5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:39.515550 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67421754-5707-4bd6-8c49-f655ddb2de5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:39.517160 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67421754-5707-4bd6-8c49-f655ddb2de5b admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:39.528042 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1041/2076] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:09:39.532317 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb2690-2408-4d3d-ba36-a495de0296ce admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:39.542753 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb2690-2408-4d3d-ba36-a495de0296ce admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:39.548501 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad41ad-c456-4503-898a-afb4719c7787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:39.549275 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad41ad-c456-4503-898a-afb4719c7787 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:39.549572 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad41ad-c456-4503-898a-afb4719c7787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:39.549844 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad41ad-c456-4503-898a-afb4719c7787 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:39.550575 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad41ad-c456-4503-898a-afb4719c7787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:39.552278 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad41ad-c456-4503-898a-afb4719c7787 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:39.562685 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1036/2077] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:09:39.567250 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67421754-5707-4bd6-8c49-f655ddb2de5b admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:39.579601 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67421754-5707-4bd6-8c49-f655ddb2de5b admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:39.584750 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0ea73-3a7c-45a4-a1a2-20aa8c6b889e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:39.585785 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0ea73-3a7c-45a4-a1a2-20aa8c6b889e admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:39.586129 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0ea73-3a7c-45a4-a1a2-20aa8c6b889e admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:39.586468 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0ea73-3a7c-45a4-a1a2-20aa8c6b889e admin admin] PATH_INFO: `/v3/projects/bcd1b248d4014df59f3217f24accadc5/users/b98ee2c585a54f13bd5351f2237f37d2/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:39.601555 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c0ea73-3a7c-45a4-a1a2-20aa8c6b889e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcd1b248d4014df59f3217f24accadc5, user_id=b98ee2c585a54f13bd5351f2237f37d2, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:39.604165 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c0ea73-3a7c-45a4-a1a2-20aa8c6b889e admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:39.618375 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1042/2078] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:09:39 2022] PUT /identity/v3/projects/bcd1b248d4014df59f3217f24accadc5/users/b98ee2c585a54f13bd5351f2237f37d2/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:39.628552 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e46145-3f04-4ef5-b0b3-8b859bdb2826 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:39.628844 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e46145-3f04-4ef5-b0b3-8b859bdb2826 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:39.629137 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e46145-3f04-4ef5-b0b3-8b859bdb2826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:39.657054 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-17e46145-3f04-4ef5-b0b3-8b859bdb2826 None None] MFA Rules not processed for user `b98ee2c585a54f13bd5351f2237f37d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:39.658392 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-17e46145-3f04-4ef5-b0b3-8b859bdb2826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:39.725243 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1037/2079] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:39.730701 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0ea73-3a7c-45a4-a1a2-20aa8c6b889e admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:39.804470 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0ea73-3a7c-45a4-a1a2-20aa8c6b889e admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:39.810372 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96711113-2517-4093-a56a-7ca5a4257c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:39.811042 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96711113-2517-4093-a56a-7ca5a4257c2e admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:39.811318 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96711113-2517-4093-a56a-7ca5a4257c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:39.811579 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96711113-2517-4093-a56a-7ca5a4257c2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:39.812383 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96711113-2517-4093-a56a-7ca5a4257c2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:39.814371 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96711113-2517-4093-a56a-7ca5a4257c2e admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:39.843702 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1043/2080] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:09:39 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:09:39.849314 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e46145-3f04-4ef5-b0b3-8b859bdb2826 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:39.861021 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e46145-3f04-4ef5-b0b3-8b859bdb2826 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:39.923761 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c18d6f2-d106-49c4-99a6-5c23c6b0be9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:39.924732 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18d6f2-d106-49c4-99a6-5c23c6b0be9c admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:39.925110 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18d6f2-d106-49c4-99a6-5c23c6b0be9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:39.925456 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18d6f2-d106-49c4-99a6-5c23c6b0be9c admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:39.926625 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c18d6f2-d106-49c4-99a6-5c23c6b0be9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:39.929702 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c18d6f2-d106-49c4-99a6-5c23c6b0be9c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:39.955039 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1038/2081] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:09:39 2022] POST /identity/v3/users => generated 298 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:09:39.959360 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96711113-2517-4093-a56a-7ca5a4257c2e admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:39.970014 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96711113-2517-4093-a56a-7ca5a4257c2e admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:39.974931 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064b1b9-9221-49ec-ac25-9b614d334203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:39.975591 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064b1b9-9221-49ec-ac25-9b614d334203 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:39.975869 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064b1b9-9221-49ec-ac25-9b614d334203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:39.976141 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064b1b9-9221-49ec-ac25-9b614d334203 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:39.976868 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6064b1b9-9221-49ec-ac25-9b614d334203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:39.978515 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6064b1b9-9221-49ec-ac25-9b614d334203 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:39.989002 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1044/2082] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 19:09:39.993105 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c18d6f2-d106-49c4-99a6-5c23c6b0be9c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:40.003325 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c18d6f2-d106-49c4-99a6-5c23c6b0be9c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:40.008989 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad145b9-8a52-4a42-a6e9-1093dde3d2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:40.010109 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad145b9-8a52-4a42-a6e9-1093dde3d2e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:40.010401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad145b9-8a52-4a42-a6e9-1093dde3d2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:40.010716 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad145b9-8a52-4a42-a6e9-1093dde3d2e4 admin admin] PATH_INFO: `/v3/projects/9c48c0374c6b417382131351bf7c8e73/users/a35a4732594c4ea0b020cb19c2b351e3/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:40.027147 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad145b9-8a52-4a42-a6e9-1093dde3d2e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c48c0374c6b417382131351bf7c8e73, user_id=a35a4732594c4ea0b020cb19c2b351e3, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:40.030308 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad145b9-8a52-4a42-a6e9-1093dde3d2e4 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:40.046861 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1039/2083] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:09:39 2022] PUT /identity/v3/projects/9c48c0374c6b417382131351bf7c8e73/users/a35a4732594c4ea0b020cb19c2b351e3/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:40.051364 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064b1b9-9221-49ec-ac25-9b614d334203 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:40.061509 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064b1b9-9221-49ec-ac25-9b614d334203 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:40.136479 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0d4ce-ca91-4e9e-805e-be4d313e722c None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:40.136479 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0d4ce-ca91-4e9e-805e-be4d313e722c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:40.136685 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0d4ce-ca91-4e9e-805e-be4d313e722c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:40.140012 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622bb25-07c7-439c-9673-f048e85db404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:40.140809 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622bb25-07c7-439c-9673-f048e85db404 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:40.141774 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622bb25-07c7-439c-9673-f048e85db404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:40.141774 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622bb25-07c7-439c-9673-f048e85db404 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:40.142572 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b622bb25-07c7-439c-9673-f048e85db404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:40.144498 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b622bb25-07c7-439c-9673-f048e85db404 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:40.155185 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-f2a0d4ce-ca91-4e9e-805e-be4d313e722c None None] MFA Rules not processed for user `c8ac79259d304d589aa1e529849bfcbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:40.156772 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f2a0d4ce-ca91-4e9e-805e-be4d313e722c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:40.156914 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1045/2084] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:09:40.161251 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622bb25-07c7-439c-9673-f048e85db404 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:40.175938 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622bb25-07c7-439c-9673-f048e85db404 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:40.180648 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a5018-3b29-4c02-af3f-ccca0101ad79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:40.181585 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a5018-3b29-4c02-af3f-ccca0101ad79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:40.181866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a5018-3b29-4c02-af3f-ccca0101ad79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:40.185782 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a5018-3b29-4c02-af3f-ccca0101ad79 admin admin] PATH_INFO: `/v3/projects/9c48c0374c6b417382131351bf7c8e73/users/a35a4732594c4ea0b020cb19c2b351e3/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:40.188616 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a5018-3b29-4c02-af3f-ccca0101ad79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c48c0374c6b417382131351bf7c8e73, user_id=a35a4732594c4ea0b020cb19c2b351e3, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:40.191451 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a5018-3b29-4c02-af3f-ccca0101ad79 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:40.203217 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1046/2085] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:09:40 2022] PUT /identity/v3/projects/9c48c0374c6b417382131351bf7c8e73/users/a35a4732594c4ea0b020cb19c2b351e3/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:40.214466 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e749d-f9a9-4bc4-a7f4-1a6c8c69185f None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:40.214757 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e749d-f9a9-4bc4-a7f4-1a6c8c69185f None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:40.215034 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e749d-f9a9-4bc4-a7f4-1a6c8c69185f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:40.215199 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1040/2086] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:40.241110 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-974e749d-f9a9-4bc4-a7f4-1a6c8c69185f None None] MFA Rules not processed for user `a35a4732594c4ea0b020cb19c2b351e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:40.242587 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-974e749d-f9a9-4bc4-a7f4-1a6c8c69185f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:40.312510 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1047/2087] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:09:40.323764 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0d4ce-ca91-4e9e-805e-be4d313e722c None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:40.325166 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f2a0d4ce-ca91-4e9e-805e-be4d313e722c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:40.380320 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0d4ce-ca91-4e9e-805e-be4d313e722c None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:40.431797 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8735d43-156d-42e3-984c-409238ccdcd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:40.432475 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8735d43-156d-42e3-984c-409238ccdcd9 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:40.432755 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8735d43-156d-42e3-984c-409238ccdcd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:40.433058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8735d43-156d-42e3-984c-409238ccdcd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:40.443724 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8735d43-156d-42e3-984c-409238ccdcd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:40.445208 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8735d43-156d-42e3-984c-409238ccdcd9 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:40.454999 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1041/2088] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:09:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:09:41.035850 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e749d-f9a9-4bc4-a7f4-1a6c8c69185f None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:41.037411 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-974e749d-f9a9-4bc4-a7f4-1a6c8c69185f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:41.049137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e749d-f9a9-4bc4-a7f4-1a6c8c69185f None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:41.053049 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d113b7c-3a34-4f76-a87d-c594a484621c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:41.053724 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d113b7c-3a34-4f76-a87d-c594a484621c service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:41.054003 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d113b7c-3a34-4f76-a87d-c594a484621c service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:41.054272 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d113b7c-3a34-4f76-a87d-c594a484621c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:41.115749 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d113b7c-3a34-4f76-a87d-c594a484621c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:41.121347 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d113b7c-3a34-4f76-a87d-c594a484621c service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:41.126893 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1048/2089] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:09:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:09:45.218811 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8735d43-156d-42e3-984c-409238ccdcd9 service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:45.227811 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8735d43-156d-42e3-984c-409238ccdcd9 service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:45.232493 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee779b7-c216-4f3e-a6c7-435dbe8fa582 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:45.233162 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee779b7-c216-4f3e-a6c7-435dbe8fa582 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:45.233459 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee779b7-c216-4f3e-a6c7-435dbe8fa582 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:45.233739 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee779b7-c216-4f3e-a6c7-435dbe8fa582 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:45.295022 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee779b7-c216-4f3e-a6c7-435dbe8fa582 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:45.296566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee779b7-c216-4f3e-a6c7-435dbe8fa582 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:45.306067 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1042/2090] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:09:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:09:47.301752 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e8881-e372-46ae-8894-8fca74caa75e None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:47.302274 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e8881-e372-46ae-8894-8fca74caa75e None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:47.302386 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e8881-e372-46ae-8894-8fca74caa75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:47.323255 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-8b0e8881-e372-46ae-8894-8fca74caa75e None None] MFA Rules not processed for user `4775e9dd7aea448d95ec7378b4ff3124`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:47.325010 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-8b0e8881-e372-46ae-8894-8fca74caa75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:47.394736 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1049/2091] 10.222.0.24 () {58 vars in 1009 bytes} [Mon May 16 19:09:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:09:47.452366 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee779b7-c216-4f3e-a6c7-435dbe8fa582 service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:47.453875 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4ee779b7-c216-4f3e-a6c7-435dbe8fa582 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:47.529613 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee779b7-c216-4f3e-a6c7-435dbe8fa582 service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:47.534581 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341184f-da11-4705-b78f-b5d81b0efca3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '654e435a35c4491eb87943734ce280f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:47.535224 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341184f-da11-4705-b78f-b5d81b0efca3 service swift] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:47.535502 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341184f-da11-4705-b78f-b5d81b0efca3 service swift] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:47.535770 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341184f-da11-4705-b78f-b5d81b0efca3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:47.543500 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e8881-e372-46ae-8894-8fca74caa75e None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:47.544364 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341184f-da11-4705-b78f-b5d81b0efca3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:47.546007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341184f-da11-4705-b78f-b5d81b0efca3 service swift] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:47.554669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1043/2092] 10.222.0.24 () {60 vars in 1384 bytes} [Mon May 16 19:09:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 19:09:47.610035 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e8881-e372-46ae-8894-8fca74caa75e None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:47.615302 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087719da-f013-4cb9-ace8-34238c7be492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:47.616273 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087719da-f013-4cb9-ace8-34238c7be492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:47.616547 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087719da-f013-4cb9-ace8-34238c7be492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:47.616820 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087719da-f013-4cb9-ace8-34238c7be492 admin admin] PATH_INFO: `/v3/users/769b0e5626b74406966fd6979d5229e9` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:47.618136 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087719da-f013-4cb9-ace8-34238c7be492 admin admin] RBAC: Authorizing `identity:delete_user(user_id=769b0e5626b74406966fd6979d5229e9)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:47.620095 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087719da-f013-4cb9-ace8-34238c7be492 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:47.681246 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-087719da-f013-4cb9-ace8-34238c7be492 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '769b0e5626b74406966fd6979d5229e9'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:47.691025 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-087719da-f013-4cb9-ace8-34238c7be492 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '769b0e5626b74406966fd6979d5229e9'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:47.700381 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-087719da-f013-4cb9-ace8-34238c7be492 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '769b0e5626b74406966fd6979d5229e9'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:47.701221 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-087719da-f013-4cb9-ace8-34238c7be492 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '769b0e5626b74406966fd6979d5229e9'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:47.713394 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-087719da-f013-4cb9-ace8-34238c7be492 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '769b0e5626b74406966fd6979d5229e9'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:47.722461 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1050/2093] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:09:47 2022] DELETE /identity/v3/users/769b0e5626b74406966fd6979d5229e9 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:09:47.726932 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47510e9-b86a-43e2-9527-c4230f66ee68 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:47.727818 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47510e9-b86a-43e2-9527-c4230f66ee68 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:47.728102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47510e9-b86a-43e2-9527-c4230f66ee68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:47.749334 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-d47510e9-b86a-43e2-9527-c4230f66ee68 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:47.750591 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d47510e9-b86a-43e2-9527-c4230f66ee68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:47.820614 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1044/2094] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:09:47.828658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087719da-f013-4cb9-ace8-34238c7be492 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:47.830238 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-087719da-f013-4cb9-ace8-34238c7be492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:47.888058 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087719da-f013-4cb9-ace8-34238c7be492 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:47.892556 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7528a6-d53e-49ea-a9ad-66c6ca64f419 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:47.893619 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7528a6-d53e-49ea-a9ad-66c6ca64f419 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:47.893619 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7528a6-d53e-49ea-a9ad-66c6ca64f419 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:47.893884 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7528a6-d53e-49ea-a9ad-66c6ca64f419 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:47.904023 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7528a6-d53e-49ea-a9ad-66c6ca64f419 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:47.905471 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7528a6-d53e-49ea-a9ad-66c6ca64f419 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:47.915237 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1051/2095] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:09:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:09:48.103594 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa54ef6-1b10-4f67-b65c-b9f3b0ec03b9 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:48.103885 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa54ef6-1b10-4f67-b65c-b9f3b0ec03b9 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:48.104159 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa54ef6-1b10-4f67-b65c-b9f3b0ec03b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:48.122601 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-0fa54ef6-1b10-4f67-b65c-b9f3b0ec03b9 None None] MFA Rules not processed for user `4775e9dd7aea448d95ec7378b4ff3124`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:48.123898 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0fa54ef6-1b10-4f67-b65c-b9f3b0ec03b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:48.180665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1045/2096] 10.222.0.24 () {58 vars in 967 bytes} [Mon May 16 19:09:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:48.194961 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7528a6-d53e-49ea-a9ad-66c6ca64f419 service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:48.196664 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-af7528a6-d53e-49ea-a9ad-66c6ca64f419 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:48.201221 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa54ef6-1b10-4f67-b65c-b9f3b0ec03b9 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:48.202763 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0fa54ef6-1b10-4f67-b65c-b9f3b0ec03b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:48.219663 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa54ef6-1b10-4f67-b65c-b9f3b0ec03b9 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:48.224342 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ad51e-ac63-43f2-b887-40162fbb131d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:48.225225 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ad51e-ac63-43f2-b887-40162fbb131d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:48.225520 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ad51e-ac63-43f2-b887-40162fbb131d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:48.225827 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ad51e-ac63-43f2-b887-40162fbb131d admin admin] PATH_INFO: `/v3/projects/b00216fb215644e39a4c8f76a3217d2b` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:48.227037 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ad51e-ac63-43f2-b887-40162fbb131d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b00216fb215644e39a4c8f76a3217d2b)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:48.228982 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ad51e-ac63-43f2-b887-40162fbb131d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:48.284353 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-692ad51e-ac63-43f2-b887-40162fbb131d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b00216fb215644e39a4c8f76a3217d2b', 'request_id': 'req-692ad51e-ac63-43f2-b887-40162fbb131d'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:48.293342 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-692ad51e-ac63-43f2-b887-40162fbb131d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b00216fb215644e39a4c8f76a3217d2b', 'request_id': 'req-692ad51e-ac63-43f2-b887-40162fbb131d'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:48.297519 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7528a6-d53e-49ea-a9ad-66c6ca64f419 service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:48.298890 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-692ad51e-ac63-43f2-b887-40162fbb131d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b00216fb215644e39a4c8f76a3217d2b', 'request_id': 'req-692ad51e-ac63-43f2-b887-40162fbb131d'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:48.310241 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-692ad51e-ac63-43f2-b887-40162fbb131d admin admin] The token cache is being invalidate because project b00216fb215644e39a4c8f76a3217d2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:09:48.310528 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-692ad51e-ac63-43f2-b887-40162fbb131d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:48.311175 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-692ad51e-ac63-43f2-b887-40162fbb131d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:48.312742 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1046/2097] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:09:48 2022] DELETE /identity/v3/projects/b00216fb215644e39a4c8f76a3217d2b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:48.316663 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ad51e-ac63-43f2-b887-40162fbb131d admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:48.317995 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-692ad51e-ac63-43f2-b887-40162fbb131d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:48.360799 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1fb03-84e7-4b2c-b0b5-0abc9b7c7aa4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '654e435a35c4491eb87943734ce280f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:48.361560 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1fb03-84e7-4b2c-b0b5-0abc9b7c7aa4 service swift] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:48.361937 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1fb03-84e7-4b2c-b0b5-0abc9b7c7aa4 service swift] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:48.362277 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1fb03-84e7-4b2c-b0b5-0abc9b7c7aa4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:48.364185 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-3bc1fb03-84e7-4b2c-b0b5-0abc9b7c7aa4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:48.386354 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ad51e-ac63-43f2-b887-40162fbb131d admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:48.395380 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd493edd-c1bb-4a7c-bde6-46c364c25260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:48.396436 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd493edd-c1bb-4a7c-bde6-46c364c25260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:48.396786 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd493edd-c1bb-4a7c-bde6-46c364c25260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:48.397125 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd493edd-c1bb-4a7c-bde6-46c364c25260 admin admin] PATH_INFO: `/v3/users/b98ee2c585a54f13bd5351f2237f37d2` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:48.398462 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd493edd-c1bb-4a7c-bde6-46c364c25260 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b98ee2c585a54f13bd5351f2237f37d2)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:48.400621 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd493edd-c1bb-4a7c-bde6-46c364c25260 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:48.429928 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1fb03-84e7-4b2c-b0b5-0abc9b7c7aa4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:48.431592 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1fb03-84e7-4b2c-b0b5-0abc9b7c7aa4 service swift] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:48.441186 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1052/2098] 10.222.0.24 () {60 vars in 1384 bytes} [Mon May 16 19:09:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 19:09:48.454872 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-dd493edd-c1bb-4a7c-bde6-46c364c25260 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b98ee2c585a54f13bd5351f2237f37d2'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:48.472064 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-dd493edd-c1bb-4a7c-bde6-46c364c25260 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b98ee2c585a54f13bd5351f2237f37d2'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:48.481821 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-dd493edd-c1bb-4a7c-bde6-46c364c25260 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b98ee2c585a54f13bd5351f2237f37d2'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:48.498432 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-dd493edd-c1bb-4a7c-bde6-46c364c25260 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b98ee2c585a54f13bd5351f2237f37d2'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:48.499169 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-dd493edd-c1bb-4a7c-bde6-46c364c25260 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b98ee2c585a54f13bd5351f2237f37d2'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:48.505627 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1047/2099] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:09:48 2022] DELETE /identity/v3/users/b98ee2c585a54f13bd5351f2237f37d2 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:09:48.756553 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab1ad9-7ff2-4078-a266-842e381fb14b None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:48.756841 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab1ad9-7ff2-4078-a266-842e381fb14b None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:48.757117 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab1ad9-7ff2-4078-a266-842e381fb14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:48.779750 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-acab1ad9-7ff2-4078-a266-842e381fb14b None None] MFA Rules not processed for user `4775e9dd7aea448d95ec7378b4ff3124`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:48.781479 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-acab1ad9-7ff2-4078-a266-842e381fb14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:48.817413 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd493edd-c1bb-4a7c-bde6-46c364c25260 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:48.820624 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-dd493edd-c1bb-4a7c-bde6-46c364c25260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:48.841667 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1053/2100] 10.222.0.24 () {58 vars in 1009 bytes} [Mon May 16 19:09:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:48.863729 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab1ad9-7ff2-4078-a266-842e381fb14b None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:48.874059 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-acab1ad9-7ff2-4078-a266-842e381fb14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:48.893599 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd493edd-c1bb-4a7c-bde6-46c364c25260 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:48.899010 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145b325-f6a5-41ca-94e0-b764f38bea0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:48.900119 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145b325-f6a5-41ca-94e0-b764f38bea0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:48.900603 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145b325-f6a5-41ca-94e0-b764f38bea0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:48.901095 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145b325-f6a5-41ca-94e0-b764f38bea0d admin admin] PATH_INFO: `/v3/projects/bcd1b248d4014df59f3217f24accadc5` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:48.902928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7145b325-f6a5-41ca-94e0-b764f38bea0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcd1b248d4014df59f3217f24accadc5)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:48.905058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7145b325-f6a5-41ca-94e0-b764f38bea0d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:48.958857 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7145b325-f6a5-41ca-94e0-b764f38bea0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcd1b248d4014df59f3217f24accadc5', 'request_id': 'req-7145b325-f6a5-41ca-94e0-b764f38bea0d'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:48.965594 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab1ad9-7ff2-4078-a266-842e381fb14b None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:48.968390 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7145b325-f6a5-41ca-94e0-b764f38bea0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcd1b248d4014df59f3217f24accadc5', 'request_id': 'req-7145b325-f6a5-41ca-94e0-b764f38bea0d'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:48.974661 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7145b325-f6a5-41ca-94e0-b764f38bea0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcd1b248d4014df59f3217f24accadc5', 'request_id': 'req-7145b325-f6a5-41ca-94e0-b764f38bea0d'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:48.986710 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7145b325-f6a5-41ca-94e0-b764f38bea0d admin admin] The token cache is being invalidate because project bcd1b248d4014df59f3217f24accadc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:09:48.987075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7145b325-f6a5-41ca-94e0-b764f38bea0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:48.987797 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7145b325-f6a5-41ca-94e0-b764f38bea0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:48.990347 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1048/2101] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:09:48 2022] DELETE /identity/v3/projects/bcd1b248d4014df59f3217f24accadc5 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:09:48.993978 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145b325-f6a5-41ca-94e0-b764f38bea0d admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:48.995602 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7145b325-f6a5-41ca-94e0-b764f38bea0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:49.033915 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172dbf82-15e7-4ac4-8e4b-9b8077289acf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '654e435a35c4491eb87943734ce280f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:49.034829 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172dbf82-15e7-4ac4-8e4b-9b8077289acf service swift] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:49.035314 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172dbf82-15e7-4ac4-8e4b-9b8077289acf service swift] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:49.035975 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172dbf82-15e7-4ac4-8e4b-9b8077289acf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:49.038172 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-172dbf82-15e7-4ac4-8e4b-9b8077289acf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:49.066760 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145b325-f6a5-41ca-94e0-b764f38bea0d admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:49.071603 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ea009-008e-4796-bd85-363741065f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:49.072493 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ea009-008e-4796-bd85-363741065f20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:49.072764 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ea009-008e-4796-bd85-363741065f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:49.073035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ea009-008e-4796-bd85-363741065f20 admin admin] PATH_INFO: `/v3/users/a35a4732594c4ea0b020cb19c2b351e3` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:49.074293 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ea009-008e-4796-bd85-363741065f20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a35a4732594c4ea0b020cb19c2b351e3)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:49.076245 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ea009-008e-4796-bd85-363741065f20 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:49.096559 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172dbf82-15e7-4ac4-8e4b-9b8077289acf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:49.098269 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172dbf82-15e7-4ac4-8e4b-9b8077289acf service swift] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:49.106620 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1054/2102] 10.222.0.24 () {60 vars in 1384 bytes} [Mon May 16 19:09:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 19:09:49.127050 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-697ea009-008e-4796-bd85-363741065f20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a35a4732594c4ea0b020cb19c2b351e3'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:49.134551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-697ea009-008e-4796-bd85-363741065f20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a35a4732594c4ea0b020cb19c2b351e3'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:49.141964 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-697ea009-008e-4796-bd85-363741065f20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a35a4732594c4ea0b020cb19c2b351e3'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:49.154108 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-697ea009-008e-4796-bd85-363741065f20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a35a4732594c4ea0b020cb19c2b351e3'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:49.154322 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-697ea009-008e-4796-bd85-363741065f20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a35a4732594c4ea0b020cb19c2b351e3'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:49.165864 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1049/2103] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:09:48 2022] DELETE /identity/v3/users/a35a4732594c4ea0b020cb19c2b351e3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:49.449646 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179be61d-448d-4b16-b344-600649ebb6ca None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:49.450146 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179be61d-448d-4b16-b344-600649ebb6ca None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:49.450254 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179be61d-448d-4b16-b344-600649ebb6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:49.467855 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-179be61d-448d-4b16-b344-600649ebb6ca None None] MFA Rules not processed for user `4775e9dd7aea448d95ec7378b4ff3124`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:49.469074 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-179be61d-448d-4b16-b344-600649ebb6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:49.532363 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1055/2104] 10.222.0.24 () {58 vars in 967 bytes} [Mon May 16 19:09:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:49.546584 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ea009-008e-4796-bd85-363741065f20 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:49.548943 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-697ea009-008e-4796-bd85-363741065f20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:49.624543 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ea009-008e-4796-bd85-363741065f20 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:49.631945 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a41caf-e28e-464f-8a3b-f452638059ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '654e435a35c4491eb87943734ce280f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:49.632874 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a41caf-e28e-464f-8a3b-f452638059ae service swift] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:49.633660 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a41caf-e28e-464f-8a3b-f452638059ae service swift] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:49.633957 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a41caf-e28e-464f-8a3b-f452638059ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:49.644092 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a41caf-e28e-464f-8a3b-f452638059ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:49.645849 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a41caf-e28e-464f-8a3b-f452638059ae service swift] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:49.655167 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1050/2105] 10.222.0.24 () {60 vars in 1384 bytes} [Mon May 16 19:09:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 16 19:09:49.739673 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179be61d-448d-4b16-b344-600649ebb6ca None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:49.741162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-179be61d-448d-4b16-b344-600649ebb6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:49.810706 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179be61d-448d-4b16-b344-600649ebb6ca None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:49.815954 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434e282-2a0f-4164-8e33-b050b5a790a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:49.816833 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434e282-2a0f-4164-8e33-b050b5a790a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:49.817113 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434e282-2a0f-4164-8e33-b050b5a790a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:49.817463 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434e282-2a0f-4164-8e33-b050b5a790a3 admin admin] PATH_INFO: `/v3/projects/9c48c0374c6b417382131351bf7c8e73` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:49.818830 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434e282-2a0f-4164-8e33-b050b5a790a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c48c0374c6b417382131351bf7c8e73)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:49.820789 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434e282-2a0f-4164-8e33-b050b5a790a3 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:49.867160 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-b434e282-2a0f-4164-8e33-b050b5a790a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c48c0374c6b417382131351bf7c8e73', 'request_id': 'req-b434e282-2a0f-4164-8e33-b050b5a790a3'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:49.872762 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-b434e282-2a0f-4164-8e33-b050b5a790a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c48c0374c6b417382131351bf7c8e73', 'request_id': 'req-b434e282-2a0f-4164-8e33-b050b5a790a3'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:49.878906 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-b434e282-2a0f-4164-8e33-b050b5a790a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c48c0374c6b417382131351bf7c8e73', 'request_id': 'req-b434e282-2a0f-4164-8e33-b050b5a790a3'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:49.895766 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-b434e282-2a0f-4164-8e33-b050b5a790a3 admin admin] The token cache is being invalidate because project 9c48c0374c6b417382131351bf7c8e73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:09:49.896083 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-b434e282-2a0f-4164-8e33-b050b5a790a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:49.896748 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-b434e282-2a0f-4164-8e33-b050b5a790a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:49.898353 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1056/2106] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:09:49 2022] DELETE /identity/v3/projects/9c48c0374c6b417382131351bf7c8e73 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:49.904763 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561c4ef-0a68-40e3-adce-0a3c555f4bc1 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:49.905061 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561c4ef-0a68-40e3-adce-0a3c555f4bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:49.905338 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561c4ef-0a68-40e3-adce-0a3c555f4bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:49.926986 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-d561c4ef-0a68-40e3-adce-0a3c555f4bc1 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:49.928181 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d561c4ef-0a68-40e3-adce-0a3c555f4bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:49.993551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1051/2107] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:50.002253 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a74fb-547d-4601-bc06-b2ce82359418 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:50.002537 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a74fb-547d-4601-bc06-b2ce82359418 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:50.002807 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a74fb-547d-4601-bc06-b2ce82359418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:50.020937 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-272a74fb-547d-4601-bc06-b2ce82359418 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:50.022145 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-272a74fb-547d-4601-bc06-b2ce82359418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:50.030904 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1057/2108] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:50.035414 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561c4ef-0a68-40e3-adce-0a3c555f4bc1 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:50.045384 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561c4ef-0a68-40e3-adce-0a3c555f4bc1 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:50.052454 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712e91e-5813-41b2-b24e-8ec2a55dbaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:50.052454 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712e91e-5813-41b2-b24e-8ec2a55dbaaf admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:50.052454 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712e91e-5813-41b2-b24e-8ec2a55dbaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:50.052454 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712e91e-5813-41b2-b24e-8ec2a55dbaaf admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:50.052830 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9712e91e-5813-41b2-b24e-8ec2a55dbaaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:09:50.054325 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9712e91e-5813-41b2-b24e-8ec2a55dbaaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:50.056026 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9712e91e-5813-41b2-b24e-8ec2a55dbaaf admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:50.069766 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1052/2109] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:09:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:09:50.074246 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a74fb-547d-4601-bc06-b2ce82359418 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:50.083515 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a74fb-547d-4601-bc06-b2ce82359418 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:50.088497 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aff34c-70dd-4d51-8a24-d24594f49361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:50.089211 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aff34c-70dd-4d51-8a24-d24594f49361 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:50.089722 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aff34c-70dd-4d51-8a24-d24594f49361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:50.090004 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aff34c-70dd-4d51-8a24-d24594f49361 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:50.090734 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aff34c-70dd-4d51-8a24-d24594f49361 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:50.092655 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aff34c-70dd-4d51-8a24-d24594f49361 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:50.126368 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1058/2110] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:09:50 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:09:50.130536 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712e91e-5813-41b2-b24e-8ec2a55dbaaf admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:50.140613 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712e91e-5813-41b2-b24e-8ec2a55dbaaf admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:50.207490 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80e0de-c625-43bf-a585-77803a4f72b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:50.208182 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80e0de-c625-43bf-a585-77803a4f72b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:50.208485 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80e0de-c625-43bf-a585-77803a4f72b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:50.208710 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80e0de-c625-43bf-a585-77803a4f72b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:50.209414 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc80e0de-c625-43bf-a585-77803a4f72b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:50.211407 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc80e0de-c625-43bf-a585-77803a4f72b6 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:50.237671 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1053/2111] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:09:50 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:09:50.239191 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aff34c-70dd-4d51-8a24-d24594f49361 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:50.250638 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aff34c-70dd-4d51-8a24-d24594f49361 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:50.256003 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72a478-2e7f-4258-bc4c-ef1210f0fdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:50.256848 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72a478-2e7f-4258-bc4c-ef1210f0fdea admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:50.257274 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72a478-2e7f-4258-bc4c-ef1210f0fdea admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:50.257615 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72a478-2e7f-4258-bc4c-ef1210f0fdea admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:50.258355 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba72a478-2e7f-4258-bc4c-ef1210f0fdea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:50.260001 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba72a478-2e7f-4258-bc4c-ef1210f0fdea admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:50.272359 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1059/2112] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 19:09:50.276353 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80e0de-c625-43bf-a585-77803a4f72b6 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:50.287228 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80e0de-c625-43bf-a585-77803a4f72b6 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:50.293879 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17274b2-865d-4fa1-9139-d906159a35fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:50.294749 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17274b2-865d-4fa1-9139-d906159a35fe admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:50.295147 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17274b2-865d-4fa1-9139-d906159a35fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:50.296599 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17274b2-865d-4fa1-9139-d906159a35fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:50.297595 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17274b2-865d-4fa1-9139-d906159a35fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:50.299792 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17274b2-865d-4fa1-9139-d906159a35fe admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:50.317821 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1054/2113] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:09:50.318783 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72a478-2e7f-4258-bc4c-ef1210f0fdea admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:50.330280 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72a478-2e7f-4258-bc4c-ef1210f0fdea admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:50.339037 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3455886-03e8-4c09-812e-f4b118b9558b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:50.340137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3455886-03e8-4c09-812e-f4b118b9558b admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:50.340619 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3455886-03e8-4c09-812e-f4b118b9558b admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:50.340994 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3455886-03e8-4c09-812e-f4b118b9558b admin admin] PATH_INFO: `/v3/projects/da029b5fe30a4fbdb7bab083442071a2/users/f6b3317815c141949cf3e88d2e60ad20/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:50.359421 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3455886-03e8-4c09-812e-f4b118b9558b admin admin] RBAC: Authorizing `identity:create_grant(project_id=da029b5fe30a4fbdb7bab083442071a2, user_id=f6b3317815c141949cf3e88d2e60ad20, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:50.362787 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3455886-03e8-4c09-812e-f4b118b9558b admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:50.384645 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1060/2114] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:09:50 2022] PUT /identity/v3/projects/da029b5fe30a4fbdb7bab083442071a2/users/f6b3317815c141949cf3e88d2e60ad20/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:50.390874 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a303dd-f79b-4021-9a4b-03773a9c0326 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:50.391136 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a303dd-f79b-4021-9a4b-03773a9c0326 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:50.391504 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a303dd-f79b-4021-9a4b-03773a9c0326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:50.414972 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-30a303dd-f79b-4021-9a4b-03773a9c0326 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:50.416734 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-30a303dd-f79b-4021-9a4b-03773a9c0326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:50.484249 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1055/2115] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:50.497816 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3455886-03e8-4c09-812e-f4b118b9558b admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:50.499619 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-d3455886-03e8-4c09-812e-f4b118b9558b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:50.559443 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3455886-03e8-4c09-812e-f4b118b9558b admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:50.564182 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ddd307-9869-46b5-aa6a-d32a91baca62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:50.564854 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ddd307-9869-46b5-aa6a-d32a91baca62 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:50.565131 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ddd307-9869-46b5-aa6a-d32a91baca62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:50.565401 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ddd307-9869-46b5-aa6a-d32a91baca62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:50.574739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ddd307-9869-46b5-aa6a-d32a91baca62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:50.576200 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ddd307-9869-46b5-aa6a-d32a91baca62 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:50.585670 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1061/2116] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:09:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:09:51.268272 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168a910-ae66-407c-840e-86dac6301055 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:51.268809 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168a910-ae66-407c-840e-86dac6301055 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:51.268809 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168a910-ae66-407c-840e-86dac6301055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:51.298372 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-2168a910-ae66-407c-840e-86dac6301055 None None] MFA Rules not processed for user `f6b3317815c141949cf3e88d2e60ad20`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:51.298372 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2168a910-ae66-407c-840e-86dac6301055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:51.360810 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1056/2117] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:51.365498 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ddd307-9869-46b5-aa6a-d32a91baca62 service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:51.374903 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ddd307-9869-46b5-aa6a-d32a91baca62 service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:51.379699 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b2919-7a00-4813-947d-2ad91ddd3f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:51.380404 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b2919-7a00-4813-947d-2ad91ddd3f64 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:51.380683 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b2919-7a00-4813-947d-2ad91ddd3f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:51.380961 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b2919-7a00-4813-947d-2ad91ddd3f64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:51.381700 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155b2919-7a00-4813-947d-2ad91ddd3f64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:51.383609 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155b2919-7a00-4813-947d-2ad91ddd3f64 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:51.413605 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1062/2118] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:09:51 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:09:51.418203 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168a910-ae66-407c-840e-86dac6301055 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:51.430489 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168a910-ae66-407c-840e-86dac6301055 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:51.494916 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787e6b3-baec-4a0b-afbd-29bac17d92d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:51.495503 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787e6b3-baec-4a0b-afbd-29bac17d92d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:51.495779 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787e6b3-baec-4a0b-afbd-29bac17d92d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:51.496049 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787e6b3-baec-4a0b-afbd-29bac17d92d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:51.496762 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787e6b3-baec-4a0b-afbd-29bac17d92d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:51.498727 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787e6b3-baec-4a0b-afbd-29bac17d92d4 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:51.522228 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1057/2119] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:09:51 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:09:51.523549 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b2919-7a00-4813-947d-2ad91ddd3f64 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:51.534339 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b2919-7a00-4813-947d-2ad91ddd3f64 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:51.539081 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f35fe-d215-466b-abb9-826a2faf614b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:51.539773 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f35fe-d215-466b-abb9-826a2faf614b admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:51.540028 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f35fe-d215-466b-abb9-826a2faf614b admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:51.540305 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f35fe-d215-466b-abb9-826a2faf614b admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:51.541059 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f35fe-d215-466b-abb9-826a2faf614b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:51.547189 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f35fe-d215-466b-abb9-826a2faf614b admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:51.558385 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1063/2120] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:09:51.562524 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787e6b3-baec-4a0b-afbd-29bac17d92d4 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:51.573000 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787e6b3-baec-4a0b-afbd-29bac17d92d4 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:51.578330 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad3a5f-9f24-408d-963f-2332bee0a5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:51.579338 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad3a5f-9f24-408d-963f-2332bee0a5f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:51.579620 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad3a5f-9f24-408d-963f-2332bee0a5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:51.579890 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad3a5f-9f24-408d-963f-2332bee0a5f7 admin admin] PATH_INFO: `/v3/projects/ed7c9671268b4f6fae59cea20c79acdc/users/36f5f4269a5d45e78af4637b4594c36a/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:51.595515 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad3a5f-9f24-408d-963f-2332bee0a5f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed7c9671268b4f6fae59cea20c79acdc, user_id=36f5f4269a5d45e78af4637b4594c36a, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:51.598282 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad3a5f-9f24-408d-963f-2332bee0a5f7 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:51.612402 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1058/2121] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:09:51 2022] PUT /identity/v3/projects/ed7c9671268b4f6fae59cea20c79acdc/users/36f5f4269a5d45e78af4637b4594c36a/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:51.616464 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f35fe-d215-466b-abb9-826a2faf614b admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:51.626553 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f35fe-d215-466b-abb9-826a2faf614b admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:51.684184 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371afe0-2d2b-44a9-9490-4b29b0de0179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:51.684846 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371afe0-2d2b-44a9-9490-4b29b0de0179 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:51.685111 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371afe0-2d2b-44a9-9490-4b29b0de0179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:51.685385 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371afe0-2d2b-44a9-9490-4b29b0de0179 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:51.686246 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1371afe0-2d2b-44a9-9490-4b29b0de0179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:51.687957 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1371afe0-2d2b-44a9-9490-4b29b0de0179 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:51.697980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1064/2122] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:09:51.702446 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad3a5f-9f24-408d-963f-2332bee0a5f7 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:51.713229 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad3a5f-9f24-408d-963f-2332bee0a5f7 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:51.719144 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ac279-9ec7-4b2c-b867-45c1ba819914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:51.720122 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ac279-9ec7-4b2c-b867-45c1ba819914 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:51.720381 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ac279-9ec7-4b2c-b867-45c1ba819914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:51.720679 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ac279-9ec7-4b2c-b867-45c1ba819914 admin admin] PATH_INFO: `/v3/projects/ed7c9671268b4f6fae59cea20c79acdc/users/36f5f4269a5d45e78af4637b4594c36a/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:51.722952 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ac279-9ec7-4b2c-b867-45c1ba819914 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed7c9671268b4f6fae59cea20c79acdc, user_id=36f5f4269a5d45e78af4637b4594c36a, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:51.725665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ac279-9ec7-4b2c-b867-45c1ba819914 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:51.736516 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1059/2123] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:09:51 2022] PUT /identity/v3/projects/ed7c9671268b4f6fae59cea20c79acdc/users/36f5f4269a5d45e78af4637b4594c36a/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:51.807857 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371afe0-2d2b-44a9-9490-4b29b0de0179 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:51.809903 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-1371afe0-2d2b-44a9-9490-4b29b0de0179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:51.822888 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371afe0-2d2b-44a9-9490-4b29b0de0179 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:51.882207 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df00776-ca2c-4167-aea9-257f6b9f265e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:51.883286 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df00776-ca2c-4167-aea9-257f6b9f265e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:51.883399 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df00776-ca2c-4167-aea9-257f6b9f265e admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:51.883675 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df00776-ca2c-4167-aea9-257f6b9f265e admin admin] PATH_INFO: `/v3/users/fa54a47a738c4b65b13f08921a7f76af` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:51.884925 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df00776-ca2c-4167-aea9-257f6b9f265e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa54a47a738c4b65b13f08921a7f76af)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:51.887003 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df00776-ca2c-4167-aea9-257f6b9f265e admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:51.936584 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-1df00776-ca2c-4167-aea9-257f6b9f265e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa54a47a738c4b65b13f08921a7f76af'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:51.943309 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-1df00776-ca2c-4167-aea9-257f6b9f265e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa54a47a738c4b65b13f08921a7f76af'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:51.950903 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-1df00776-ca2c-4167-aea9-257f6b9f265e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa54a47a738c4b65b13f08921a7f76af'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:51.951623 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-1df00776-ca2c-4167-aea9-257f6b9f265e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa54a47a738c4b65b13f08921a7f76af'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:51.963577 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-1df00776-ca2c-4167-aea9-257f6b9f265e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa54a47a738c4b65b13f08921a7f76af'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:51.970480 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1065/2124] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:09:51 2022] DELETE /identity/v3/users/fa54a47a738c4b65b13f08921a7f76af => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:51.975950 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd0843-2426-41b4-a374-18e0bdb695fc None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:51.976262 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd0843-2426-41b4-a374-18e0bdb695fc None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:51.976534 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd0843-2426-41b4-a374-18e0bdb695fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:51.995197 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-82bd0843-2426-41b4-a374-18e0bdb695fc None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:51.996588 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-82bd0843-2426-41b4-a374-18e0bdb695fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:52.062403 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1060/2125] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:52.080507 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df00776-ca2c-4167-aea9-257f6b9f265e admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:52.082061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-1df00776-ca2c-4167-aea9-257f6b9f265e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:52.171267 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df00776-ca2c-4167-aea9-257f6b9f265e admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:52.179450 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee1408-599a-46c4-99ad-90f80553dc11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:52.180524 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee1408-599a-46c4-99ad-90f80553dc11 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:52.181514 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee1408-599a-46c4-99ad-90f80553dc11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:52.182081 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee1408-599a-46c4-99ad-90f80553dc11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:52.192703 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee1408-599a-46c4-99ad-90f80553dc11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:52.194582 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee1408-599a-46c4-99ad-90f80553dc11 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:52.204554 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1066/2126] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:09:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:09:52.404038 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0dee59-99ee-4d78-860b-c4f8e048d82d None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:52.404544 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0dee59-99ee-4d78-860b-c4f8e048d82d None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:52.404659 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0dee59-99ee-4d78-860b-c4f8e048d82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:52.434522 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-7e0dee59-99ee-4d78-860b-c4f8e048d82d None None] MFA Rules not processed for user `36f5f4269a5d45e78af4637b4594c36a`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:52.435889 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7e0dee59-99ee-4d78-860b-c4f8e048d82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:52.444151 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee1408-599a-46c4-99ad-90f80553dc11 service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:52.445644 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-d3ee1408-599a-46c4-99ad-90f80553dc11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:52.467134 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee1408-599a-46c4-99ad-90f80553dc11 service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:52.473825 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d34383-e65d-478f-bd62-b6a516d0dc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:52.474854 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d34383-e65d-478f-bd62-b6a516d0dc17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:52.474966 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d34383-e65d-478f-bd62-b6a516d0dc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:52.475411 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d34383-e65d-478f-bd62-b6a516d0dc17 admin admin] PATH_INFO: `/v3/projects/053d1449368243acad7c389435ec357c` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:52.476981 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d34383-e65d-478f-bd62-b6a516d0dc17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=053d1449368243acad7c389435ec357c)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:52.479401 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d34383-e65d-478f-bd62-b6a516d0dc17 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:52.540359 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1061/2127] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:52.552662 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0dee59-99ee-4d78-860b-c4f8e048d82d None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:52.553782 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-36d34383-e65d-478f-bd62-b6a516d0dc17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '053d1449368243acad7c389435ec357c', 'request_id': 'req-36d34383-e65d-478f-bd62-b6a516d0dc17'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:52.554356 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7e0dee59-99ee-4d78-860b-c4f8e048d82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:52.564333 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-36d34383-e65d-478f-bd62-b6a516d0dc17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '053d1449368243acad7c389435ec357c', 'request_id': 'req-36d34383-e65d-478f-bd62-b6a516d0dc17'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:52.573494 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-36d34383-e65d-478f-bd62-b6a516d0dc17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '053d1449368243acad7c389435ec357c', 'request_id': 'req-36d34383-e65d-478f-bd62-b6a516d0dc17'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:52.598233 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-36d34383-e65d-478f-bd62-b6a516d0dc17 admin admin] The token cache is being invalidate because project 053d1449368243acad7c389435ec357c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:09:52.599459 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-36d34383-e65d-478f-bd62-b6a516d0dc17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:52.600477 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-36d34383-e65d-478f-bd62-b6a516d0dc17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:09:52.604902 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1067/2128] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:09:52 2022] DELETE /identity/v3/projects/053d1449368243acad7c389435ec357c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:52.610283 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda1df8-a860-4b09-9a34-eeeb4e8ad06f None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:52.610686 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda1df8-a860-4b09-9a34-eeeb4e8ad06f None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:52.612475 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda1df8-a860-4b09-9a34-eeeb4e8ad06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:52.637485 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0dee59-99ee-4d78-860b-c4f8e048d82d None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:52.646851 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-ccda1df8-a860-4b09-9a34-eeeb4e8ad06f None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:52.648673 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-ccda1df8-a860-4b09-9a34-eeeb4e8ad06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:52.700912 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a890d8b-62e9-4d39-8757-0f42cff15ed7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:52.702195 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a890d8b-62e9-4d39-8757-0f42cff15ed7 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:52.702579 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a890d8b-62e9-4d39-8757-0f42cff15ed7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:52.703188 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a890d8b-62e9-4d39-8757-0f42cff15ed7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:52.705835 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7a890d8b-62e9-4d39-8757-0f42cff15ed7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:52.713467 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1068/2129] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:52.721421 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e725392-2cde-4edf-8e06-1526fb9465e8 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:52.723382 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e725392-2cde-4edf-8e06-1526fb9465e8 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:52.723665 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e725392-2cde-4edf-8e06-1526fb9465e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:52.743366 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-7e725392-2cde-4edf-8e06-1526fb9465e8 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:52.744849 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-7e725392-2cde-4edf-8e06-1526fb9465e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:52.753272 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1069/2130] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:52.757052 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e725392-2cde-4edf-8e06-1526fb9465e8 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:52.767363 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e725392-2cde-4edf-8e06-1526fb9465e8 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:52.770063 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a890d8b-62e9-4d39-8757-0f42cff15ed7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:52.771514 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a890d8b-62e9-4d39-8757-0f42cff15ed7 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:52.773240 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80635ff3-b60c-4950-8446-b48e4a15cd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:52.773939 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80635ff3-b60c-4950-8446-b48e4a15cd75 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:52.774221 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80635ff3-b60c-4950-8446-b48e4a15cd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:52.774496 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80635ff3-b60c-4950-8446-b48e4a15cd75 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:52.775289 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80635ff3-b60c-4950-8446-b48e4a15cd75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:09:52.775535 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80635ff3-b60c-4950-8446-b48e4a15cd75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:52.777563 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80635ff3-b60c-4950-8446-b48e4a15cd75 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:52.781434 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1062/2131] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:09:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 19:09:52.789502 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1070/2132] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:09:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 19:09:52.794271 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a890d8b-62e9-4d39-8757-0f42cff15ed7 service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:52.806965 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a890d8b-62e9-4d39-8757-0f42cff15ed7 service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:52.813889 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05307b8b-fcb2-4fb5-a730-1b3e10dcab01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:52.815130 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05307b8b-fcb2-4fb5-a730-1b3e10dcab01 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:52.815584 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05307b8b-fcb2-4fb5-a730-1b3e10dcab01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:52.816217 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05307b8b-fcb2-4fb5-a730-1b3e10dcab01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:52.817102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05307b8b-fcb2-4fb5-a730-1b3e10dcab01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:52.819212 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05307b8b-fcb2-4fb5-a730-1b3e10dcab01 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:52.853494 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1063/2133] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:09:52 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:09:52.854978 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80635ff3-b60c-4950-8446-b48e4a15cd75 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:52.865147 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80635ff3-b60c-4950-8446-b48e4a15cd75 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:52.929619 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e117f54-cf8e-4689-948c-120a58f0fab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:52.930536 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e117f54-cf8e-4689-948c-120a58f0fab4 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:52.930917 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e117f54-cf8e-4689-948c-120a58f0fab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:52.931201 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e117f54-cf8e-4689-948c-120a58f0fab4 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:52.931942 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e117f54-cf8e-4689-948c-120a58f0fab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:52.934124 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e117f54-cf8e-4689-948c-120a58f0fab4 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:52.957562 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1071/2134] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:09:52 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:09:52.960054 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05307b8b-fcb2-4fb5-a730-1b3e10dcab01 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:52.973119 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05307b8b-fcb2-4fb5-a730-1b3e10dcab01 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:52.978490 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d216db-544c-4501-8282-78eb41996e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:52.979287 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d216db-544c-4501-8282-78eb41996e50 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:52.979570 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d216db-544c-4501-8282-78eb41996e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:52.979889 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d216db-544c-4501-8282-78eb41996e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:52.980723 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d216db-544c-4501-8282-78eb41996e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:52.982457 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d216db-544c-4501-8282-78eb41996e50 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:52.995107 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1064/2135] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:09:52.999438 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e117f54-cf8e-4689-948c-120a58f0fab4 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:53.009783 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e117f54-cf8e-4689-948c-120a58f0fab4 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:53.014965 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8aa6e1-7c26-4a07-ad54-567295db8f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:53.015878 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8aa6e1-7c26-4a07-ad54-567295db8f44 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:53.016146 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8aa6e1-7c26-4a07-ad54-567295db8f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:53.016586 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8aa6e1-7c26-4a07-ad54-567295db8f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:53.017334 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8aa6e1-7c26-4a07-ad54-567295db8f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:53.019044 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8aa6e1-7c26-4a07-ad54-567295db8f44 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:53.040756 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1072/2136] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 19:09:53.044856 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d216db-544c-4501-8282-78eb41996e50 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:53.058187 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d216db-544c-4501-8282-78eb41996e50 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:53.064061 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36509dd7-3ffd-44ba-b886-b3c9da8b5e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:53.065162 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36509dd7-3ffd-44ba-b886-b3c9da8b5e31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:53.065628 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36509dd7-3ffd-44ba-b886-b3c9da8b5e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:53.066092 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36509dd7-3ffd-44ba-b886-b3c9da8b5e31 admin admin] PATH_INFO: `/v3/projects/84949fef3a77459fbf02d0804bafdc4a/users/2aba8a58b6c24e548a8ab08cfa5bb857/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:53.087347 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36509dd7-3ffd-44ba-b886-b3c9da8b5e31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84949fef3a77459fbf02d0804bafdc4a, user_id=2aba8a58b6c24e548a8ab08cfa5bb857, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:53.090377 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36509dd7-3ffd-44ba-b886-b3c9da8b5e31 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:53.105095 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1065/2137] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:09:53 2022] PUT /identity/v3/projects/84949fef3a77459fbf02d0804bafdc4a/users/2aba8a58b6c24e548a8ab08cfa5bb857/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:53.111505 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86b751-7e52-4e3e-b38c-b73711d044f8 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:53.111815 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86b751-7e52-4e3e-b38c-b73711d044f8 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:53.112094 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86b751-7e52-4e3e-b38c-b73711d044f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:53.138033 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-5c86b751-7e52-4e3e-b38c-b73711d044f8 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:53.139266 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-5c86b751-7e52-4e3e-b38c-b73711d044f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:53.200356 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1073/2138] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:53.211570 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36509dd7-3ffd-44ba-b886-b3c9da8b5e31 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:53.213645 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-36509dd7-3ffd-44ba-b886-b3c9da8b5e31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:53.278264 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36509dd7-3ffd-44ba-b886-b3c9da8b5e31 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:53.282415 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233a973-576a-4d10-96b4-bf723a7a9f33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:53.283081 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233a973-576a-4d10-96b4-bf723a7a9f33 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:53.283359 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233a973-576a-4d10-96b4-bf723a7a9f33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:53.283631 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233a973-576a-4d10-96b4-bf723a7a9f33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:53.293021 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233a973-576a-4d10-96b4-bf723a7a9f33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:53.294571 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233a973-576a-4d10-96b4-bf723a7a9f33 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:53.304716 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1066/2139] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:09:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:09:54.155666 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86b751-7e52-4e3e-b38c-b73711d044f8 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:54.157138 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-5c86b751-7e52-4e3e-b38c-b73711d044f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:54.225731 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86b751-7e52-4e3e-b38c-b73711d044f8 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:54.229401 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a10847-6742-4acf-ae18-61d125295cfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:54.230147 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a10847-6742-4acf-ae18-61d125295cfe service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:54.230494 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a10847-6742-4acf-ae18-61d125295cfe service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:54.230834 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a10847-6742-4acf-ae18-61d125295cfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:54.233684 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-c1a10847-6742-4acf-ae18-61d125295cfe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:54.298016 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a10847-6742-4acf-ae18-61d125295cfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:54.299598 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a10847-6742-4acf-ae18-61d125295cfe service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:54.313679 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1074/2140] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:09:54 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:09:57.806289 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e608caa-eb79-4073-bfc6-4d72d8308681 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:57.806807 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e608caa-eb79-4073-bfc6-4d72d8308681 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:57.807345 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e608caa-eb79-4073-bfc6-4d72d8308681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:57.836984 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-0e608caa-eb79-4073-bfc6-4d72d8308681 None None] MFA Rules not processed for user `2aba8a58b6c24e548a8ab08cfa5bb857`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:09:57.838276 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0e608caa-eb79-4073-bfc6-4d72d8308681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:09:57.921721 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1067/2141] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:09:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:09:57.925932 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a10847-6742-4acf-ae18-61d125295cfe service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:57.938377 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a10847-6742-4acf-ae18-61d125295cfe service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:57.943692 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2d2b7-63aa-40de-bda8-e696cbae9075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:57.944267 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2d2b7-63aa-40de-bda8-e696cbae9075 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:57.944572 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2d2b7-63aa-40de-bda8-e696cbae9075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:57.944848 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2d2b7-63aa-40de-bda8-e696cbae9075 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:57.945818 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2d2b7-63aa-40de-bda8-e696cbae9075 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:57.947749 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2d2b7-63aa-40de-bda8-e696cbae9075 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:57.977135 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1075/2142] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:09:57 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:09:57.981315 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e608caa-eb79-4073-bfc6-4d72d8308681 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:57.992815 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e608caa-eb79-4073-bfc6-4d72d8308681 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:58.058317 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672bd7e-e814-4456-b0cf-8266be261c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:58.059121 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672bd7e-e814-4456-b0cf-8266be261c53 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:58.059830 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672bd7e-e814-4456-b0cf-8266be261c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:58.060183 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672bd7e-e814-4456-b0cf-8266be261c53 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:58.060998 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6672bd7e-e814-4456-b0cf-8266be261c53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:58.063249 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6672bd7e-e814-4456-b0cf-8266be261c53 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:58.090178 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1068/2143] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:09:57 2022] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:09:58.094217 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2d2b7-63aa-40de-bda8-e696cbae9075 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:58.107487 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2d2b7-63aa-40de-bda8-e696cbae9075 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:58.119890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d99fb5-280c-46da-b7f4-27d263506cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:58.120846 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d99fb5-280c-46da-b7f4-27d263506cdd admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:58.121279 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d99fb5-280c-46da-b7f4-27d263506cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:58.121745 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d99fb5-280c-46da-b7f4-27d263506cdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:58.122797 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d99fb5-280c-46da-b7f4-27d263506cdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:58.124599 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d99fb5-280c-46da-b7f4-27d263506cdd admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:58.153989 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1076/2144] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:09:58.175318 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672bd7e-e814-4456-b0cf-8266be261c53 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:58.187406 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672bd7e-e814-4456-b0cf-8266be261c53 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:58.199198 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c89da-0c2b-4fb0-8be9-f6a1acf16895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:58.200520 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c89da-0c2b-4fb0-8be9-f6a1acf16895 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:58.200866 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c89da-0c2b-4fb0-8be9-f6a1acf16895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:58.201267 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c89da-0c2b-4fb0-8be9-f6a1acf16895 admin admin] PATH_INFO: `/v3/projects/006a916aeef842d29784440cf91bf8a6/users/009e41b8f9844174ac056c52a0b74d1a/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:58.230723 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c89da-0c2b-4fb0-8be9-f6a1acf16895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=006a916aeef842d29784440cf91bf8a6, user_id=009e41b8f9844174ac056c52a0b74d1a, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:58.235221 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c89da-0c2b-4fb0-8be9-f6a1acf16895 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:58.255146 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1069/2145] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:09:58 2022] PUT /identity/v3/projects/006a916aeef842d29784440cf91bf8a6/users/009e41b8f9844174ac056c52a0b74d1a/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:09:58.259560 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d99fb5-280c-46da-b7f4-27d263506cdd admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:58.276670 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d99fb5-280c-46da-b7f4-27d263506cdd admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:58.336338 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4826ab6-36e1-4170-bb0a-a51ce53735f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:58.337153 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4826ab6-36e1-4170-bb0a-a51ce53735f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:58.337498 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4826ab6-36e1-4170-bb0a-a51ce53735f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:58.337807 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4826ab6-36e1-4170-bb0a-a51ce53735f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:58.338536 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4826ab6-36e1-4170-bb0a-a51ce53735f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:58.340189 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4826ab6-36e1-4170-bb0a-a51ce53735f6 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:58.350602 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1077/2146] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:09:58.355077 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c89da-0c2b-4fb0-8be9-f6a1acf16895 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:09:58.368250 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c89da-0c2b-4fb0-8be9-f6a1acf16895 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:09:58.373231 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85bb48-fb2c-4be2-8b8b-89cbd375c9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:09:58.374356 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85bb48-fb2c-4be2-8b8b-89cbd375c9a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:09:58.374750 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85bb48-fb2c-4be2-8b8b-89cbd375c9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:09:58.375102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85bb48-fb2c-4be2-8b8b-89cbd375c9a0 admin admin] PATH_INFO: `/v3/projects/006a916aeef842d29784440cf91bf8a6/users/009e41b8f9844174ac056c52a0b74d1a/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:09:58.377242 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc85bb48-fb2c-4be2-8b8b-89cbd375c9a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=006a916aeef842d29784440cf91bf8a6, user_id=009e41b8f9844174ac056c52a0b74d1a, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:09:58.380135 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc85bb48-fb2c-4be2-8b8b-89cbd375c9a0 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:09:58.393603 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1070/2147] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:09:58 2022] PUT /identity/v3/projects/006a916aeef842d29784440cf91bf8a6/users/009e41b8f9844174ac056c52a0b74d1a/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:10:03.808395 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c15ee5-02df-448f-bd2b-8e14c132a2ad None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:03.809017 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c15ee5-02df-448f-bd2b-8e14c132a2ad None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:03.809255 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c15ee5-02df-448f-bd2b-8e14c132a2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:03.842484 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-c0c15ee5-02df-448f-bd2b-8e14c132a2ad None None] MFA Rules not processed for user `009e41b8f9844174ac056c52a0b74d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:10:03.843781 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-c0c15ee5-02df-448f-bd2b-8e14c132a2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:03.939889 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1078/2148] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:10:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:10:03.951600 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85bb48-fb2c-4be2-8b8b-89cbd375c9a0 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:03.954361 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-cc85bb48-fb2c-4be2-8b8b-89cbd375c9a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:04.054985 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85bb48-fb2c-4be2-8b8b-89cbd375c9a0 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:04.058948 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf99666-f1ab-4831-92cb-f152279224cc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dfa8e8908804c0e8908e2a8c6b377e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:04.060065 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf99666-f1ab-4831-92cb-f152279224cc service glance] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:04.060197 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf99666-f1ab-4831-92cb-f152279224cc service glance] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:04.060648 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf99666-f1ab-4831-92cb-f152279224cc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:04.153385 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf99666-f1ab-4831-92cb-f152279224cc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:04.155117 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf99666-f1ab-4831-92cb-f152279224cc service glance] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:04.180546 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1071/2149] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:10:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:10:04.316748 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975af5cb-aaa2-4e73-9f05-45c56676cfb0 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:04.316892 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975af5cb-aaa2-4e73-9f05-45c56676cfb0 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:04.317175 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975af5cb-aaa2-4e73-9f05-45c56676cfb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:04.348946 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-975af5cb-aaa2-4e73-9f05-45c56676cfb0 None None] MFA Rules not processed for user `4775e9dd7aea448d95ec7378b4ff3124`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:10:04.353127 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-975af5cb-aaa2-4e73-9f05-45c56676cfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:04.423300 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1079/2150] 10.222.0.24 () {58 vars in 1009 bytes} [Mon May 16 19:10:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:10:04.439021 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf99666-f1ab-4831-92cb-f152279224cc service glance] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:04.440561 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3cf99666-f1ab-4831-92cb-f152279224cc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:04.511043 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf99666-f1ab-4831-92cb-f152279224cc service glance] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:04.517439 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acaf432-1dbc-48af-ad13-542aa4199b39 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '654e435a35c4491eb87943734ce280f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:04.518351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acaf432-1dbc-48af-ad13-542aa4199b39 service swift] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:04.518631 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acaf432-1dbc-48af-ad13-542aa4199b39 service swift] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:04.519051 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acaf432-1dbc-48af-ad13-542aa4199b39 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:04.528146 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acaf432-1dbc-48af-ad13-542aa4199b39 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:04.529751 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acaf432-1dbc-48af-ad13-542aa4199b39 service swift] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:04.538145 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1072/2151] 10.222.0.24 () {60 vars in 1384 bytes} [Mon May 16 19:10:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 19:10:05.166006 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9047b-2060-4c28-b36b-ab343cf6a363 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:05.167059 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9047b-2060-4c28-b36b-ab343cf6a363 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:05.168362 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9047b-2060-4c28-b36b-ab343cf6a363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:05.205706 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-45c9047b-2060-4c28-b36b-ab343cf6a363 None None] MFA Rules not processed for user `4775e9dd7aea448d95ec7378b4ff3124`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:10:05.206982 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-45c9047b-2060-4c28-b36b-ab343cf6a363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:05.245115 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1080/2152] 10.222.0.24 () {58 vars in 1009 bytes} [Mon May 16 19:10:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:10:05.267464 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acaf432-1dbc-48af-ad13-542aa4199b39 service swift] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:05.281113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acaf432-1dbc-48af-ad13-542aa4199b39 service swift] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:05.295318 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874ba49-f821-4e45-9923-6f640d0cee80 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '654e435a35c4491eb87943734ce280f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:05.296261 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874ba49-f821-4e45-9923-6f640d0cee80 service swift] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:05.297553 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874ba49-f821-4e45-9923-6f640d0cee80 service swift] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:05.297990 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874ba49-f821-4e45-9923-6f640d0cee80 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:05.308826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874ba49-f821-4e45-9923-6f640d0cee80 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:05.310584 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874ba49-f821-4e45-9923-6f640d0cee80 service swift] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:05.325191 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1073/2153] 10.222.0.24 () {60 vars in 1384 bytes} [Mon May 16 19:10:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 19:10:16.821931 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9047b-2060-4c28-b36b-ab343cf6a363 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:16.823568 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-45c9047b-2060-4c28-b36b-ab343cf6a363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:17.068727 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9047b-2060-4c28-b36b-ab343cf6a363 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:17.074101 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8225702-bf46-479c-b747-1af60293acb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:17.075418 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8225702-bf46-479c-b747-1af60293acb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:17.075897 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8225702-bf46-479c-b747-1af60293acb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:17.076344 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8225702-bf46-479c-b747-1af60293acb6 admin admin] PATH_INFO: `/v3/users/53266915261a4b4fa5fce16a34de8bc7` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:17.078297 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8225702-bf46-479c-b747-1af60293acb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53266915261a4b4fa5fce16a34de8bc7)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:17.080665 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8225702-bf46-479c-b747-1af60293acb6 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:17.160172 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a8225702-bf46-479c-b747-1af60293acb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53266915261a4b4fa5fce16a34de8bc7'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:17.173347 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a8225702-bf46-479c-b747-1af60293acb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53266915261a4b4fa5fce16a34de8bc7'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:17.192103 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a8225702-bf46-479c-b747-1af60293acb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53266915261a4b4fa5fce16a34de8bc7'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:17.194437 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a8225702-bf46-479c-b747-1af60293acb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53266915261a4b4fa5fce16a34de8bc7'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:17.232374 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a8225702-bf46-479c-b747-1af60293acb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53266915261a4b4fa5fce16a34de8bc7'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:17.239694 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1081/2154] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:10:16 2022] DELETE /identity/v3/users/53266915261a4b4fa5fce16a34de8bc7 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:10:17.244826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfe5cc-09c2-4062-8324-777af8243e1a None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:17.245958 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfe5cc-09c2-4062-8324-777af8243e1a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:17.246422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfe5cc-09c2-4062-8324-777af8243e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:17.332567 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-eccfe5cc-09c2-4062-8324-777af8243e1a None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:10:17.335635 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-eccfe5cc-09c2-4062-8324-777af8243e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:17.467123 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1074/2155] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:10:17.478644 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8225702-bf46-479c-b747-1af60293acb6 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:17.480580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a8225702-bf46-479c-b747-1af60293acb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:17.672946 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8225702-bf46-479c-b747-1af60293acb6 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:17.687643 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6287a33c-6d0b-43fc-ad48-3e0c38eaeb72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:17.688329 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287a33c-6d0b-43fc-ad48-3e0c38eaeb72 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:17.688905 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287a33c-6d0b-43fc-ad48-3e0c38eaeb72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:17.694632 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287a33c-6d0b-43fc-ad48-3e0c38eaeb72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:17.713174 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6287a33c-6d0b-43fc-ad48-3e0c38eaeb72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:17.714679 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6287a33c-6d0b-43fc-ad48-3e0c38eaeb72 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:17.735358 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1082/2156] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:10:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:10:18.037637 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a6297-b26c-4ee2-9846-78409d1f7819 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:18.038243 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a6297-b26c-4ee2-9846-78409d1f7819 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:18.038603 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a6297-b26c-4ee2-9846-78409d1f7819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:18.062295 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-ea1a6297-b26c-4ee2-9846-78409d1f7819 None None] MFA Rules not processed for user `2aba8a58b6c24e548a8ab08cfa5bb857`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:10:18.064942 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ea1a6297-b26c-4ee2-9846-78409d1f7819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:18.119059 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6287a33c-6d0b-43fc-ad48-3e0c38eaeb72 service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:18.127077 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-6287a33c-6d0b-43fc-ad48-3e0c38eaeb72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:18.153031 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6287a33c-6d0b-43fc-ad48-3e0c38eaeb72 service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:18.162360 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0789c4-2234-4599-8bfc-37058f492616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:18.163617 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0789c4-2234-4599-8bfc-37058f492616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:18.165213 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0789c4-2234-4599-8bfc-37058f492616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:18.171061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0789c4-2234-4599-8bfc-37058f492616 admin admin] PATH_INFO: `/v3/users/f6b3317815c141949cf3e88d2e60ad20` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:18.173283 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0789c4-2234-4599-8bfc-37058f492616 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6b3317815c141949cf3e88d2e60ad20)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:18.179575 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0789c4-2234-4599-8bfc-37058f492616 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:18.220453 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1075/2157] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:10:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:10:18.272280 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-5c0789c4-2234-4599-8bfc-37058f492616 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6b3317815c141949cf3e88d2e60ad20'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:18.285895 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-5c0789c4-2234-4599-8bfc-37058f492616 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6b3317815c141949cf3e88d2e60ad20'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:18.299000 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-5c0789c4-2234-4599-8bfc-37058f492616 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6b3317815c141949cf3e88d2e60ad20'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:18.300067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-5c0789c4-2234-4599-8bfc-37058f492616 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6b3317815c141949cf3e88d2e60ad20'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:18.327792 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-5c0789c4-2234-4599-8bfc-37058f492616 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6b3317815c141949cf3e88d2e60ad20'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:18.343524 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1083/2158] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:10:18 2022] DELETE /identity/v3/users/f6b3317815c141949cf3e88d2e60ad20 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:10:18.540081 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a6297-b26c-4ee2-9846-78409d1f7819 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:18.544279 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ea1a6297-b26c-4ee2-9846-78409d1f7819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:18.617011 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a6297-b26c-4ee2-9846-78409d1f7819 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:18.745721 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0789c4-2234-4599-8bfc-37058f492616 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:18.747213 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-5c0789c4-2234-4599-8bfc-37058f492616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:18.793578 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e32f3b-92a2-4566-8f2c-efda9db16e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:18.794451 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e32f3b-92a2-4566-8f2c-efda9db16e5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:18.794723 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e32f3b-92a2-4566-8f2c-efda9db16e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:18.794987 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e32f3b-92a2-4566-8f2c-efda9db16e5e admin admin] PATH_INFO: `/v3/projects/5da41ec945a74bf7a2e2ea7eaf112b5f` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:18.796384 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e32f3b-92a2-4566-8f2c-efda9db16e5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5da41ec945a74bf7a2e2ea7eaf112b5f)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:18.798731 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e32f3b-92a2-4566-8f2c-efda9db16e5e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:18.887234 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0789c4-2234-4599-8bfc-37058f492616 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:18.902811 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-53e32f3b-92a2-4566-8f2c-efda9db16e5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5da41ec945a74bf7a2e2ea7eaf112b5f', 'request_id': 'req-53e32f3b-92a2-4566-8f2c-efda9db16e5e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:18.916530 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-53e32f3b-92a2-4566-8f2c-efda9db16e5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5da41ec945a74bf7a2e2ea7eaf112b5f', 'request_id': 'req-53e32f3b-92a2-4566-8f2c-efda9db16e5e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:18.923993 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-53e32f3b-92a2-4566-8f2c-efda9db16e5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5da41ec945a74bf7a2e2ea7eaf112b5f', 'request_id': 'req-53e32f3b-92a2-4566-8f2c-efda9db16e5e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:18.947320 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-53e32f3b-92a2-4566-8f2c-efda9db16e5e admin admin] The token cache is being invalidate because project 5da41ec945a74bf7a2e2ea7eaf112b5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:10:18.947814 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-53e32f3b-92a2-4566-8f2c-efda9db16e5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:18.948813 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-53e32f3b-92a2-4566-8f2c-efda9db16e5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:18.954827 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1076/2159] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:10:18 2022] DELETE /identity/v3/projects/5da41ec945a74bf7a2e2ea7eaf112b5f => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:10:18.956704 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d2577-2ce9-4538-9225-df42c767909e None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:18.957162 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d2577-2ce9-4538-9225-df42c767909e None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:18.957512 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d2577-2ce9-4538-9225-df42c767909e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:18.990409 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73abc0a-38b5-4faa-af36-f720c8ca6da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:18.991318 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73abc0a-38b5-4faa-af36-f720c8ca6da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:18.991606 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73abc0a-38b5-4faa-af36-f720c8ca6da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:18.991869 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73abc0a-38b5-4faa-af36-f720c8ca6da7 admin admin] PATH_INFO: `/v3/projects/da029b5fe30a4fbdb7bab083442071a2` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:18.994356 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73abc0a-38b5-4faa-af36-f720c8ca6da7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da029b5fe30a4fbdb7bab083442071a2)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:18.996302 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73abc0a-38b5-4faa-af36-f720c8ca6da7 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:19.035681 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-2b6d2577-2ce9-4538-9225-df42c767909e None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:10:19.038763 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2b6d2577-2ce9-4538-9225-df42c767909e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:19.058262 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1077/2160] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:10:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:10:19.068485 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c833fe-995b-4a4e-9afc-cd3dd15f2306 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:19.068676 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f73abc0a-38b5-4faa-af36-f720c8ca6da7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da029b5fe30a4fbdb7bab083442071a2', 'request_id': 'req-f73abc0a-38b5-4faa-af36-f720c8ca6da7'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:19.068762 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c833fe-995b-4a4e-9afc-cd3dd15f2306 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:19.069043 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c833fe-995b-4a4e-9afc-cd3dd15f2306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:19.075578 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f73abc0a-38b5-4faa-af36-f720c8ca6da7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da029b5fe30a4fbdb7bab083442071a2', 'request_id': 'req-f73abc0a-38b5-4faa-af36-f720c8ca6da7'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:19.086367 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f73abc0a-38b5-4faa-af36-f720c8ca6da7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da029b5fe30a4fbdb7bab083442071a2', 'request_id': 'req-f73abc0a-38b5-4faa-af36-f720c8ca6da7'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:19.114329 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f73abc0a-38b5-4faa-af36-f720c8ca6da7 admin admin] The token cache is being invalidate because project da029b5fe30a4fbdb7bab083442071a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:10:19.114814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f73abc0a-38b5-4faa-af36-f720c8ca6da7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:19.116095 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f73abc0a-38b5-4faa-af36-f720c8ca6da7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:19.118746 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1084/2161] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:10:18 2022] DELETE /identity/v3/projects/da029b5fe30a4fbdb7bab083442071a2 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:10:19.122235 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73abc0a-38b5-4faa-af36-f720c8ca6da7 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:19.124245 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f73abc0a-38b5-4faa-af36-f720c8ca6da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:19.133466 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-23c833fe-995b-4a4e-9afc-cd3dd15f2306 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:10:19.133466 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-23c833fe-995b-4a4e-9afc-cd3dd15f2306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:19.234006 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73abc0a-38b5-4faa-af36-f720c8ca6da7 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:19.241184 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b699526-da03-44ed-95b9-7b67414706a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:19.242993 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b699526-da03-44ed-95b9-7b67414706a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:19.243604 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b699526-da03-44ed-95b9-7b67414706a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:19.244639 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b699526-da03-44ed-95b9-7b67414706a4 admin admin] PATH_INFO: `/v3/users/36f5f4269a5d45e78af4637b4594c36a` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:19.246677 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b699526-da03-44ed-95b9-7b67414706a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36f5f4269a5d45e78af4637b4594c36a)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:19.249234 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b699526-da03-44ed-95b9-7b67414706a4 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:19.249617 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1078/2162] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:10:19.250687 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c833fe-995b-4a4e-9afc-cd3dd15f2306 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:19.269960 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c833fe-995b-4a4e-9afc-cd3dd15f2306 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:19.286200 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1220f5-96c5-4d44-b5c0-ff519d26ad40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:19.287125 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1220f5-96c5-4d44-b5c0-ff519d26ad40 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:19.287550 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1220f5-96c5-4d44-b5c0-ff519d26ad40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:19.287991 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1220f5-96c5-4d44-b5c0-ff519d26ad40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:19.288922 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1220f5-96c5-4d44-b5c0-ff519d26ad40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:10:19.289402 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1220f5-96c5-4d44-b5c0-ff519d26ad40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:19.291838 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1220f5-96c5-4d44-b5c0-ff519d26ad40 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:19.328113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1079/2163] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:10:19.334261 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1220f5-96c5-4d44-b5c0-ff519d26ad40 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:19.340545 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-8b699526-da03-44ed-95b9-7b67414706a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36f5f4269a5d45e78af4637b4594c36a'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:19.350768 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1220f5-96c5-4d44-b5c0-ff519d26ad40 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:19.372703 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-8b699526-da03-44ed-95b9-7b67414706a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36f5f4269a5d45e78af4637b4594c36a'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:19.378110 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08382301-294d-42f5-a128-6e1f8b928b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:19.378798 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08382301-294d-42f5-a128-6e1f8b928b76 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:19.379078 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08382301-294d-42f5-a128-6e1f8b928b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:19.379348 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08382301-294d-42f5-a128-6e1f8b928b76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:19.380048 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08382301-294d-42f5-a128-6e1f8b928b76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:19.381989 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08382301-294d-42f5-a128-6e1f8b928b76 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:19.399033 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-8b699526-da03-44ed-95b9-7b67414706a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36f5f4269a5d45e78af4637b4594c36a'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:19.400502 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-8b699526-da03-44ed-95b9-7b67414706a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36f5f4269a5d45e78af4637b4594c36a'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:19.422505 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1080/2164] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:10:19 2022] POST /identity/v3/projects => generated 383 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:10:19.427230 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08382301-294d-42f5-a128-6e1f8b928b76 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:19.434491 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-08382301-294d-42f5-a128-6e1f8b928b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:19.443024 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-8b699526-da03-44ed-95b9-7b67414706a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36f5f4269a5d45e78af4637b4594c36a'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:19.455303 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1085/2165] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:10:19 2022] DELETE /identity/v3/users/36f5f4269a5d45e78af4637b4594c36a => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:10:19.540729 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08382301-294d-42f5-a128-6e1f8b928b76 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:19.621387 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1639faf-dbe5-426a-b472-9ad876b05cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:19.622236 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1639faf-dbe5-426a-b472-9ad876b05cab admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:19.623209 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1639faf-dbe5-426a-b472-9ad876b05cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:19.623519 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1639faf-dbe5-426a-b472-9ad876b05cab admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:19.624234 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1639faf-dbe5-426a-b472-9ad876b05cab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:19.627326 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1639faf-dbe5-426a-b472-9ad876b05cab admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:19.664904 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1081/2166] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:10:19 2022] POST /identity/v3/users => generated 292 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:10:19.669117 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b699526-da03-44ed-95b9-7b67414706a4 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:19.683594 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b699526-da03-44ed-95b9-7b67414706a4 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:19.697102 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b17eec-f781-4059-bc24-86410d2cbd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:19.700069 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b17eec-f781-4059-bc24-86410d2cbd31 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:19.701793 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b17eec-f781-4059-bc24-86410d2cbd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:19.703117 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b17eec-f781-4059-bc24-86410d2cbd31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:19.706195 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b17eec-f781-4059-bc24-86410d2cbd31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:19.710352 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b17eec-f781-4059-bc24-86410d2cbd31 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:19.737212 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1086/2167] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:10:19.741104 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1639faf-dbe5-426a-b472-9ad876b05cab admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:19.753133 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1639faf-dbe5-426a-b472-9ad876b05cab admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:19.776903 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ed535-b8ad-4f21-ae50-25baa1dbeefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:19.777675 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ed535-b8ad-4f21-ae50-25baa1dbeefe admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:19.777902 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ed535-b8ad-4f21-ae50-25baa1dbeefe admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:19.778223 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ed535-b8ad-4f21-ae50-25baa1dbeefe admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:19.778925 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417ed535-b8ad-4f21-ae50-25baa1dbeefe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:19.780585 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417ed535-b8ad-4f21-ae50-25baa1dbeefe admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:19.807514 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1082/2168] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:10:19.813257 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b17eec-f781-4059-bc24-86410d2cbd31 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:19.831014 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b17eec-f781-4059-bc24-86410d2cbd31 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:19.850646 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fa694-96d6-41fc-961a-d93eac616292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:19.851637 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fa694-96d6-41fc-961a-d93eac616292 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:19.851848 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fa694-96d6-41fc-961a-d93eac616292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:19.852122 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fa694-96d6-41fc-961a-d93eac616292 admin admin] PATH_INFO: `/v3/projects/3f47a5832eba495e9a74266e13420ebb/users/94079d9bd7b843f09e1345a79b51e447/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:19.874902 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97fa694-96d6-41fc-961a-d93eac616292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f47a5832eba495e9a74266e13420ebb, user_id=94079d9bd7b843f09e1345a79b51e447, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:19.878640 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97fa694-96d6-41fc-961a-d93eac616292 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:19.943047 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1087/2169] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:10:19 2022] PUT /identity/v3/projects/3f47a5832eba495e9a74266e13420ebb/users/94079d9bd7b843f09e1345a79b51e447/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:10:19.949267 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0f0a0-f12e-4e0b-8fd3-c2df92a49f2f None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:19.950580 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0f0a0-f12e-4e0b-8fd3-c2df92a49f2f None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:19.953004 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0f0a0-f12e-4e0b-8fd3-c2df92a49f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:19.986062 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fa694-96d6-41fc-961a-d93eac616292 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:19.988276 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-b97fa694-96d6-41fc-961a-d93eac616292 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:20.041782 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-8ce0f0a0-f12e-4e0b-8fd3-c2df92a49f2f None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:10:20.045392 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-8ce0f0a0-f12e-4e0b-8fd3-c2df92a49f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:20.180459 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fa694-96d6-41fc-961a-d93eac616292 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:20.191994 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d67ee95-f54b-4801-a367-29a6a158c777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:20.194589 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67ee95-f54b-4801-a367-29a6a158c777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:20.195216 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67ee95-f54b-4801-a367-29a6a158c777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:20.195707 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67ee95-f54b-4801-a367-29a6a158c777 admin admin] PATH_INFO: `/v3/projects/ed7c9671268b4f6fae59cea20c79acdc` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:20.200156 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d67ee95-f54b-4801-a367-29a6a158c777 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed7c9671268b4f6fae59cea20c79acdc)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:20.207292 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d67ee95-f54b-4801-a367-29a6a158c777 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:20.216468 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1083/2170] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:10:20.227760 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0f0a0-f12e-4e0b-8fd3-c2df92a49f2f None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:20.229768 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-8ce0f0a0-f12e-4e0b-8fd3-c2df92a49f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:20.328263 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-3d67ee95-f54b-4801-a367-29a6a158c777 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed7c9671268b4f6fae59cea20c79acdc', 'request_id': 'req-3d67ee95-f54b-4801-a367-29a6a158c777'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:20.347002 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-3d67ee95-f54b-4801-a367-29a6a158c777 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed7c9671268b4f6fae59cea20c79acdc', 'request_id': 'req-3d67ee95-f54b-4801-a367-29a6a158c777'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:20.365548 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-3d67ee95-f54b-4801-a367-29a6a158c777 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed7c9671268b4f6fae59cea20c79acdc', 'request_id': 'req-3d67ee95-f54b-4801-a367-29a6a158c777'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:20.385872 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-3d67ee95-f54b-4801-a367-29a6a158c777 admin admin] The token cache is being invalidate because project ed7c9671268b4f6fae59cea20c79acdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:10:20.386602 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-3d67ee95-f54b-4801-a367-29a6a158c777 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:20.396743 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0f0a0-f12e-4e0b-8fd3-c2df92a49f2f None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:20.397760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-3d67ee95-f54b-4801-a367-29a6a158c777 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:20.403272 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1088/2171] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:10:19 2022] DELETE /identity/v3/projects/ed7c9671268b4f6fae59cea20c79acdc => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:10:20.409707 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1683f-54f6-47bc-87b7-8ded5b4b796a None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:20.410055 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1683f-54f6-47bc-87b7-8ded5b4b796a None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:20.410339 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1683f-54f6-47bc-87b7-8ded5b4b796a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:20.451483 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-a1a1683f-54f6-47bc-87b7-8ded5b4b796a None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:10:20.452815 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a1a1683f-54f6-47bc-87b7-8ded5b4b796a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:20.489919 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e0879-ab86-4d1a-8510-b8db05c7c268 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:20.491038 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e0879-ab86-4d1a-8510-b8db05c7c268 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:20.491323 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e0879-ab86-4d1a-8510-b8db05c7c268 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:20.491592 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e0879-ab86-4d1a-8510-b8db05c7c268 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:20.493578 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-594e0879-ab86-4d1a-8510-b8db05c7c268 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:20.568389 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1089/2172] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:10:20.580301 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5a60b-062b-4400-aa5d-77cd1a5c6ece None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:20.580895 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5a60b-062b-4400-aa5d-77cd1a5c6ece None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:20.584146 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5a60b-062b-4400-aa5d-77cd1a5c6ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:20.607328 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-25e5a60b-062b-4400-aa5d-77cd1a5c6ece None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:10:20.609222 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-25e5a60b-062b-4400-aa5d-77cd1a5c6ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:20.623025 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1090/2173] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:10:20.629932 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5a60b-062b-4400-aa5d-77cd1a5c6ece None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:20.650407 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e0879-ab86-4d1a-8510-b8db05c7c268 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:20.651739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5a60b-062b-4400-aa5d-77cd1a5c6ece None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:20.652276 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e0879-ab86-4d1a-8510-b8db05c7c268 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:20.665009 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94890468-fc3c-4779-8d10-303ebf4b4386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:20.665726 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94890468-fc3c-4779-8d10-303ebf4b4386 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:20.666009 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94890468-fc3c-4779-8d10-303ebf4b4386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:20.666283 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94890468-fc3c-4779-8d10-303ebf4b4386 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:20.667030 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94890468-fc3c-4779-8d10-303ebf4b4386 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:10:20.667353 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94890468-fc3c-4779-8d10-303ebf4b4386 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:20.672648 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94890468-fc3c-4779-8d10-303ebf4b4386 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:20.677598 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1084/2174] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:10:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 19:10:20.700725 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1091/2175] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:10:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:10:20.707278 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e0879-ab86-4d1a-8510-b8db05c7c268 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:20.720723 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e0879-ab86-4d1a-8510-b8db05c7c268 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:20.726402 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c10ac-dd64-4a5f-93ce-8751ef8d49d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:20.727454 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c10ac-dd64-4a5f-93ce-8751ef8d49d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:20.727743 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c10ac-dd64-4a5f-93ce-8751ef8d49d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:20.728020 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c10ac-dd64-4a5f-93ce-8751ef8d49d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:20.728794 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c10ac-dd64-4a5f-93ce-8751ef8d49d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:20.731615 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c10ac-dd64-4a5f-93ce-8751ef8d49d4 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:20.779255 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1085/2176] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:10:20 2022] POST /identity/v3/projects => generated 361 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:10:20.779416 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94890468-fc3c-4779-8d10-303ebf4b4386 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:20.794255 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94890468-fc3c-4779-8d10-303ebf4b4386 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:20.899876 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7b214-afc1-4c3f-a6db-603a136356f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:20.900564 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7b214-afc1-4c3f-a6db-603a136356f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:20.900833 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7b214-afc1-4c3f-a6db-603a136356f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:20.901107 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7b214-afc1-4c3f-a6db-603a136356f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:20.902223 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd7b214-afc1-4c3f-a6db-603a136356f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:20.904178 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd7b214-afc1-4c3f-a6db-603a136356f3 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:20.950299 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1092/2177] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:10:20 2022] POST /identity/v3/users => generated 281 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:10:20.951767 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c10ac-dd64-4a5f-93ce-8751ef8d49d4 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:20.966389 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c10ac-dd64-4a5f-93ce-8751ef8d49d4 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:20.979995 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086e54d-9a9e-4340-9e0b-10113554d28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:20.984926 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086e54d-9a9e-4340-9e0b-10113554d28b admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:20.985143 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086e54d-9a9e-4340-9e0b-10113554d28b admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:20.986201 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086e54d-9a9e-4340-9e0b-10113554d28b admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:20.988312 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4086e54d-9a9e-4340-9e0b-10113554d28b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:20.992408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4086e54d-9a9e-4340-9e0b-10113554d28b admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:21.022787 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1086/2178] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:10:21.024884 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7b214-afc1-4c3f-a6db-603a136356f3 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:21.047085 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7b214-afc1-4c3f-a6db-603a136356f3 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:21.069319 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466617f-e37c-40cc-858c-a97726b4a4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:21.070109 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466617f-e37c-40cc-858c-a97726b4a4e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:21.070404 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466617f-e37c-40cc-858c-a97726b4a4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:21.070652 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466617f-e37c-40cc-858c-a97726b4a4e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:21.071403 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466617f-e37c-40cc-858c-a97726b4a4e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:21.073175 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466617f-e37c-40cc-858c-a97726b4a4e6 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:21.106954 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1093/2179] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:10:21.108428 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086e54d-9a9e-4340-9e0b-10113554d28b admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:21.127686 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086e54d-9a9e-4340-9e0b-10113554d28b admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:21.134251 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d99c5-b896-46f6-a0c5-81c6bea1f167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:21.135249 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d99c5-b896-46f6-a0c5-81c6bea1f167 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:21.135708 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d99c5-b896-46f6-a0c5-81c6bea1f167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:21.136913 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d99c5-b896-46f6-a0c5-81c6bea1f167 admin admin] PATH_INFO: `/v3/projects/0fab2d42cead4bc9a7c3adb92f2748f3/users/10f9cdb82fae4ac4a2470235e375c306/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:21.168661 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d99c5-b896-46f6-a0c5-81c6bea1f167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fab2d42cead4bc9a7c3adb92f2748f3, user_id=10f9cdb82fae4ac4a2470235e375c306, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:21.172062 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d99c5-b896-46f6-a0c5-81c6bea1f167 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:21.205552 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1087/2180] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:10:21 2022] PUT /identity/v3/projects/0fab2d42cead4bc9a7c3adb92f2748f3/users/10f9cdb82fae4ac4a2470235e375c306/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:10:21.220436 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928dafb-1bd8-444e-9c0d-f2a2c7c501fb None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:21.221017 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928dafb-1bd8-444e-9c0d-f2a2c7c501fb None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:21.221017 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928dafb-1bd8-444e-9c0d-f2a2c7c501fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:21.264129 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d0dfd-fd8b-419e-aed0-7fd9c6a4f92e None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:21.264418 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d0dfd-fd8b-419e-aed0-7fd9c6a4f92e None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:21.264696 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d0dfd-fd8b-419e-aed0-7fd9c6a4f92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:21.288141 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-d928dafb-1bd8-444e-9c0d-f2a2c7c501fb None None] MFA Rules not processed for user `10f9cdb82fae4ac4a2470235e375c306`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:10:21.289351 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-d928dafb-1bd8-444e-9c0d-f2a2c7c501fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:21.294583 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-ac5d0dfd-fd8b-419e-aed0-7fd9c6a4f92e None None] MFA Rules not processed for user `4775e9dd7aea448d95ec7378b4ff3124`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:10:21.296541 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ac5d0dfd-fd8b-419e-aed0-7fd9c6a4f92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:21.409947 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1088/2181] 10.222.0.24 () {58 vars in 1009 bytes} [Mon May 16 19:10:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:10:21.419158 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1094/2182] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:10:21 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:10:21.449119 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d0dfd-fd8b-419e-aed0-7fd9c6a4f92e None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:21.453995 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928dafb-1bd8-444e-9c0d-f2a2c7c501fb None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:21.456214 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ac5d0dfd-fd8b-419e-aed0-7fd9c6a4f92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:21.484136 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-d928dafb-1bd8-444e-9c0d-f2a2c7c501fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:21.622955 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928dafb-1bd8-444e-9c0d-f2a2c7c501fb None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:21.639657 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401399f-bca6-43c0-8473-96233c7112b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:21.640501 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401399f-bca6-43c0-8473-96233c7112b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:21.640848 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401399f-bca6-43c0-8473-96233c7112b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:21.641184 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401399f-bca6-43c0-8473-96233c7112b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:21.706412 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d0dfd-fd8b-419e-aed0-7fd9c6a4f92e None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:21.714049 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c401399f-bca6-43c0-8473-96233c7112b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:21.719138 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c401399f-bca6-43c0-8473-96233c7112b3 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:21.728494 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f106bb-1808-418f-ba27-c9bc58a7ac69 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '654e435a35c4491eb87943734ce280f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:21.729168 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f106bb-1808-418f-ba27-c9bc58a7ac69 service swift] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:21.729440 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f106bb-1808-418f-ba27-c9bc58a7ac69 service swift] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:21.729737 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f106bb-1808-418f-ba27-c9bc58a7ac69 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:21.763487 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f106bb-1808-418f-ba27-c9bc58a7ac69 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:21.765288 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f106bb-1808-418f-ba27-c9bc58a7ac69 service swift] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:21.787596 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1095/2183] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:10:21 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:10:21.801048 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401399f-bca6-43c0-8473-96233c7112b3 service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:21.812452 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1089/2184] 10.222.0.24 () {60 vars in 1384 bytes} [Mon May 16 19:10:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 19:10:21.926048 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401399f-bca6-43c0-8473-96233c7112b3 service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:21.937997 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f63ec-f8ac-4b4b-a85c-1638dde83b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:21.940117 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f63ec-f8ac-4b4b-a85c-1638dde83b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:21.941846 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f63ec-f8ac-4b4b-a85c-1638dde83b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:21.943035 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f63ec-f8ac-4b4b-a85c-1638dde83b5f admin admin] PATH_INFO: `/v3/users/10f9cdb82fae4ac4a2470235e375c306` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:21.946550 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f63ec-f8ac-4b4b-a85c-1638dde83b5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=10f9cdb82fae4ac4a2470235e375c306)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:21.954883 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f63ec-f8ac-4b4b-a85c-1638dde83b5f admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:22.073344 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-279f63ec-f8ac-4b4b-a85c-1638dde83b5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10f9cdb82fae4ac4a2470235e375c306'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:22.091814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-279f63ec-f8ac-4b4b-a85c-1638dde83b5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10f9cdb82fae4ac4a2470235e375c306'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:22.105229 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-279f63ec-f8ac-4b4b-a85c-1638dde83b5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10f9cdb82fae4ac4a2470235e375c306'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:22.106839 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-279f63ec-f8ac-4b4b-a85c-1638dde83b5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10f9cdb82fae4ac4a2470235e375c306'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:22.149991 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-279f63ec-f8ac-4b4b-a85c-1638dde83b5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10f9cdb82fae4ac4a2470235e375c306'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:22.180102 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1096/2185] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:10:21 2022] DELETE /identity/v3/users/10f9cdb82fae4ac4a2470235e375c306 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:10:22.184890 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dee497-8e37-41bb-bc9e-ec22ae7d08b8 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:22.185413 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dee497-8e37-41bb-bc9e-ec22ae7d08b8 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:22.185955 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dee497-8e37-41bb-bc9e-ec22ae7d08b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:22.252037 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-01dee497-8e37-41bb-bc9e-ec22ae7d08b8 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:10:22.282672 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-01dee497-8e37-41bb-bc9e-ec22ae7d08b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:22.446562 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1090/2186] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:10:22.472170 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f63ec-f8ac-4b4b-a85c-1638dde83b5f admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:22.474479 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-279f63ec-f8ac-4b4b-a85c-1638dde83b5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:22.605393 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f63ec-f8ac-4b4b-a85c-1638dde83b5f admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:22.628660 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4b3ea-2c5a-480e-a54d-873b1f848adc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:22.629427 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4b3ea-2c5a-480e-a54d-873b1f848adc service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:22.629776 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4b3ea-2c5a-480e-a54d-873b1f848adc service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:22.630053 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4b3ea-2c5a-480e-a54d-873b1f848adc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:22.672291 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff4b3ea-2c5a-480e-a54d-873b1f848adc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:22.673915 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff4b3ea-2c5a-480e-a54d-873b1f848adc service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:22.709336 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1097/2187] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:10:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:10:23.067430 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da92ba-472e-45ad-a39c-fe7b19d4be6b None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:23.068239 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da92ba-472e-45ad-a39c-fe7b19d4be6b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:23.069523 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da92ba-472e-45ad-a39c-fe7b19d4be6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:23.149253 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-91da92ba-472e-45ad-a39c-fe7b19d4be6b None None] MFA Rules not processed for user `7d3af11e1ffc4ab1a37669f893d2f3be`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:10:23.150845 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-91da92ba-472e-45ad-a39c-fe7b19d4be6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:23.299793 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1091/2188] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:10:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:10:23.518246 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5e5c3-5b7a-43af-918d-e3bef4942aac None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:23.518808 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5e5c3-5b7a-43af-918d-e3bef4942aac None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:23.518808 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5e5c3-5b7a-43af-918d-e3bef4942aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:23.580149 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-c0d5e5c3-5b7a-43af-918d-e3bef4942aac None None] MFA Rules not processed for user `94079d9bd7b843f09e1345a79b51e447`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:10:23.581387 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-c0d5e5c3-5b7a-43af-918d-e3bef4942aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:23.705524 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1098/2189] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:10:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:10:23.718692 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da92ba-472e-45ad-a39c-fe7b19d4be6b None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:23.720350 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-91da92ba-472e-45ad-a39c-fe7b19d4be6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:23.766767 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5e5c3-5b7a-43af-918d-e3bef4942aac None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:23.768245 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-c0d5e5c3-5b7a-43af-918d-e3bef4942aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:23.790047 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5e5c3-5b7a-43af-918d-e3bef4942aac None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:23.805710 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ed5f1-ca4f-4896-b773-deb2c689e4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:23.808829 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ed5f1-ca4f-4896-b773-deb2c689e4f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:23.808829 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ed5f1-ca4f-4896-b773-deb2c689e4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:23.808829 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ed5f1-ca4f-4896-b773-deb2c689e4f4 admin admin] PATH_INFO: `/v3/projects/0fab2d42cead4bc9a7c3adb92f2748f3` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:23.813656 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4ed5f1-ca4f-4896-b773-deb2c689e4f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fab2d42cead4bc9a7c3adb92f2748f3)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:23.817855 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4ed5f1-ca4f-4896-b773-deb2c689e4f4 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:23.872056 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da92ba-472e-45ad-a39c-fe7b19d4be6b None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:23.882095 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630d4d3-e02d-4c80-90bb-0b2c52a130d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:23.884943 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630d4d3-e02d-4c80-90bb-0b2c52a130d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:23.885369 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630d4d3-e02d-4c80-90bb-0b2c52a130d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:23.887936 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630d4d3-e02d-4c80-90bb-0b2c52a130d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:23.915030 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630d4d3-e02d-4c80-90bb-0b2c52a130d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:23.917515 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630d4d3-e02d-4c80-90bb-0b2c52a130d1 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:23.939081 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ee4ed5f1-ca4f-4896-b773-deb2c689e4f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fab2d42cead4bc9a7c3adb92f2748f3', 'request_id': 'req-ee4ed5f1-ca4f-4896-b773-deb2c689e4f4'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:23.945237 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1092/2190] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:10:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:10:23.956364 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ee4ed5f1-ca4f-4896-b773-deb2c689e4f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fab2d42cead4bc9a7c3adb92f2748f3', 'request_id': 'req-ee4ed5f1-ca4f-4896-b773-deb2c689e4f4'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:23.976259 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ee4ed5f1-ca4f-4896-b773-deb2c689e4f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fab2d42cead4bc9a7c3adb92f2748f3', 'request_id': 'req-ee4ed5f1-ca4f-4896-b773-deb2c689e4f4'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:24.002742 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ee4ed5f1-ca4f-4896-b773-deb2c689e4f4 admin admin] The token cache is being invalidate because project 0fab2d42cead4bc9a7c3adb92f2748f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:10:24.003333 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ee4ed5f1-ca4f-4896-b773-deb2c689e4f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:24.004589 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ee4ed5f1-ca4f-4896-b773-deb2c689e4f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:24.009732 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1099/2191] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:10:23 2022] DELETE /identity/v3/projects/0fab2d42cead4bc9a7c3adb92f2748f3 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:10:24.016467 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7e85d-1c6c-4f37-bf34-dab0196d6ab9 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:24.016747 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7e85d-1c6c-4f37-bf34-dab0196d6ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:24.017090 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7e85d-1c6c-4f37-bf34-dab0196d6ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:24.053676 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-13e7e85d-1c6c-4f37-bf34-dab0196d6ab9 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:10:24.055021 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-13e7e85d-1c6c-4f37-bf34-dab0196d6ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:24.173445 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1093/2192] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:10:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:10:24.181222 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffc958-93da-407c-a0af-8cb36689fa86 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:24.181605 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffc958-93da-407c-a0af-8cb36689fa86 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:24.182422 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffc958-93da-407c-a0af-8cb36689fa86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:24.230519 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-7bffc958-93da-407c-a0af-8cb36689fa86 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:10:24.235075 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-7bffc958-93da-407c-a0af-8cb36689fa86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:24.263794 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1100/2193] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:10:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:10:24.268602 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7e85d-1c6c-4f37-bf34-dab0196d6ab9 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:24.279856 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7e85d-1c6c-4f37-bf34-dab0196d6ab9 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:24.298361 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd804af5-1f9b-4ef3-85bc-188ca099c096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:24.300209 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd804af5-1f9b-4ef3-85bc-188ca099c096 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:24.301428 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd804af5-1f9b-4ef3-85bc-188ca099c096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:24.302915 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd804af5-1f9b-4ef3-85bc-188ca099c096 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:24.304048 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd804af5-1f9b-4ef3-85bc-188ca099c096 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:10:24.304923 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd804af5-1f9b-4ef3-85bc-188ca099c096 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:24.308150 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd804af5-1f9b-4ef3-85bc-188ca099c096 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:24.350125 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1094/2194] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:10:24.353236 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffc958-93da-407c-a0af-8cb36689fa86 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:24.392584 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffc958-93da-407c-a0af-8cb36689fa86 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:24.404418 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56ef34-5fac-42f6-a4d2-6cac80641e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:24.405660 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56ef34-5fac-42f6-a4d2-6cac80641e5d admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:24.406190 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56ef34-5fac-42f6-a4d2-6cac80641e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:24.418360 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56ef34-5fac-42f6-a4d2-6cac80641e5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:24.421764 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae56ef34-5fac-42f6-a4d2-6cac80641e5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:24.424087 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae56ef34-5fac-42f6-a4d2-6cac80641e5d admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:24.497440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1101/2195] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:10:24 2022] POST /identity/v3/projects => generated 373 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:10:24.503067 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd804af5-1f9b-4ef3-85bc-188ca099c096 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:24.533620 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd804af5-1f9b-4ef3-85bc-188ca099c096 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:24.664830 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96ef62-aba2-48e2-bf0b-ee98ba1190ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:24.665907 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96ef62-aba2-48e2-bf0b-ee98ba1190ad admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:24.666565 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96ef62-aba2-48e2-bf0b-ee98ba1190ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:24.667048 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96ef62-aba2-48e2-bf0b-ee98ba1190ad admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:24.667975 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96ef62-aba2-48e2-bf0b-ee98ba1190ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:24.672211 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96ef62-aba2-48e2-bf0b-ee98ba1190ad admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:24.731105 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1095/2196] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:10:24 2022] POST /identity/v3/users => generated 287 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:10:24.735659 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56ef34-5fac-42f6-a4d2-6cac80641e5d admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:24.755240 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56ef34-5fac-42f6-a4d2-6cac80641e5d admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:24.771357 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c23fc-6aa8-47de-ac11-10bb562006a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:24.773977 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c23fc-6aa8-47de-ac11-10bb562006a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:24.775354 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c23fc-6aa8-47de-ac11-10bb562006a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:24.776626 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c23fc-6aa8-47de-ac11-10bb562006a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:24.779395 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c23fc-6aa8-47de-ac11-10bb562006a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:24.787277 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c23fc-6aa8-47de-ac11-10bb562006a2 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:24.825307 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1102/2197] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:10:24.829296 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96ef62-aba2-48e2-bf0b-ee98ba1190ad admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:24.845062 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96ef62-aba2-48e2-bf0b-ee98ba1190ad admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:24.857849 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a1d2b-62bb-4398-bace-7b2568f0e9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:24.859921 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a1d2b-62bb-4398-bace-7b2568f0e9bd admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:24.860623 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a1d2b-62bb-4398-bace-7b2568f0e9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:24.860951 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a1d2b-62bb-4398-bace-7b2568f0e9bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:24.861887 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863a1d2b-62bb-4398-bace-7b2568f0e9bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:24.864080 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863a1d2b-62bb-4398-bace-7b2568f0e9bd admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:25.005740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1096/2198] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:10:25.006077 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c23fc-6aa8-47de-ac11-10bb562006a2 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:25.048311 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c23fc-6aa8-47de-ac11-10bb562006a2 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:25.055878 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602473b5-b285-490c-96bc-2826000168ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:25.057097 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602473b5-b285-490c-96bc-2826000168ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:25.069779 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602473b5-b285-490c-96bc-2826000168ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:25.074799 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602473b5-b285-490c-96bc-2826000168ac admin admin] PATH_INFO: `/v3/projects/5e758da8d71142bdbac8765efccefde8/users/16afce4f51384e37b381171cbc2e0a82/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:25.119050 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602473b5-b285-490c-96bc-2826000168ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e758da8d71142bdbac8765efccefde8, user_id=16afce4f51384e37b381171cbc2e0a82, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:25.134292 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602473b5-b285-490c-96bc-2826000168ac admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:25.165147 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1103/2199] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:10:24 2022] PUT /identity/v3/projects/5e758da8d71142bdbac8765efccefde8/users/16afce4f51384e37b381171cbc2e0a82/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:10:25.170309 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ff3fd-ce33-41f7-9a9f-b8d25c713571 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:25.170594 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ff3fd-ce33-41f7-9a9f-b8d25c713571 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:25.171401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ff3fd-ce33-41f7-9a9f-b8d25c713571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:25.232125 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-570ff3fd-ce33-41f7-9a9f-b8d25c713571 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:10:25.234551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-570ff3fd-ce33-41f7-9a9f-b8d25c713571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:25.370061 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1097/2200] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:10:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:10:25.382661 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602473b5-b285-490c-96bc-2826000168ac admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:25.384519 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-602473b5-b285-490c-96bc-2826000168ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:25.478552 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602473b5-b285-490c-96bc-2826000168ac admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:25.504153 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df8f3f-0bf2-4448-b145-e7b840ca99fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:25.505953 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df8f3f-0bf2-4448-b145-e7b840ca99fd service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:25.506771 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df8f3f-0bf2-4448-b145-e7b840ca99fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:25.507115 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df8f3f-0bf2-4448-b145-e7b840ca99fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:25.539647 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df8f3f-0bf2-4448-b145-e7b840ca99fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:25.543737 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df8f3f-0bf2-4448-b145-e7b840ca99fd service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:25.598455 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1104/2201] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:10:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:10:25.635826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dca031-544f-40d9-8aa7-ec0daefdb322 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:25.636250 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dca031-544f-40d9-8aa7-ec0daefdb322 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:25.636629 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dca031-544f-40d9-8aa7-ec0daefdb322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:25.668481 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-c3dca031-544f-40d9-8aa7-ec0daefdb322 None None] MFA Rules not processed for user `94079d9bd7b843f09e1345a79b51e447`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:10:25.673589 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c3dca031-544f-40d9-8aa7-ec0daefdb322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:25.846028 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1098/2202] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:10:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:10:32.821022 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5ca80-5f83-4e8a-a963-604bce96facb None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:32.821665 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5ca80-5f83-4e8a-a963-604bce96facb None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:32.821665 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5ca80-5f83-4e8a-a963-604bce96facb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:32.912395 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-aec5ca80-5f83-4e8a-a963-604bce96facb None None] MFA Rules not processed for user `4775e9dd7aea448d95ec7378b4ff3124`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:10:32.913657 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-aec5ca80-5f83-4e8a-a963-604bce96facb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:33.119435 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1105/2203] 10.222.0.24 () {58 vars in 967 bytes} [Mon May 16 19:10:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:10:33.174705 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dca031-544f-40d9-8aa7-ec0daefdb322 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:33.180459 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c3dca031-544f-40d9-8aa7-ec0daefdb322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:33.418694 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dca031-544f-40d9-8aa7-ec0daefdb322 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:33.435259 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a3d18-9195-480b-a3f0-363f3a3a5ed7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '654e435a35c4491eb87943734ce280f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:33.435937 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a3d18-9195-480b-a3f0-363f3a3a5ed7 service swift] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:33.436475 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a3d18-9195-480b-a3f0-363f3a3a5ed7 service swift] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:33.436805 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a3d18-9195-480b-a3f0-363f3a3a5ed7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:33.458533 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a3d18-9195-480b-a3f0-363f3a3a5ed7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:33.460180 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a3d18-9195-480b-a3f0-363f3a3a5ed7 service swift] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:33.493912 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1099/2204] 10.222.0.24 () {60 vars in 1384 bytes} [Mon May 16 19:10:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 19:10:34.282340 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fef144-7653-4200-9c26-86a8fefee6d2 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:34.282813 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fef144-7653-4200-9c26-86a8fefee6d2 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:34.282929 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fef144-7653-4200-9c26-86a8fefee6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:34.354952 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-b2fef144-7653-4200-9c26-86a8fefee6d2 None None] MFA Rules not processed for user `16afce4f51384e37b381171cbc2e0a82`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:10:34.371955 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-b2fef144-7653-4200-9c26-86a8fefee6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:34.569212 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1106/2205] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:10:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:10:34.572048 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a3d18-9195-480b-a3f0-363f3a3a5ed7 service swift] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:34.587882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a3d18-9195-480b-a3f0-363f3a3a5ed7 service swift] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:34.608729 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f010792-3f24-4b6e-9bf4-ed5777154573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:34.611180 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f010792-3f24-4b6e-9bf4-ed5777154573 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:34.611779 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f010792-3f24-4b6e-9bf4-ed5777154573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:34.612762 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f010792-3f24-4b6e-9bf4-ed5777154573 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:34.613875 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f010792-3f24-4b6e-9bf4-ed5777154573 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:34.616766 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f010792-3f24-4b6e-9bf4-ed5777154573 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:34.694671 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1100/2206] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:10:34 2022] POST /identity/v3/projects => generated 371 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:10:34.697576 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fef144-7653-4200-9c26-86a8fefee6d2 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:34.710738 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fef144-7653-4200-9c26-86a8fefee6d2 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:34.775328 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3ba04-21fe-487e-9903-2b0d0034753e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:34.776409 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3ba04-21fe-487e-9903-2b0d0034753e admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:34.776751 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3ba04-21fe-487e-9903-2b0d0034753e admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:34.777259 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3ba04-21fe-487e-9903-2b0d0034753e admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:34.777896 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa3ba04-21fe-487e-9903-2b0d0034753e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:34.780551 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa3ba04-21fe-487e-9903-2b0d0034753e admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:34.806418 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1107/2207] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:10:34 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:10:34.810422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f010792-3f24-4b6e-9bf4-ed5777154573 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:34.842792 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f010792-3f24-4b6e-9bf4-ed5777154573 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:34.849748 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4697c3-fe87-453d-8b92-98d88a7294f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:34.852283 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4697c3-fe87-453d-8b92-98d88a7294f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:34.852859 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4697c3-fe87-453d-8b92-98d88a7294f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:34.860707 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4697c3-fe87-453d-8b92-98d88a7294f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:34.862209 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4697c3-fe87-453d-8b92-98d88a7294f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:34.866456 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4697c3-fe87-453d-8b92-98d88a7294f7 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:34.883745 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1101/2208] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:10:34.884879 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3ba04-21fe-487e-9903-2b0d0034753e admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:34.899303 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3ba04-21fe-487e-9903-2b0d0034753e admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:34.911805 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52da0d-d8d1-4e9f-bde9-8926f196f509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:34.913547 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52da0d-d8d1-4e9f-bde9-8926f196f509 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:34.914173 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52da0d-d8d1-4e9f-bde9-8926f196f509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:34.915458 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52da0d-d8d1-4e9f-bde9-8926f196f509 admin admin] PATH_INFO: `/v3/projects/83f09aa01b714c549f44f03f652089bd/users/254bc90f1c7a4fa6b9e593fef63f44cf/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:34.952175 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52da0d-d8d1-4e9f-bde9-8926f196f509 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83f09aa01b714c549f44f03f652089bd, user_id=254bc90f1c7a4fa6b9e593fef63f44cf, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:34.971314 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52da0d-d8d1-4e9f-bde9-8926f196f509 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:34.989676 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1108/2209] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:10:34 2022] PUT /identity/v3/projects/83f09aa01b714c549f44f03f652089bd/users/254bc90f1c7a4fa6b9e593fef63f44cf/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:10:34.993760 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4697c3-fe87-453d-8b92-98d88a7294f7 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:35.007687 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4697c3-fe87-453d-8b92-98d88a7294f7 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:35.113224 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e163034-1fde-485a-aaef-b0b62f957c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:35.114203 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e163034-1fde-485a-aaef-b0b62f957c39 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:35.114576 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e163034-1fde-485a-aaef-b0b62f957c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:35.114957 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e163034-1fde-485a-aaef-b0b62f957c39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:35.115810 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e163034-1fde-485a-aaef-b0b62f957c39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:35.117565 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e163034-1fde-485a-aaef-b0b62f957c39 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:35.137030 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1102/2210] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:10:35.141441 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52da0d-d8d1-4e9f-bde9-8926f196f509 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:35.156536 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52da0d-d8d1-4e9f-bde9-8926f196f509 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:35.171185 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc3908-fdc0-4e56-842d-c161490b6905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:35.172180 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc3908-fdc0-4e56-842d-c161490b6905 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:35.172614 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc3908-fdc0-4e56-842d-c161490b6905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:35.172906 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc3908-fdc0-4e56-842d-c161490b6905 admin admin] PATH_INFO: `/v3/projects/83f09aa01b714c549f44f03f652089bd/users/254bc90f1c7a4fa6b9e593fef63f44cf/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:35.176624 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc3908-fdc0-4e56-842d-c161490b6905 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83f09aa01b714c549f44f03f652089bd, user_id=254bc90f1c7a4fa6b9e593fef63f44cf, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:35.187792 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc3908-fdc0-4e56-842d-c161490b6905 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:35.227903 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1109/2211] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:10:35 2022] PUT /identity/v3/projects/83f09aa01b714c549f44f03f652089bd/users/254bc90f1c7a4fa6b9e593fef63f44cf/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:10:36.851865 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e163034-1fde-485a-aaef-b0b62f957c39 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:36.854865 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5e163034-1fde-485a-aaef-b0b62f957c39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:36.878041 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e163034-1fde-485a-aaef-b0b62f957c39 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:36.969070 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfed2c-1d15-4336-a8dd-545bb611628a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:36.970336 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfed2c-1d15-4336-a8dd-545bb611628a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:36.970764 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfed2c-1d15-4336-a8dd-545bb611628a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:36.971046 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfed2c-1d15-4336-a8dd-545bb611628a admin admin] PATH_INFO: `/v3/users/c8ac79259d304d589aa1e529849bfcbe` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:36.972317 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbfed2c-1d15-4336-a8dd-545bb611628a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8ac79259d304d589aa1e529849bfcbe)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:36.975790 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbfed2c-1d15-4336-a8dd-545bb611628a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:37.109444 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4fbfed2c-1d15-4336-a8dd-545bb611628a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8ac79259d304d589aa1e529849bfcbe'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:37.128122 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4fbfed2c-1d15-4336-a8dd-545bb611628a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8ac79259d304d589aa1e529849bfcbe'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:37.149140 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4fbfed2c-1d15-4336-a8dd-545bb611628a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8ac79259d304d589aa1e529849bfcbe'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:37.176286 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4fbfed2c-1d15-4336-a8dd-545bb611628a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8ac79259d304d589aa1e529849bfcbe'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:37.178050 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4fbfed2c-1d15-4336-a8dd-545bb611628a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8ac79259d304d589aa1e529849bfcbe'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:37.190020 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1103/2212] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:10:36 2022] DELETE /identity/v3/users/c8ac79259d304d589aa1e529849bfcbe => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:10:37.957776 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc3908-fdc0-4e56-842d-c161490b6905 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:37.959783 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-23dc3908-fdc0-4e56-842d-c161490b6905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:37.987806 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc3908-fdc0-4e56-842d-c161490b6905 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:38.125938 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73cf5ee-f139-470a-80fc-d1d129f341ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:38.126830 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cf5ee-f139-470a-80fc-d1d129f341ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:38.127110 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cf5ee-f139-470a-80fc-d1d129f341ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:38.127381 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cf5ee-f139-470a-80fc-d1d129f341ed admin admin] PATH_INFO: `/v3/projects/f7b9188e991a4a7bb57c8a5beb3fb278` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:38.128783 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73cf5ee-f139-470a-80fc-d1d129f341ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7b9188e991a4a7bb57c8a5beb3fb278)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:38.130772 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73cf5ee-f139-470a-80fc-d1d129f341ed admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:38.241871 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-d73cf5ee-f139-470a-80fc-d1d129f341ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7b9188e991a4a7bb57c8a5beb3fb278', 'request_id': 'req-d73cf5ee-f139-470a-80fc-d1d129f341ed'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:38.261061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-d73cf5ee-f139-470a-80fc-d1d129f341ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7b9188e991a4a7bb57c8a5beb3fb278', 'request_id': 'req-d73cf5ee-f139-470a-80fc-d1d129f341ed'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:38.271483 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-d73cf5ee-f139-470a-80fc-d1d129f341ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7b9188e991a4a7bb57c8a5beb3fb278', 'request_id': 'req-d73cf5ee-f139-470a-80fc-d1d129f341ed'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:38.290147 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-d73cf5ee-f139-470a-80fc-d1d129f341ed admin admin] The token cache is being invalidate because project f7b9188e991a4a7bb57c8a5beb3fb278 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:10:38.290723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-d73cf5ee-f139-470a-80fc-d1d129f341ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:38.291472 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-d73cf5ee-f139-470a-80fc-d1d129f341ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:38.293608 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1110/2213] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:10:37 2022] DELETE /identity/v3/projects/f7b9188e991a4a7bb57c8a5beb3fb278 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:10:38.299327 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c40e76-e581-4d77-af0d-0ae5e9c6636b None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:38.299847 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c40e76-e581-4d77-af0d-0ae5e9c6636b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:38.299847 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c40e76-e581-4d77-af0d-0ae5e9c6636b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:38.340762 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-28c40e76-e581-4d77-af0d-0ae5e9c6636b None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:10:38.341726 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-28c40e76-e581-4d77-af0d-0ae5e9c6636b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:38.451365 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1104/2214] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:10:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:10:38.459464 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973bca3-57e5-49fe-a08e-f97b305e35aa None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:38.460041 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973bca3-57e5-49fe-a08e-f97b305e35aa None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:38.460407 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973bca3-57e5-49fe-a08e-f97b305e35aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:38.503958 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-b973bca3-57e5-49fe-a08e-f97b305e35aa None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:10:38.505361 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-b973bca3-57e5-49fe-a08e-f97b305e35aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:38.538246 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1111/2215] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:10:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:10:38.539566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c40e76-e581-4d77-af0d-0ae5e9c6636b None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:38.556510 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c40e76-e581-4d77-af0d-0ae5e9c6636b None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:38.567181 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb3849-fd75-4d28-83f5-efd0456c10dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:38.567707 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb3849-fd75-4d28-83f5-efd0456c10dd admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:38.567999 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb3849-fd75-4d28-83f5-efd0456c10dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:38.568281 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb3849-fd75-4d28-83f5-efd0456c10dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:38.569131 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb3849-fd75-4d28-83f5-efd0456c10dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:10:38.570131 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb3849-fd75-4d28-83f5-efd0456c10dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:38.572391 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb3849-fd75-4d28-83f5-efd0456c10dd admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:38.610366 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1105/2216] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 19:10:38.614997 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973bca3-57e5-49fe-a08e-f97b305e35aa None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:38.633654 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973bca3-57e5-49fe-a08e-f97b305e35aa None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:38.642623 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ec047-9d19-412d-9dfd-653ed6704a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:38.644689 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ec047-9d19-412d-9dfd-653ed6704a3e admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:38.644993 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ec047-9d19-412d-9dfd-653ed6704a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:38.645359 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ec047-9d19-412d-9dfd-653ed6704a3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:38.646279 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ec047-9d19-412d-9dfd-653ed6704a3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:38.648277 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ec047-9d19-412d-9dfd-653ed6704a3e admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:38.713646 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1112/2217] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:10:38 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:10:38.715360 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb3849-fd75-4d28-83f5-efd0456c10dd admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:38.796596 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb3849-fd75-4d28-83f5-efd0456c10dd admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:38.967302 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c44727-4e0a-429c-9918-e4aebf1f85f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:38.968280 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c44727-4e0a-429c-9918-e4aebf1f85f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:38.968714 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c44727-4e0a-429c-9918-e4aebf1f85f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:38.969246 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c44727-4e0a-429c-9918-e4aebf1f85f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:38.970280 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c44727-4e0a-429c-9918-e4aebf1f85f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:38.977573 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c44727-4e0a-429c-9918-e4aebf1f85f2 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:39.052361 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ec047-9d19-412d-9dfd-653ed6704a3e admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:39.052920 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1106/2218] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:10:38 2022] POST /identity/v3/users => generated 287 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:10:39.064728 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ec047-9d19-412d-9dfd-653ed6704a3e admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:39.074631 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b4b1f-bd3f-4213-b5e0-610f142a6a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:39.075619 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b4b1f-bd3f-4213-b5e0-610f142a6a13 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:39.076168 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b4b1f-bd3f-4213-b5e0-610f142a6a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:39.076644 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b4b1f-bd3f-4213-b5e0-610f142a6a13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:39.077426 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b4b1f-bd3f-4213-b5e0-610f142a6a13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:39.081601 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b4b1f-bd3f-4213-b5e0-610f142a6a13 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:39.098056 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1113/2219] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:10:39.102006 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c44727-4e0a-429c-9918-e4aebf1f85f2 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:39.125685 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c44727-4e0a-429c-9918-e4aebf1f85f2 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:39.132773 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19caa9-7384-4075-a54a-5eff739c94dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:39.133521 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19caa9-7384-4075-a54a-5eff739c94dc admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:39.133850 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19caa9-7384-4075-a54a-5eff739c94dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:39.134127 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19caa9-7384-4075-a54a-5eff739c94dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:39.134875 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c19caa9-7384-4075-a54a-5eff739c94dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:39.139383 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c19caa9-7384-4075-a54a-5eff739c94dc admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:39.186002 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1107/2220] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:10:39.191590 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b4b1f-bd3f-4213-b5e0-610f142a6a13 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:39.213589 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b4b1f-bd3f-4213-b5e0-610f142a6a13 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:39.223158 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7cb88-abc8-4101-ae5e-af8979e2fc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:39.224067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7cb88-abc8-4101-ae5e-af8979e2fc8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:39.224350 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7cb88-abc8-4101-ae5e-af8979e2fc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:39.224623 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7cb88-abc8-4101-ae5e-af8979e2fc8e admin admin] PATH_INFO: `/v3/projects/9b4a2e2575904cd1a3810f6748d0309d/users/3d6cdb5f52ab4aa59762774f490018ce/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:39.287971 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7cb88-abc8-4101-ae5e-af8979e2fc8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b4a2e2575904cd1a3810f6748d0309d, user_id=3d6cdb5f52ab4aa59762774f490018ce, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:39.292082 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7cb88-abc8-4101-ae5e-af8979e2fc8e admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:39.335475 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1114/2221] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:10:39 2022] PUT /identity/v3/projects/9b4a2e2575904cd1a3810f6748d0309d/users/3d6cdb5f52ab4aa59762774f490018ce/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:10:39.346535 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff6648-bde0-4696-9fc0-387008b7a0c9 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:39.349489 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff6648-bde0-4696-9fc0-387008b7a0c9 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:39.350047 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff6648-bde0-4696-9fc0-387008b7a0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:39.396116 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-a7ff6648-bde0-4696-9fc0-387008b7a0c9 None None] MFA Rules not processed for user `3d6cdb5f52ab4aa59762774f490018ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:10:39.397920 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a7ff6648-bde0-4696-9fc0-387008b7a0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:39.500263 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1108/2222] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:10:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:10:39.514937 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7cb88-abc8-4101-ae5e-af8979e2fc8e admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:39.516706 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-0bc7cb88-abc8-4101-ae5e-af8979e2fc8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:39.690138 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7cb88-abc8-4101-ae5e-af8979e2fc8e admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:39.696623 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a24d4-7e25-44d4-be3a-2f10b7d8868c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:39.697563 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a24d4-7e25-44d4-be3a-2f10b7d8868c service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:39.698003 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a24d4-7e25-44d4-be3a-2f10b7d8868c service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:39.698319 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a24d4-7e25-44d4-be3a-2f10b7d8868c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:39.712622 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a24d4-7e25-44d4-be3a-2f10b7d8868c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:39.715064 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a24d4-7e25-44d4-be3a-2f10b7d8868c service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:39.745203 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1115/2223] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:10:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:10:39.795742 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff6648-bde0-4696-9fc0-387008b7a0c9 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:39.926866 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff6648-bde0-4696-9fc0-387008b7a0c9 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:39.932200 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f45535-59a4-4f8f-9fb3-8f0a02d8c009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:39.933367 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f45535-59a4-4f8f-9fb3-8f0a02d8c009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:39.933834 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f45535-59a4-4f8f-9fb3-8f0a02d8c009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:39.934281 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f45535-59a4-4f8f-9fb3-8f0a02d8c009 admin admin] PATH_INFO: `/v3/users/3d6cdb5f52ab4aa59762774f490018ce` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:39.938343 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f45535-59a4-4f8f-9fb3-8f0a02d8c009 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d6cdb5f52ab4aa59762774f490018ce)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:39.940976 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f45535-59a4-4f8f-9fb3-8f0a02d8c009 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:40.029111 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-71f45535-59a4-4f8f-9fb3-8f0a02d8c009 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d6cdb5f52ab4aa59762774f490018ce'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:40.039962 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-71f45535-59a4-4f8f-9fb3-8f0a02d8c009 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d6cdb5f52ab4aa59762774f490018ce'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:40.065013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-71f45535-59a4-4f8f-9fb3-8f0a02d8c009 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d6cdb5f52ab4aa59762774f490018ce'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:40.120016 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-71f45535-59a4-4f8f-9fb3-8f0a02d8c009 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d6cdb5f52ab4aa59762774f490018ce'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:40.123284 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-71f45535-59a4-4f8f-9fb3-8f0a02d8c009 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d6cdb5f52ab4aa59762774f490018ce'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:40.135870 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1109/2224] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:10:39 2022] DELETE /identity/v3/users/3d6cdb5f52ab4aa59762774f490018ce => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:10:40.140632 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf82c1-a42a-46ea-aeed-0f7d7e4d57da None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:40.142028 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf82c1-a42a-46ea-aeed-0f7d7e4d57da None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:40.143896 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf82c1-a42a-46ea-aeed-0f7d7e4d57da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:40.167625 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-abbf82c1-a42a-46ea-aeed-0f7d7e4d57da None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:10:40.209392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-abbf82c1-a42a-46ea-aeed-0f7d7e4d57da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:40.421428 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1116/2225] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:10:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:10:40.504185 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f45535-59a4-4f8f-9fb3-8f0a02d8c009 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:40.511420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-71f45535-59a4-4f8f-9fb3-8f0a02d8c009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:40.669764 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f45535-59a4-4f8f-9fb3-8f0a02d8c009 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:40.674867 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8e713-2d2c-479f-888b-19caade02d43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:40.675833 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8e713-2d2c-479f-888b-19caade02d43 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:40.676417 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8e713-2d2c-479f-888b-19caade02d43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:40.677033 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8e713-2d2c-479f-888b-19caade02d43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:40.690577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f8e713-2d2c-479f-888b-19caade02d43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:40.692809 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f8e713-2d2c-479f-888b-19caade02d43 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:40.706059 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1110/2226] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:10:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:10:40.773682 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e7387-154c-49b4-a513-7d739d46093e None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:40.774301 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e7387-154c-49b4-a513-7d739d46093e None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:40.774761 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e7387-154c-49b4-a513-7d739d46093e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:40.807406 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-8e6e7387-154c-49b4-a513-7d739d46093e None None] MFA Rules not processed for user `4775e9dd7aea448d95ec7378b4ff3124`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:10:40.810769 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-8e6e7387-154c-49b4-a513-7d739d46093e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:40.964399 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1117/2227] 10.222.0.24 () {58 vars in 1009 bytes} [Mon May 16 19:10:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:10:40.985056 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8e713-2d2c-479f-888b-19caade02d43 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:40.986912 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-49f8e713-2d2c-479f-888b-19caade02d43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:41.144864 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8e713-2d2c-479f-888b-19caade02d43 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:41.164201 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1e68c-8edb-419d-a92a-804437b15459 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '654e435a35c4491eb87943734ce280f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:41.170893 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1e68c-8edb-419d-a92a-804437b15459 service swift] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:41.171303 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1e68c-8edb-419d-a92a-804437b15459 service swift] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:41.171578 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1e68c-8edb-419d-a92a-804437b15459 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:41.182115 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c1e68c-8edb-419d-a92a-804437b15459 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:41.183936 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c1e68c-8edb-419d-a92a-804437b15459 service swift] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:41.197897 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1111/2228] 10.222.0.24 () {60 vars in 1384 bytes} [Mon May 16 19:10:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 19:10:41.675456 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e7387-154c-49b4-a513-7d739d46093e None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:41.680122 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-8e6e7387-154c-49b4-a513-7d739d46093e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:41.699208 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e7387-154c-49b4-a513-7d739d46093e None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:41.709581 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62117d95-9bcb-4b7a-993d-0c1cd678cb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:41.711020 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62117d95-9bcb-4b7a-993d-0c1cd678cb77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:41.711497 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62117d95-9bcb-4b7a-993d-0c1cd678cb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:41.712086 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62117d95-9bcb-4b7a-993d-0c1cd678cb77 admin admin] PATH_INFO: `/v3/projects/9b4a2e2575904cd1a3810f6748d0309d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:41.714120 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62117d95-9bcb-4b7a-993d-0c1cd678cb77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b4a2e2575904cd1a3810f6748d0309d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:41.719536 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62117d95-9bcb-4b7a-993d-0c1cd678cb77 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:41.921981 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-62117d95-9bcb-4b7a-993d-0c1cd678cb77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b4a2e2575904cd1a3810f6748d0309d', 'request_id': 'req-62117d95-9bcb-4b7a-993d-0c1cd678cb77'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:41.960943 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-62117d95-9bcb-4b7a-993d-0c1cd678cb77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b4a2e2575904cd1a3810f6748d0309d', 'request_id': 'req-62117d95-9bcb-4b7a-993d-0c1cd678cb77'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:41.984717 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-62117d95-9bcb-4b7a-993d-0c1cd678cb77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b4a2e2575904cd1a3810f6748d0309d', 'request_id': 'req-62117d95-9bcb-4b7a-993d-0c1cd678cb77'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:42.017598 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-62117d95-9bcb-4b7a-993d-0c1cd678cb77 admin admin] The token cache is being invalidate because project 9b4a2e2575904cd1a3810f6748d0309d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:10:42.018073 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-62117d95-9bcb-4b7a-993d-0c1cd678cb77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:42.019492 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-62117d95-9bcb-4b7a-993d-0c1cd678cb77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:42.026911 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1118/2229] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:10:41 2022] DELETE /identity/v3/projects/9b4a2e2575904cd1a3810f6748d0309d => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:10:42.027953 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a42792-acef-4ee4-a571-f032dc61dc8e None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:42.028490 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a42792-acef-4ee4-a571-f032dc61dc8e None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:42.028748 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a42792-acef-4ee4-a571-f032dc61dc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:42.115906 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-42a42792-acef-4ee4-a571-f032dc61dc8e None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:10:42.117173 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-42a42792-acef-4ee4-a571-f032dc61dc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:42.287381 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1112/2230] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:10:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:10:42.296036 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2289d62-d043-4b2c-89ad-38dfea4343c8 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:42.296452 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2289d62-d043-4b2c-89ad-38dfea4343c8 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:42.296747 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2289d62-d043-4b2c-89ad-38dfea4343c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:42.331202 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-f2289d62-d043-4b2c-89ad-38dfea4343c8 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:10:42.333035 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f2289d62-d043-4b2c-89ad-38dfea4343c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:42.356597 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1119/2231] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:10:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:10:42.358290 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a42792-acef-4ee4-a571-f032dc61dc8e None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:42.371075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a42792-acef-4ee4-a571-f032dc61dc8e None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:42.388510 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2894b79-e144-4759-bb34-5b598e97c951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:42.397993 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2894b79-e144-4759-bb34-5b598e97c951 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:42.398798 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2894b79-e144-4759-bb34-5b598e97c951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:42.404728 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2894b79-e144-4759-bb34-5b598e97c951 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:42.406898 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2894b79-e144-4759-bb34-5b598e97c951 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:10:42.407424 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2894b79-e144-4759-bb34-5b598e97c951 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:42.416113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2894b79-e144-4759-bb34-5b598e97c951 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:42.453987 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1113/2232] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:10:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:10:42.455412 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2289d62-d043-4b2c-89ad-38dfea4343c8 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:42.465239 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2289d62-d043-4b2c-89ad-38dfea4343c8 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:42.481255 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267e56f-1a36-4df8-b7ef-b47193e53667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:42.482267 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267e56f-1a36-4df8-b7ef-b47193e53667 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:42.482823 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267e56f-1a36-4df8-b7ef-b47193e53667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:42.483783 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267e56f-1a36-4df8-b7ef-b47193e53667 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:42.484950 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8267e56f-1a36-4df8-b7ef-b47193e53667 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:42.487528 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8267e56f-1a36-4df8-b7ef-b47193e53667 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:42.535606 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1120/2233] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:10:42 2022] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:10:42.540804 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2894b79-e144-4759-bb34-5b598e97c951 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:42.555434 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2894b79-e144-4759-bb34-5b598e97c951 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:42.741074 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd484db1-2abb-4b06-8418-219034efa0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:42.741949 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd484db1-2abb-4b06-8418-219034efa0da admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:42.742180 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd484db1-2abb-4b06-8418-219034efa0da admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:42.742442 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd484db1-2abb-4b06-8418-219034efa0da admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:42.743147 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd484db1-2abb-4b06-8418-219034efa0da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:42.749326 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd484db1-2abb-4b06-8418-219034efa0da admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:42.794153 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1114/2234] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:10:42 2022] POST /identity/v3/users => generated 287 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:10:42.798207 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267e56f-1a36-4df8-b7ef-b47193e53667 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:42.822764 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267e56f-1a36-4df8-b7ef-b47193e53667 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:42.843724 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc448f3-ba58-4b08-8597-93000eb8dd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:42.844418 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc448f3-ba58-4b08-8597-93000eb8dd70 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:42.844695 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc448f3-ba58-4b08-8597-93000eb8dd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:42.844981 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc448f3-ba58-4b08-8597-93000eb8dd70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:42.845742 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc448f3-ba58-4b08-8597-93000eb8dd70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:42.847378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc448f3-ba58-4b08-8597-93000eb8dd70 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:42.876207 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1121/2235] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:10:42.878412 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd484db1-2abb-4b06-8418-219034efa0da admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:42.896994 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd484db1-2abb-4b06-8418-219034efa0da admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:42.915598 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737681b-c012-49ea-bb31-6ea85dd4dad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:42.916595 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737681b-c012-49ea-bb31-6ea85dd4dad2 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:42.916986 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737681b-c012-49ea-bb31-6ea85dd4dad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:42.918407 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737681b-c012-49ea-bb31-6ea85dd4dad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:42.919274 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5737681b-c012-49ea-bb31-6ea85dd4dad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:42.925866 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5737681b-c012-49ea-bb31-6ea85dd4dad2 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:42.948566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1115/2236] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 19:10:42.953549 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc448f3-ba58-4b08-8597-93000eb8dd70 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:42.980032 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc448f3-ba58-4b08-8597-93000eb8dd70 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:42.997249 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a6966-2873-4e31-9300-6c15d29e72ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:42.998773 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a6966-2873-4e31-9300-6c15d29e72ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:42.999549 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a6966-2873-4e31-9300-6c15d29e72ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:43.001908 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a6966-2873-4e31-9300-6c15d29e72ac admin admin] PATH_INFO: `/v3/projects/f861981125164bcd93c9ec5c8bd14995/users/f16f808696964a3bb3e077c6ec822b32/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:43.044443 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a6966-2873-4e31-9300-6c15d29e72ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=f861981125164bcd93c9ec5c8bd14995, user_id=f16f808696964a3bb3e077c6ec822b32, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:43.047463 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a6966-2873-4e31-9300-6c15d29e72ac admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:43.080977 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1122/2237] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:10:42 2022] PUT /identity/v3/projects/f861981125164bcd93c9ec5c8bd14995/users/f16f808696964a3bb3e077c6ec822b32/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:10:43.102277 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e28c9-1dbd-452b-9468-f52e2d85593b None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:43.103755 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e28c9-1dbd-452b-9468-f52e2d85593b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:43.104766 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e28c9-1dbd-452b-9468-f52e2d85593b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:43.230044 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-ff5e28c9-1dbd-452b-9468-f52e2d85593b None None] MFA Rules not processed for user `f16f808696964a3bb3e077c6ec822b32`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:10:43.231347 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ff5e28c9-1dbd-452b-9468-f52e2d85593b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:43.389702 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1116/2238] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:10:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:10:43.401141 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a6966-2873-4e31-9300-6c15d29e72ac admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:43.403811 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-516a6966-2873-4e31-9300-6c15d29e72ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:43.608026 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a6966-2873-4e31-9300-6c15d29e72ac admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:43.621113 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a39ae5-7b1a-4245-ada2-3290b70dee8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:43.622017 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a39ae5-7b1a-4245-ada2-3290b70dee8a service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:43.622377 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a39ae5-7b1a-4245-ada2-3290b70dee8a service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:43.622735 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a39ae5-7b1a-4245-ada2-3290b70dee8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:43.644569 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a39ae5-7b1a-4245-ada2-3290b70dee8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:43.646156 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a39ae5-7b1a-4245-ada2-3290b70dee8a service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:43.666847 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1123/2239] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:10:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:10:49.769668 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c627621-ed11-41ac-abf3-637bc63e149e None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:49.770226 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c627621-ed11-41ac-abf3-637bc63e149e None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:49.770593 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c627621-ed11-41ac-abf3-637bc63e149e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:49.836624 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-9c627621-ed11-41ac-abf3-637bc63e149e None None] MFA Rules not processed for user `254bc90f1c7a4fa6b9e593fef63f44cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:10:49.838137 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9c627621-ed11-41ac-abf3-637bc63e149e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:50.100379 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1117/2240] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:10:49 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:10:50.113965 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a39ae5-7b1a-4245-ada2-3290b70dee8a service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:50.116505 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-91a39ae5-7b1a-4245-ada2-3290b70dee8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:50.335515 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a39ae5-7b1a-4245-ada2-3290b70dee8a service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:50.346899 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195135b-d1e1-4256-8d28-674d7275863b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:50.347802 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195135b-d1e1-4256-8d28-674d7275863b service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:50.348264 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195135b-d1e1-4256-8d28-674d7275863b service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:50.348688 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195135b-d1e1-4256-8d28-674d7275863b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:50.353493 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-d195135b-d1e1-4256-8d28-674d7275863b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:50.513268 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d195135b-d1e1-4256-8d28-674d7275863b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:50.515455 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d195135b-d1e1-4256-8d28-674d7275863b service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:50.537186 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1124/2241] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:10:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:10:53.054760 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6706a6c-a382-4890-8912-7b71041ceacf None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:53.055284 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6706a6c-a382-4890-8912-7b71041ceacf None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:53.055512 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6706a6c-a382-4890-8912-7b71041ceacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:53.104321 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-b6706a6c-a382-4890-8912-7b71041ceacf None None] MFA Rules not processed for user `16afce4f51384e37b381171cbc2e0a82`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:10:53.106153 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b6706a6c-a382-4890-8912-7b71041ceacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:53.139996 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1118/2242] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:10:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:10:56.114009 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700de06-b744-4748-ba9d-74bcf24c8376 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:56.115072 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700de06-b744-4748-ba9d-74bcf24c8376 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:56.115561 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700de06-b744-4748-ba9d-74bcf24c8376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:56.152496 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-7700de06-b744-4748-ba9d-74bcf24c8376 None None] MFA Rules not processed for user `1673e91c8910435499a5d587f4ef59f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:10:56.154592 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-7700de06-b744-4748-ba9d-74bcf24c8376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:56.234965 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1125/2243] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:10:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:10:58.436949 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6706a6c-a382-4890-8912-7b71041ceacf None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:58.518935 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6706a6c-a382-4890-8912-7b71041ceacf None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:58.530253 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13466033-65e3-447a-b14a-2a9a6f8f8a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:58.531541 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13466033-65e3-447a-b14a-2a9a6f8f8a7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:58.532060 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13466033-65e3-447a-b14a-2a9a6f8f8a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:58.532538 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13466033-65e3-447a-b14a-2a9a6f8f8a7f admin admin] PATH_INFO: `/v3/users/f16f808696964a3bb3e077c6ec822b32` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:58.534036 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13466033-65e3-447a-b14a-2a9a6f8f8a7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f16f808696964a3bb3e077c6ec822b32)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:58.536286 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13466033-65e3-447a-b14a-2a9a6f8f8a7f admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:58.611971 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-13466033-65e3-447a-b14a-2a9a6f8f8a7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f16f808696964a3bb3e077c6ec822b32'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:58.621053 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-13466033-65e3-447a-b14a-2a9a6f8f8a7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f16f808696964a3bb3e077c6ec822b32'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:58.631005 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-13466033-65e3-447a-b14a-2a9a6f8f8a7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f16f808696964a3bb3e077c6ec822b32'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:58.645464 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-13466033-65e3-447a-b14a-2a9a6f8f8a7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f16f808696964a3bb3e077c6ec822b32'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:58.646402 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-13466033-65e3-447a-b14a-2a9a6f8f8a7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f16f808696964a3bb3e077c6ec822b32'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:58.655897 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1119/2244] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:10:58 2022] DELETE /identity/v3/users/f16f808696964a3bb3e077c6ec822b32 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:10:58.657637 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a18068-f398-476c-ba42-6aa3ae365ed2 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:58.658166 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a18068-f398-476c-ba42-6aa3ae365ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:58.658166 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a18068-f398-476c-ba42-6aa3ae365ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:58.675976 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-c6a18068-f398-476c-ba42-6aa3ae365ed2 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:10:58.677154 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-c6a18068-f398-476c-ba42-6aa3ae365ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:58.758982 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1126/2245] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:10:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:10:58.768774 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13466033-65e3-447a-b14a-2a9a6f8f8a7f admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:58.770275 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-13466033-65e3-447a-b14a-2a9a6f8f8a7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:58.831555 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13466033-65e3-447a-b14a-2a9a6f8f8a7f admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:58.835827 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f55e8-d887-4404-be76-c3e782386467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:58.836495 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f55e8-d887-4404-be76-c3e782386467 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:58.837226 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f55e8-d887-4404-be76-c3e782386467 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:58.837509 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f55e8-d887-4404-be76-c3e782386467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:58.848302 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60f55e8-d887-4404-be76-c3e782386467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:58.849789 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60f55e8-d887-4404-be76-c3e782386467 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:58.859824 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1120/2246] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:10:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:10:59.506447 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a18068-f398-476c-ba42-6aa3ae365ed2 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:10:59.509066 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-c6a18068-f398-476c-ba42-6aa3ae365ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:59.557929 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a18068-f398-476c-ba42-6aa3ae365ed2 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:10:59.597260 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f051f-5e00-476e-bb30-740691a91cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:10:59.598204 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f051f-5e00-476e-bb30-740691a91cf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:59.598553 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f051f-5e00-476e-bb30-740691a91cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:59.598840 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f051f-5e00-476e-bb30-740691a91cf1 admin admin] PATH_INFO: `/v3/projects/f861981125164bcd93c9ec5c8bd14995` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:59.605154 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f051f-5e00-476e-bb30-740691a91cf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f861981125164bcd93c9ec5c8bd14995)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:10:59.609237 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f051f-5e00-476e-bb30-740691a91cf1 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:10:59.773459 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-417f051f-5e00-476e-bb30-740691a91cf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f861981125164bcd93c9ec5c8bd14995', 'request_id': 'req-417f051f-5e00-476e-bb30-740691a91cf1'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:59.796925 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-417f051f-5e00-476e-bb30-740691a91cf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f861981125164bcd93c9ec5c8bd14995', 'request_id': 'req-417f051f-5e00-476e-bb30-740691a91cf1'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:59.815715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-417f051f-5e00-476e-bb30-740691a91cf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f861981125164bcd93c9ec5c8bd14995', 'request_id': 'req-417f051f-5e00-476e-bb30-740691a91cf1'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:59.844918 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-417f051f-5e00-476e-bb30-740691a91cf1 admin admin] The token cache is being invalidate because project f861981125164bcd93c9ec5c8bd14995 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:10:59.845443 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-417f051f-5e00-476e-bb30-740691a91cf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:59.846637 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-417f051f-5e00-476e-bb30-740691a91cf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:10:59.849061 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1127/2247] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:10:59 2022] DELETE /identity/v3/projects/f861981125164bcd93c9ec5c8bd14995 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:10:59.855646 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92a1ef-933f-4fb5-869e-c92b2915c133 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:59.856142 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92a1ef-933f-4fb5-869e-c92b2915c133 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:59.856267 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92a1ef-933f-4fb5-869e-c92b2915c133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:10:59.892189 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-4d92a1ef-933f-4fb5-869e-c92b2915c133 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:10:59.893663 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4d92a1ef-933f-4fb5-869e-c92b2915c133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:10:59.976780 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1121/2248] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:10:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:10:59.985146 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737bcca9-dfc4-4870-a12e-394b7b4465d7 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:10:59.985964 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737bcca9-dfc4-4870-a12e-394b7b4465d7 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:10:59.986788 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737bcca9-dfc4-4870-a12e-394b7b4465d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:11:00.010182 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-737bcca9-dfc4-4870-a12e-394b7b4465d7 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:11:00.011530 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-737bcca9-dfc4-4870-a12e-394b7b4465d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:11:00.021415 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1128/2249] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:10:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:11:00.025870 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92a1ef-933f-4fb5-869e-c92b2915c133 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:11:00.035834 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92a1ef-933f-4fb5-869e-c92b2915c133 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:11:00.040496 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e246d8-2382-47e6-aa03-1e9a48f3e4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:11:00.041171 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e246d8-2382-47e6-aa03-1e9a48f3e4ec admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:11:00.041462 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e246d8-2382-47e6-aa03-1e9a48f3e4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:11:00.041767 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e246d8-2382-47e6-aa03-1e9a48f3e4ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:11:00.042503 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e246d8-2382-47e6-aa03-1e9a48f3e4ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:11:00.042813 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e246d8-2382-47e6-aa03-1e9a48f3e4ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:11:00.044478 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e246d8-2382-47e6-aa03-1e9a48f3e4ec admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:11:00.059190 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1122/2250] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:11:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:11:00.063970 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737bcca9-dfc4-4870-a12e-394b7b4465d7 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:11:00.073502 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737bcca9-dfc4-4870-a12e-394b7b4465d7 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:11:00.078543 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5cb22-28c6-454d-b14e-6cb0857e884e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:11:00.079206 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5cb22-28c6-454d-b14e-6cb0857e884e admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:11:00.079489 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5cb22-28c6-454d-b14e-6cb0857e884e admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:11:00.079768 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5cb22-28c6-454d-b14e-6cb0857e884e admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:11:00.083194 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df5cb22-28c6-454d-b14e-6cb0857e884e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:11:00.083194 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df5cb22-28c6-454d-b14e-6cb0857e884e admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:11:00.114508 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1129/2251] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:11:00 2022] POST /identity/v3/projects => generated 389 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:11:00.118948 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e246d8-2382-47e6-aa03-1e9a48f3e4ec admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:11:00.130265 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e246d8-2382-47e6-aa03-1e9a48f3e4ec admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:11:00.188702 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2671f0b-144c-49ff-8df8-1230462e90e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:11:00.189444 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2671f0b-144c-49ff-8df8-1230462e90e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:11:00.189769 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2671f0b-144c-49ff-8df8-1230462e90e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:11:00.190040 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2671f0b-144c-49ff-8df8-1230462e90e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:11:00.190750 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2671f0b-144c-49ff-8df8-1230462e90e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:11:00.192687 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2671f0b-144c-49ff-8df8-1230462e90e0 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:11:00.218060 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1123/2252] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:11:00 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:11:00.219861 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5cb22-28c6-454d-b14e-6cb0857e884e admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:11:00.231196 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5cb22-28c6-454d-b14e-6cb0857e884e admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:11:00.235933 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fdf521-60a8-4ec4-9141-7acb3dbcb6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:11:00.236629 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fdf521-60a8-4ec4-9141-7acb3dbcb6a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:11:00.236907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fdf521-60a8-4ec4-9141-7acb3dbcb6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:11:00.237301 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fdf521-60a8-4ec4-9141-7acb3dbcb6a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:11:00.238078 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fdf521-60a8-4ec4-9141-7acb3dbcb6a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:11:00.239705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fdf521-60a8-4ec4-9141-7acb3dbcb6a2 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:11:00.250673 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1130/2253] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:11:00.254778 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2671f0b-144c-49ff-8df8-1230462e90e0 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:11:00.265554 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2671f0b-144c-49ff-8df8-1230462e90e0 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:11:00.270534 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f5b82-15c5-425a-8a1b-da77d82ef81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:11:00.271202 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f5b82-15c5-425a-8a1b-da77d82ef81c admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:11:00.271484 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f5b82-15c5-425a-8a1b-da77d82ef81c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:11:00.273771 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f5b82-15c5-425a-8a1b-da77d82ef81c admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:11:00.274563 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f5b82-15c5-425a-8a1b-da77d82ef81c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:11:00.276505 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f5b82-15c5-425a-8a1b-da77d82ef81c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:11:00.289790 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1124/2254] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 19:11:00.291362 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fdf521-60a8-4ec4-9141-7acb3dbcb6a2 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:11:00.303001 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fdf521-60a8-4ec4-9141-7acb3dbcb6a2 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:11:00.307687 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd4e98-61a2-4dbd-927b-981f0e64e89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:11:00.308833 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd4e98-61a2-4dbd-927b-981f0e64e89e admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:11:00.309114 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd4e98-61a2-4dbd-927b-981f0e64e89e admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:11:00.309387 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd4e98-61a2-4dbd-927b-981f0e64e89e admin admin] PATH_INFO: `/v3/projects/ee44f41bd5c9401984200a3f66257b4e/users/ba5b6312b1db4af5ae4de2462fef5e5a/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:11:00.324057 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fd4e98-61a2-4dbd-927b-981f0e64e89e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee44f41bd5c9401984200a3f66257b4e, user_id=ba5b6312b1db4af5ae4de2462fef5e5a, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:11:00.327145 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fd4e98-61a2-4dbd-927b-981f0e64e89e admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:11:00.341931 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1131/2255] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:11:00 2022] PUT /identity/v3/projects/ee44f41bd5c9401984200a3f66257b4e/users/ba5b6312b1db4af5ae4de2462fef5e5a/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:11:00.419700 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5ff97-7391-4990-b650-92205498b550 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:11:00.420275 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5ff97-7391-4990-b650-92205498b550 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:11:00.420761 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5ff97-7391-4990-b650-92205498b550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:11:00.449323 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-6bf5ff97-7391-4990-b650-92205498b550 None None] MFA Rules not processed for user `ba5b6312b1db4af5ae4de2462fef5e5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:11:00.450874 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6bf5ff97-7391-4990-b650-92205498b550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:11:00.528155 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1125/2256] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:11:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:11:00.540111 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd4e98-61a2-4dbd-927b-981f0e64e89e admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:11:00.542097 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a8fd4e98-61a2-4dbd-927b-981f0e64e89e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:11:00.627067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd4e98-61a2-4dbd-927b-981f0e64e89e admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:11:00.631517 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8683d3a-9d98-45bb-b720-5553c1a02054 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:11:00.632278 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8683d3a-9d98-45bb-b720-5553c1a02054 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:11:00.632575 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8683d3a-9d98-45bb-b720-5553c1a02054 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:11:00.632840 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8683d3a-9d98-45bb-b720-5553c1a02054 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:11:00.641699 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8683d3a-9d98-45bb-b720-5553c1a02054 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:11:00.643137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8683d3a-9d98-45bb-b720-5553c1a02054 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:11:00.653476 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1132/2257] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:11:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:11:06.035749 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5ff97-7391-4990-b650-92205498b550 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:11:06.037476 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8683d3a-9d98-45bb-b720-5553c1a02054 service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:11:06.039407 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6bf5ff97-7391-4990-b650-92205498b550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:11:06.042923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-e8683d3a-9d98-45bb-b720-5553c1a02054 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:11:06.199723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8683d3a-9d98-45bb-b720-5553c1a02054 service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:11:06.208691 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c627cb7-ad96-4350-a6e2-1336d5edc682 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '629742b135b2447898e8291d9a360295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:11:06.209442 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c627cb7-ad96-4350-a6e2-1336d5edc682 service placement] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:11:06.209809 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c627cb7-ad96-4350-a6e2-1336d5edc682 service placement] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:11:06.210105 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c627cb7-ad96-4350-a6e2-1336d5edc682 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:11:06.212022 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-2c627cb7-ad96-4350-a6e2-1336d5edc682 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:11:06.220556 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5ff97-7391-4990-b650-92205498b550 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:11:06.232169 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c30365-6b44-458b-9931-7e4ff437c643 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '629742b135b2447898e8291d9a360295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:11:06.232508 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c627cb7-ad96-4350-a6e2-1336d5edc682 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:11:06.232960 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c30365-6b44-458b-9931-7e4ff437c643 service placement] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:11:06.233135 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c30365-6b44-458b-9931-7e4ff437c643 service placement] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:11:06.233471 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c30365-6b44-458b-9931-7e4ff437c643 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:11:06.235029 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c627cb7-ad96-4350-a6e2-1336d5edc682 service placement] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:11:06.242751 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c30365-6b44-458b-9931-7e4ff437c643 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:11:06.244292 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c30365-6b44-458b-9931-7e4ff437c643 service placement] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:11:06.253187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1133/2258] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:11:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:11:06.257151 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1126/2259] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:11:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:11:07.781779 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619b130-caea-44a7-ada1-6ac2131b1f82 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:11:07.783444 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619b130-caea-44a7-ada1-6ac2131b1f82 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:11:07.783988 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619b130-caea-44a7-ada1-6ac2131b1f82 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:11:07.789715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1134/2260] 10.222.0.24 () {54 vars in 921 bytes} [Mon May 16 19:11:07 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:11:07.795805 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eaf291-65ef-4d52-8a03-5d7914fbb218 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:11:07.796351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eaf291-65ef-4d52-8a03-5d7914fbb218 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:11:07.796466 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eaf291-65ef-4d52-8a03-5d7914fbb218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:11:07.835458 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-19eaf291-65ef-4d52-8a03-5d7914fbb218 None None] MFA Rules not processed for user `1f03aa520ee14615b802cdbc3cd4f87d`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:11:07.836690 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-19eaf291-65ef-4d52-8a03-5d7914fbb218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:11:07.913353 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1127/2261] 10.222.0.24 () {58 vars in 1018 bytes} [Mon May 16 19:11:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:11:07.932558 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1619b130-caea-44a7-ada1-6ac2131b1f82 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:11:07.934712 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-1619b130-caea-44a7-ada1-6ac2131b1f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:11:08.023067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1619b130-caea-44a7-ada1-6ac2131b1f82 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:11:08.027030 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf44a4e-8e29-4f80-bc5b-09bb23efb692 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dfa8e8908804c0e8908e2a8c6b377e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:11:08.027677 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf44a4e-8e29-4f80-bc5b-09bb23efb692 service glance] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:11:08.027959 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf44a4e-8e29-4f80-bc5b-09bb23efb692 service glance] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:11:08.028240 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf44a4e-8e29-4f80-bc5b-09bb23efb692 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:11:08.038264 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf44a4e-8e29-4f80-bc5b-09bb23efb692 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:11:08.039712 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf44a4e-8e29-4f80-bc5b-09bb23efb692 service glance] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:11:08.050556 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1135/2262] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:11:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:11:08.122950 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa8c8c-4c6c-45a6-83aa-cb7a63fe0f82 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:11:08.123168 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa8c8c-4c6c-45a6-83aa-cb7a63fe0f82 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:11:08.123407 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa8c8c-4c6c-45a6-83aa-cb7a63fe0f82 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:11:08.124899 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1128/2263] 10.222.0.24 () {54 vars in 921 bytes} [Mon May 16 19:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:11:08.130210 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22141b23-785c-4ffa-86c1-6ab11f2a6310 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:11:08.130502 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22141b23-785c-4ffa-86c1-6ab11f2a6310 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:11:08.130779 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22141b23-785c-4ffa-86c1-6ab11f2a6310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:11:08.152507 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-22141b23-785c-4ffa-86c1-6ab11f2a6310 None None] MFA Rules not processed for user `ee9e8d17cf1648e0b650df48b8f9487a`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:11:08.153945 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-22141b23-785c-4ffa-86c1-6ab11f2a6310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:11:08.211535 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1136/2264] 10.222.0.24 () {58 vars in 1018 bytes} [Mon May 16 19:11:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:11:08.224099 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa8c8c-4c6c-45a6-83aa-cb7a63fe0f82 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:11:08.226060 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-33aa8c8c-4c6c-45a6-83aa-cb7a63fe0f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:11:08.239205 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa8c8c-4c6c-45a6-83aa-cb7a63fe0f82 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:11:08.242875 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c200c-07e1-4981-b8d4-3e7748ce0650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:11:08.243521 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c200c-07e1-4981-b8d4-3e7748ce0650 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:11:08.243797 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c200c-07e1-4981-b8d4-3e7748ce0650 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:11:08.244067 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c200c-07e1-4981-b8d4-3e7748ce0650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:11:08.251139 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0c200c-07e1-4981-b8d4-3e7748ce0650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:11:08.252575 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0c200c-07e1-4981-b8d4-3e7748ce0650 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:11:08.260284 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1129/2265] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:11:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:11:08.345195 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279063c8-2a34-4b78-9752-f85874e69f9f None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:11:08.345482 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279063c8-2a34-4b78-9752-f85874e69f9f None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:11:08.345790 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279063c8-2a34-4b78-9752-f85874e69f9f None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:11:08.347351 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1137/2266] 10.222.0.24 () {54 vars in 921 bytes} [Mon May 16 19:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:11:08.352247 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374946e1-232b-443b-9e42-9030490d589b None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:11:08.352609 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374946e1-232b-443b-9e42-9030490d589b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:11:08.352975 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374946e1-232b-443b-9e42-9030490d589b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:11:08.371178 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-374946e1-232b-443b-9e42-9030490d589b None None] MFA Rules not processed for user `1f03aa520ee14615b802cdbc3cd4f87d`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:11:08.372396 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-374946e1-232b-443b-9e42-9030490d589b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:11:08.381771 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1130/2267] 10.222.0.24 () {58 vars in 1018 bytes} [Mon May 16 19:11:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:11:08.392658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279063c8-2a34-4b78-9752-f85874e69f9f None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:11:08.394396 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-279063c8-2a34-4b78-9752-f85874e69f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:11:08.409658 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279063c8-2a34-4b78-9752-f85874e69f9f None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:11:08.413586 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d46803-6084-4868-be71-fed0410b9fd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:11:08.414352 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d46803-6084-4868-be71-fed0410b9fd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:11:08.414634 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d46803-6084-4868-be71-fed0410b9fd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:11:08.414907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d46803-6084-4868-be71-fed0410b9fd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:11:08.427678 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d46803-6084-4868-be71-fed0410b9fd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:11:08.429172 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d46803-6084-4868-be71-fed0410b9fd7 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:11:08.440511 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1138/2268] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:11:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:11:10.749190 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374946e1-232b-443b-9e42-9030490d589b None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:11:10.759451 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374946e1-232b-443b-9e42-9030490d589b None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:11:10.763369 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912eaea3-9284-42de-804d-874e33efbcd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:11:10.764014 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912eaea3-9284-42de-804d-874e33efbcd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:11:10.764286 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912eaea3-9284-42de-804d-874e33efbcd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:11:10.766179 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912eaea3-9284-42de-804d-874e33efbcd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:11:10.768627 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-912eaea3-9284-42de-804d-874e33efbcd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:11:10.862340 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912eaea3-9284-42de-804d-874e33efbcd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:11:10.863734 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912eaea3-9284-42de-804d-874e33efbcd8 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:11:10.874334 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1131/2269] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:11:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:11:20.143397 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d46803-6084-4868-be71-fed0410b9fd7 service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:11:20.214461 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d46803-6084-4868-be71-fed0410b9fd7 service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:11:20.219251 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426ae1d-9c4b-47bd-9289-8e5dc212a109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:11:20.220159 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426ae1d-9c4b-47bd-9289-8e5dc212a109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:11:20.220497 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426ae1d-9c4b-47bd-9289-8e5dc212a109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:11:20.220771 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426ae1d-9c4b-47bd-9289-8e5dc212a109 admin admin] PATH_INFO: `/v3/users/ba5b6312b1db4af5ae4de2462fef5e5a` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:11:20.222012 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426ae1d-9c4b-47bd-9289-8e5dc212a109 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba5b6312b1db4af5ae4de2462fef5e5a)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:11:20.224017 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426ae1d-9c4b-47bd-9289-8e5dc212a109 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:11:20.271832 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a426ae1d-9c4b-47bd-9289-8e5dc212a109 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba5b6312b1db4af5ae4de2462fef5e5a'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:11:20.282885 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a426ae1d-9c4b-47bd-9289-8e5dc212a109 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba5b6312b1db4af5ae4de2462fef5e5a'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:11:20.290518 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a426ae1d-9c4b-47bd-9289-8e5dc212a109 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba5b6312b1db4af5ae4de2462fef5e5a'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:11:20.291171 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a426ae1d-9c4b-47bd-9289-8e5dc212a109 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba5b6312b1db4af5ae4de2462fef5e5a'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:11:20.315128 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a426ae1d-9c4b-47bd-9289-8e5dc212a109 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba5b6312b1db4af5ae4de2462fef5e5a'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:11:20.322516 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1139/2270] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:11:20 2022] DELETE /identity/v3/users/ba5b6312b1db4af5ae4de2462fef5e5a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:11:20.326873 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96365e1c-9e6f-4ac7-a4ea-7e2af7f8d361 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:11:20.327356 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96365e1c-9e6f-4ac7-a4ea-7e2af7f8d361 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:11:20.327452 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96365e1c-9e6f-4ac7-a4ea-7e2af7f8d361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:11:20.347160 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-96365e1c-9e6f-4ac7-a4ea-7e2af7f8d361 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:11:20.348479 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-96365e1c-9e6f-4ac7-a4ea-7e2af7f8d361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:11:20.418911 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1132/2271] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:11:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:11:20.428545 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426ae1d-9c4b-47bd-9289-8e5dc212a109 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:11:20.430517 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a426ae1d-9c4b-47bd-9289-8e5dc212a109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:11:20.506180 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426ae1d-9c4b-47bd-9289-8e5dc212a109 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:11:20.510248 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253930d3-bfad-439a-ada8-de8a3f629408 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:11:20.511115 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253930d3-bfad-439a-ada8-de8a3f629408 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:11:20.511476 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253930d3-bfad-439a-ada8-de8a3f629408 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:11:20.511846 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253930d3-bfad-439a-ada8-de8a3f629408 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:11:20.521239 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253930d3-bfad-439a-ada8-de8a3f629408 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:11:20.522714 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253930d3-bfad-439a-ada8-de8a3f629408 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:11:20.532417 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1140/2272] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:11:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:11:20.806820 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96365e1c-9e6f-4ac7-a4ea-7e2af7f8d361 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:11:20.808487 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-96365e1c-9e6f-4ac7-a4ea-7e2af7f8d361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:11:20.825662 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96365e1c-9e6f-4ac7-a4ea-7e2af7f8d361 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:11:20.831425 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f3eaa-a189-4e74-acb4-d56df72aed0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:11:20.833284 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f3eaa-a189-4e74-acb4-d56df72aed0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:11:20.834133 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f3eaa-a189-4e74-acb4-d56df72aed0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:11:20.834414 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f3eaa-a189-4e74-acb4-d56df72aed0a admin admin] PATH_INFO: `/v3/projects/ee44f41bd5c9401984200a3f66257b4e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:11:20.835796 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f3eaa-a189-4e74-acb4-d56df72aed0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee44f41bd5c9401984200a3f66257b4e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:11:20.839878 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f3eaa-a189-4e74-acb4-d56df72aed0a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:11:20.895621 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-561f3eaa-a189-4e74-acb4-d56df72aed0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee44f41bd5c9401984200a3f66257b4e', 'request_id': 'req-561f3eaa-a189-4e74-acb4-d56df72aed0a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:11:20.903790 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-561f3eaa-a189-4e74-acb4-d56df72aed0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee44f41bd5c9401984200a3f66257b4e', 'request_id': 'req-561f3eaa-a189-4e74-acb4-d56df72aed0a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:11:20.909963 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-561f3eaa-a189-4e74-acb4-d56df72aed0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee44f41bd5c9401984200a3f66257b4e', 'request_id': 'req-561f3eaa-a189-4e74-acb4-d56df72aed0a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:11:20.922792 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-561f3eaa-a189-4e74-acb4-d56df72aed0a admin admin] The token cache is being invalidate because project ee44f41bd5c9401984200a3f66257b4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:11:20.923096 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-561f3eaa-a189-4e74-acb4-d56df72aed0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:11:20.924335 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-561f3eaa-a189-4e74-acb4-d56df72aed0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:11:20.929648 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1133/2273] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:11:20 2022] DELETE /identity/v3/projects/ee44f41bd5c9401984200a3f66257b4e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:11:22.804239 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538581b-7969-4dfd-bab2-7e0918d115d3 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:11:22.804774 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538581b-7969-4dfd-bab2-7e0918d115d3 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:11:22.804774 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538581b-7969-4dfd-bab2-7e0918d115d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:11:22.855311 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-0538581b-7969-4dfd-bab2-7e0918d115d3 None None] MFA Rules not processed for user `4775e9dd7aea448d95ec7378b4ff3124`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:11:22.856560 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-0538581b-7969-4dfd-bab2-7e0918d115d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:11:22.925774 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1141/2274] 10.222.0.24 () {58 vars in 1009 bytes} [Mon May 16 19:11:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:11:22.938244 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f3eaa-a189-4e74-acb4-d56df72aed0a admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:11:22.939689 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-561f3eaa-a189-4e74-acb4-d56df72aed0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:11:23.037019 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f3eaa-a189-4e74-acb4-d56df72aed0a admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:11:23.042158 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36758330-17e7-4233-b2d3-410475e540e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '654e435a35c4491eb87943734ce280f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:11:23.042818 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36758330-17e7-4233-b2d3-410475e540e3 service swift] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:11:23.043100 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36758330-17e7-4233-b2d3-410475e540e3 service swift] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:11:23.043377 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36758330-17e7-4233-b2d3-410475e540e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:11:23.051587 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36758330-17e7-4233-b2d3-410475e540e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:11:23.053183 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36758330-17e7-4233-b2d3-410475e540e3 service swift] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:11:23.062202 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1134/2275] 10.222.0.24 () {60 vars in 1384 bytes} [Mon May 16 19:11:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 19:11:51.146580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebddf8b-74cc-46fb-959f-0424e8f0696a None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:11:51.147509 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebddf8b-74cc-46fb-959f-0424e8f0696a None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:11:51.147820 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebddf8b-74cc-46fb-959f-0424e8f0696a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:11:51.171239 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-eebddf8b-74cc-46fb-959f-0424e8f0696a None None] MFA Rules not processed for user `4775e9dd7aea448d95ec7378b4ff3124`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:11:51.172508 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-eebddf8b-74cc-46fb-959f-0424e8f0696a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:11:51.197838 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1142/2276] 10.222.0.24 () {58 vars in 967 bytes} [Mon May 16 19:11:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:11:51.218298 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36758330-17e7-4233-b2d3-410475e540e3 service swift] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:11:51.230129 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36758330-17e7-4233-b2d3-410475e540e3 service swift] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:11:51.235581 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b015bb-06d2-4719-8bb9-902bd6b4c6a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '654e435a35c4491eb87943734ce280f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:11:51.236495 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b015bb-06d2-4719-8bb9-902bd6b4c6a7 service swift] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:11:51.236777 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b015bb-06d2-4719-8bb9-902bd6b4c6a7 service swift] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:11:51.237053 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b015bb-06d2-4719-8bb9-902bd6b4c6a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:11:51.246324 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b015bb-06d2-4719-8bb9-902bd6b4c6a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:11:51.248172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b015bb-06d2-4719-8bb9-902bd6b4c6a7 service swift] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:11:51.257384 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1135/2277] 10.222.0.24 () {60 vars in 1384 bytes} [Mon May 16 19:11:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 19:12:02.894608 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebddf8b-74cc-46fb-959f-0424e8f0696a None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:12:02.896203 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-eebddf8b-74cc-46fb-959f-0424e8f0696a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:12:02.954279 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebddf8b-74cc-46fb-959f-0424e8f0696a None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:12:02.958390 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af787284-b675-4071-b0af-8aa60c16f0ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:12:02.959395 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af787284-b675-4071-b0af-8aa60c16f0ed service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:12:02.959692 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af787284-b675-4071-b0af-8aa60c16f0ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:12:02.959959 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af787284-b675-4071-b0af-8aa60c16f0ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:12:02.962070 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-af787284-b675-4071-b0af-8aa60c16f0ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:12:03.032317 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af787284-b675-4071-b0af-8aa60c16f0ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:12:03.033971 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af787284-b675-4071-b0af-8aa60c16f0ed service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:12:03.043974 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1143/2278] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:12:02 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:12:19.036449 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b03d4-5cc3-4ea3-9f6d-12f99b6676e9 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:12:19.037011 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b03d4-5cc3-4ea3-9f6d-12f99b6676e9 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:12:19.037011 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b03d4-5cc3-4ea3-9f6d-12f99b6676e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:12:19.055739 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-059b03d4-5cc3-4ea3-9f6d-12f99b6676e9 None None] MFA Rules not processed for user `94079d9bd7b843f09e1345a79b51e447`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:12:19.056966 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-059b03d4-5cc3-4ea3-9f6d-12f99b6676e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:12:19.113003 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1136/2279] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:12:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:12:39.238570 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980329f2-1665-4fcb-8894-25829fbdcf1d None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:12:39.239160 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980329f2-1665-4fcb-8894-25829fbdcf1d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:12:39.239160 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980329f2-1665-4fcb-8894-25829fbdcf1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:12:39.261374 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-980329f2-1665-4fcb-8894-25829fbdcf1d None None] MFA Rules not processed for user `7d3af11e1ffc4ab1a37669f893d2f3be`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:12:39.262623 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-980329f2-1665-4fcb-8894-25829fbdcf1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:12:39.319581 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1144/2280] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:12:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:13:02.634774 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16bfed-47a3-4b16-a513-648c9e1588e2 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:13:02.635304 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16bfed-47a3-4b16-a513-648c9e1588e2 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:13:02.635412 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16bfed-47a3-4b16-a513-648c9e1588e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:13:02.653751 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-cc16bfed-47a3-4b16-a513-648c9e1588e2 None None] MFA Rules not processed for user `661228875e4d4c60a558656b46ea650b`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:13:02.654952 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-cc16bfed-47a3-4b16-a513-648c9e1588e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:13:02.719005 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1137/2281] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:13:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:13:04.276932 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980329f2-1665-4fcb-8894-25829fbdcf1d None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:13:04.278575 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-980329f2-1665-4fcb-8894-25829fbdcf1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:13:04.291399 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980329f2-1665-4fcb-8894-25829fbdcf1d None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:13:04.295668 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a34c86-f789-4c7f-be37-c53c71205f14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:13:04.296317 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a34c86-f789-4c7f-be37-c53c71205f14 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:13:04.296593 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a34c86-f789-4c7f-be37-c53c71205f14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:13:04.296856 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a34c86-f789-4c7f-be37-c53c71205f14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:13:04.298722 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-94a34c86-f789-4c7f-be37-c53c71205f14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:13:04.379172 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a34c86-f789-4c7f-be37-c53c71205f14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:13:04.380932 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a34c86-f789-4c7f-be37-c53c71205f14 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:13:04.392002 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1145/2282] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:13:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:13:04.426061 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16bfed-47a3-4b16-a513-648c9e1588e2 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:13:04.436477 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16bfed-47a3-4b16-a513-648c9e1588e2 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:13:04.442493 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeef215-df39-45b1-bd2e-b636e289ffe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:13:04.443264 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeef215-df39-45b1-bd2e-b636e289ffe3 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:13:04.443643 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeef215-df39-45b1-bd2e-b636e289ffe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:13:04.444021 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeef215-df39-45b1-bd2e-b636e289ffe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:13:04.446348 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-baeef215-df39-45b1-bd2e-b636e289ffe3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:13:04.461341 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeef215-df39-45b1-bd2e-b636e289ffe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:13:04.462961 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeef215-df39-45b1-bd2e-b636e289ffe3 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:13:04.474570 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1138/2283] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:13:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:13:10.222357 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a34c86-f789-4c7f-be37-c53c71205f14 service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:13:10.223908 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-94a34c86-f789-4c7f-be37-c53c71205f14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:13:10.238634 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a34c86-f789-4c7f-be37-c53c71205f14 service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:13:10.245758 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938050b-d7a5-4c7d-9f84-d2ae5d99d5b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:13:10.246424 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938050b-d7a5-4c7d-9f84-d2ae5d99d5b1 service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:13:10.246709 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938050b-d7a5-4c7d-9f84-d2ae5d99d5b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:13:10.246987 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938050b-d7a5-4c7d-9f84-d2ae5d99d5b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:13:10.248870 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-4938050b-d7a5-4c7d-9f84-d2ae5d99d5b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:13:10.310950 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4938050b-d7a5-4c7d-9f84-d2ae5d99d5b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:13:10.312637 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4938050b-d7a5-4c7d-9f84-d2ae5d99d5b1 service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:13:10.321760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1146/2284] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:13:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:13:16.403887 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeef215-df39-45b1-bd2e-b636e289ffe3 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:13:16.405435 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-baeef215-df39-45b1-bd2e-b636e289ffe3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:13:16.419173 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeef215-df39-45b1-bd2e-b636e289ffe3 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:13:16.426264 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ba85d-4bbf-49ed-8148-533b0a2a62c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:13:16.426915 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ba85d-4bbf-49ed-8148-533b0a2a62c8 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:13:16.427193 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ba85d-4bbf-49ed-8148-533b0a2a62c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:13:16.427460 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ba85d-4bbf-49ed-8148-533b0a2a62c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:13:16.429549 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6e5ba85d-4bbf-49ed-8148-533b0a2a62c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:13:16.441406 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ba85d-4bbf-49ed-8148-533b0a2a62c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:13:16.443036 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ba85d-4bbf-49ed-8148-533b0a2a62c8 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:13:16.452610 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1139/2285] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:13:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:13:18.839257 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68e7c6-0d3c-4bfb-868c-4bb911969cdd None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:13:18.840114 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68e7c6-0d3c-4bfb-868c-4bb911969cdd None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:13:18.840400 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68e7c6-0d3c-4bfb-868c-4bb911969cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:13:18.861026 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-3f68e7c6-0d3c-4bfb-868c-4bb911969cdd None None] MFA Rules not processed for user `1673e91c8910435499a5d587f4ef59f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:13:18.862180 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-3f68e7c6-0d3c-4bfb-868c-4bb911969cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:13:18.949178 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1147/2286] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:13:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:13:22.528444 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ba85d-4bbf-49ed-8148-533b0a2a62c8 service nova] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:13:22.532265 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68e7c6-0d3c-4bfb-868c-4bb911969cdd None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:13:22.540705 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ba85d-4bbf-49ed-8148-533b0a2a62c8 service nova] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:13:22.545748 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56b60a-a390-4620-8e1c-c7ec1ddfc1d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:13:22.546880 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56b60a-a390-4620-8e1c-c7ec1ddfc1d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:13:22.547161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56b60a-a390-4620-8e1c-c7ec1ddfc1d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:13:22.547435 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56b60a-a390-4620-8e1c-c7ec1ddfc1d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:13:22.549259 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6b56b60a-a390-4620-8e1c-c7ec1ddfc1d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:13:22.550950 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68e7c6-0d3c-4bfb-868c-4bb911969cdd None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:13:22.559121 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc9ab7-f7a8-454f-8ef5-7c48538564fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:13:22.559786 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc9ab7-f7a8-454f-8ef5-7c48538564fb service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:13:22.560063 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc9ab7-f7a8-454f-8ef5-7c48538564fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:13:22.560339 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc9ab7-f7a8-454f-8ef5-7c48538564fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:13:22.560958 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56b60a-a390-4620-8e1c-c7ec1ddfc1d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:13:22.562853 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56b60a-a390-4620-8e1c-c7ec1ddfc1d8 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:13:22.574661 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc9ab7-f7a8-454f-8ef5-7c48538564fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:13:22.575115 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1140/2287] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:13:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:13:22.576132 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc9ab7-f7a8-454f-8ef5-7c48538564fb service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:13:22.584947 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1148/2288] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:13:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:13:24.537284 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56b60a-a390-4620-8e1c-c7ec1ddfc1d8 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:13:24.539427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6b56b60a-a390-4620-8e1c-c7ec1ddfc1d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:13:24.617557 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56b60a-a390-4620-8e1c-c7ec1ddfc1d8 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:13:24.622205 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5282e-c9bc-486b-960a-56de6dd0151c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:13:24.623114 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5282e-c9bc-486b-960a-56de6dd0151c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:13:24.623391 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5282e-c9bc-486b-960a-56de6dd0151c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:13:24.623871 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5282e-c9bc-486b-960a-56de6dd0151c admin admin] PATH_INFO: `/v3/users/94079d9bd7b843f09e1345a79b51e447` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:13:24.625094 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5282e-c9bc-486b-960a-56de6dd0151c admin admin] RBAC: Authorizing `identity:delete_user(user_id=94079d9bd7b843f09e1345a79b51e447)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:13:24.627271 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5282e-c9bc-486b-960a-56de6dd0151c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:13:24.679960 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d5a5282e-c9bc-486b-960a-56de6dd0151c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94079d9bd7b843f09e1345a79b51e447'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:13:24.687607 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d5a5282e-c9bc-486b-960a-56de6dd0151c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94079d9bd7b843f09e1345a79b51e447'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:13:24.695922 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d5a5282e-c9bc-486b-960a-56de6dd0151c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94079d9bd7b843f09e1345a79b51e447'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:13:24.708085 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d5a5282e-c9bc-486b-960a-56de6dd0151c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94079d9bd7b843f09e1345a79b51e447'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:13:24.709116 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d5a5282e-c9bc-486b-960a-56de6dd0151c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94079d9bd7b843f09e1345a79b51e447'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:13:24.717956 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1141/2289] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:13:24 2022] DELETE /identity/v3/users/94079d9bd7b843f09e1345a79b51e447 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:13:24.923942 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc9ab7-f7a8-454f-8ef5-7c48538564fb service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:13:24.937978 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc9ab7-f7a8-454f-8ef5-7c48538564fb service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:13:24.999570 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b342d05-4723-4d89-a5e1-8456542fab09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:13:25.000570 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b342d05-4723-4d89-a5e1-8456542fab09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:13:25.000941 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b342d05-4723-4d89-a5e1-8456542fab09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:13:25.001284 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b342d05-4723-4d89-a5e1-8456542fab09 admin admin] PATH_INFO: `/v3/projects/3f47a5832eba495e9a74266e13420ebb` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:13:25.002794 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b342d05-4723-4d89-a5e1-8456542fab09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f47a5832eba495e9a74266e13420ebb)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:13:25.004865 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b342d05-4723-4d89-a5e1-8456542fab09 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:13:25.089646 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-3b342d05-4723-4d89-a5e1-8456542fab09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f47a5832eba495e9a74266e13420ebb', 'request_id': 'req-3b342d05-4723-4d89-a5e1-8456542fab09'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:13:25.098448 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-3b342d05-4723-4d89-a5e1-8456542fab09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f47a5832eba495e9a74266e13420ebb', 'request_id': 'req-3b342d05-4723-4d89-a5e1-8456542fab09'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:13:25.126068 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-3b342d05-4723-4d89-a5e1-8456542fab09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f47a5832eba495e9a74266e13420ebb', 'request_id': 'req-3b342d05-4723-4d89-a5e1-8456542fab09'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:13:25.146354 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-3b342d05-4723-4d89-a5e1-8456542fab09 admin admin] The token cache is being invalidate because project 3f47a5832eba495e9a74266e13420ebb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:13:25.147267 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-3b342d05-4723-4d89-a5e1-8456542fab09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:13:25.148272 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-3b342d05-4723-4d89-a5e1-8456542fab09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:13:25.150136 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1149/2290] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:13:24 2022] DELETE /identity/v3/projects/3f47a5832eba495e9a74266e13420ebb => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:13:25.155173 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d078df-7aec-44aa-8631-346c3e578fa5 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:13:25.155457 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d078df-7aec-44aa-8631-346c3e578fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:13:25.155733 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d078df-7aec-44aa-8631-346c3e578fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:13:25.193016 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-35d078df-7aec-44aa-8631-346c3e578fa5 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:13:25.194694 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-35d078df-7aec-44aa-8631-346c3e578fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:13:25.261478 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1142/2291] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:13:25.269573 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5cbad-1c64-42e6-98de-bf5df55d3a77 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:13:25.270280 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5cbad-1c64-42e6-98de-bf5df55d3a77 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:13:25.271789 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5cbad-1c64-42e6-98de-bf5df55d3a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:13:25.291494 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-b0b5cbad-1c64-42e6-98de-bf5df55d3a77 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:13:25.292708 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-b0b5cbad-1c64-42e6-98de-bf5df55d3a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:13:25.301521 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1150/2292] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:13:25.306643 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d078df-7aec-44aa-8631-346c3e578fa5 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:13:25.317837 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d078df-7aec-44aa-8631-346c3e578fa5 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:13:25.322484 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec587279-0a48-45d9-8c2e-782fcfe43c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:13:25.323175 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec587279-0a48-45d9-8c2e-782fcfe43c60 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:13:25.323453 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec587279-0a48-45d9-8c2e-782fcfe43c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:13:25.323813 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec587279-0a48-45d9-8c2e-782fcfe43c60 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:13:25.324441 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec587279-0a48-45d9-8c2e-782fcfe43c60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:13:25.324753 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec587279-0a48-45d9-8c2e-782fcfe43c60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:13:25.326783 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec587279-0a48-45d9-8c2e-782fcfe43c60 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:13:25.340754 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1143/2293] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:13:25.346165 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b5cbad-1c64-42e6-98de-bf5df55d3a77 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:13:25.355828 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b5cbad-1c64-42e6-98de-bf5df55d3a77 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:13:25.359867 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129ffea-a140-421a-9317-ce2bc26a2c13 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:13:25.360156 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129ffea-a140-421a-9317-ce2bc26a2c13 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:13:25.360451 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129ffea-a140-421a-9317-ce2bc26a2c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:13:25.360727 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b8145-4ea0-4b4c-9cc3-bf6580d66622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:13:25.361415 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b8145-4ea0-4b4c-9cc3-bf6580d66622 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:13:25.361757 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b8145-4ea0-4b4c-9cc3-bf6580d66622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:13:25.362035 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b8145-4ea0-4b4c-9cc3-bf6580d66622 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:13:25.362748 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b8145-4ea0-4b4c-9cc3-bf6580d66622 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:13:25.364668 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b8145-4ea0-4b4c-9cc3-bf6580d66622 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:13:25.378732 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-8129ffea-a140-421a-9317-ce2bc26a2c13 None None] MFA Rules not processed for user `a7d2aea046214bfcbbe6d5b3581fc155`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:13:25.379933 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-8129ffea-a140-421a-9317-ce2bc26a2c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:13:25.393904 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1151/2294] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:13:25 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:13:25.395178 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b8145-4ea0-4b4c-9cc3-bf6580d66622 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:13:25.434003 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1144/2295] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:13:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:13:25.456616 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b8145-4ea0-4b4c-9cc3-bf6580d66622 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:13:25.461904 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f72db-e3ec-4874-86e2-11b56b1d8cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:13:25.462886 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f72db-e3ec-4874-86e2-11b56b1d8cbe admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:13:25.462886 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f72db-e3ec-4874-86e2-11b56b1d8cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:13:25.463190 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f72db-e3ec-4874-86e2-11b56b1d8cbe admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:13:25.463815 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f72db-e3ec-4874-86e2-11b56b1d8cbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:13:25.465786 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f72db-e3ec-4874-86e2-11b56b1d8cbe admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:13:25.486934 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1152/2296] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:13:25 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:13:25.491055 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129ffea-a140-421a-9317-ce2bc26a2c13 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:13:25.502995 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129ffea-a140-421a-9317-ce2bc26a2c13 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:13:25.508430 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099eb38f-8f55-4259-a18a-9e5879bd7e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:13:25.509127 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099eb38f-8f55-4259-a18a-9e5879bd7e9b admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:13:25.509403 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099eb38f-8f55-4259-a18a-9e5879bd7e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:13:25.509705 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099eb38f-8f55-4259-a18a-9e5879bd7e9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:13:25.510483 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099eb38f-8f55-4259-a18a-9e5879bd7e9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:13:25.512080 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099eb38f-8f55-4259-a18a-9e5879bd7e9b admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:13:25.523125 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1145/2297] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:13:25.527283 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f72db-e3ec-4874-86e2-11b56b1d8cbe admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:13:25.539581 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f72db-e3ec-4874-86e2-11b56b1d8cbe admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:13:25.545557 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0efb15-34b6-4f52-a6c0-f12ad8e68caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:13:25.546274 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0efb15-34b6-4f52-a6c0-f12ad8e68caf admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:13:25.546538 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0efb15-34b6-4f52-a6c0-f12ad8e68caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:13:25.546801 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0efb15-34b6-4f52-a6c0-f12ad8e68caf admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:13:25.547720 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0efb15-34b6-4f52-a6c0-f12ad8e68caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:13:25.549565 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0efb15-34b6-4f52-a6c0-f12ad8e68caf admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:13:25.561812 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1153/2298] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:13:25.566127 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099eb38f-8f55-4259-a18a-9e5879bd7e9b admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:13:25.577635 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099eb38f-8f55-4259-a18a-9e5879bd7e9b admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:13:25.583616 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000aedc4-cc82-4321-8d2c-f1841ee27fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:13:25.584786 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000aedc4-cc82-4321-8d2c-f1841ee27fec admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:13:25.585657 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000aedc4-cc82-4321-8d2c-f1841ee27fec admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:13:25.586156 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000aedc4-cc82-4321-8d2c-f1841ee27fec admin admin] PATH_INFO: `/v3/projects/385ae3c7ea8347d7bfc346d8bc7fda4a/users/64634c902a884b84a8bd2d3c10ce6270/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:13:25.603323 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000aedc4-cc82-4321-8d2c-f1841ee27fec admin admin] RBAC: Authorizing `identity:create_grant(project_id=385ae3c7ea8347d7bfc346d8bc7fda4a, user_id=64634c902a884b84a8bd2d3c10ce6270, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:13:25.607670 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000aedc4-cc82-4321-8d2c-f1841ee27fec admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:13:25.625806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1146/2299] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:13:25 2022] PUT /identity/v3/projects/385ae3c7ea8347d7bfc346d8bc7fda4a/users/64634c902a884b84a8bd2d3c10ce6270/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:13:25.631162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc49138-cc8d-4835-aa5f-bb4c75bc2e70 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:13:25.631711 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc49138-cc8d-4835-aa5f-bb4c75bc2e70 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:13:25.632087 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc49138-cc8d-4835-aa5f-bb4c75bc2e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:13:25.654076 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-8fc49138-cc8d-4835-aa5f-bb4c75bc2e70 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:13:25.655497 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-8fc49138-cc8d-4835-aa5f-bb4c75bc2e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:13:25.723920 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1154/2300] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:13:25.733227 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000aedc4-cc82-4321-8d2c-f1841ee27fec admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:13:25.734974 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-000aedc4-cc82-4321-8d2c-f1841ee27fec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:13:25.794004 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000aedc4-cc82-4321-8d2c-f1841ee27fec admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:13:25.799102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b0f70-3ebe-47d3-b0ad-bfa5eb771bcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:13:25.799765 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b0f70-3ebe-47d3-b0ad-bfa5eb771bcd service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:13:25.800043 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b0f70-3ebe-47d3-b0ad-bfa5eb771bcd service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:13:25.800311 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b0f70-3ebe-47d3-b0ad-bfa5eb771bcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:13:25.809957 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b0f70-3ebe-47d3-b0ad-bfa5eb771bcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:13:25.811498 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b0f70-3ebe-47d3-b0ad-bfa5eb771bcd service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:13:25.821133 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1147/2301] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:13:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 19:13:26.482015 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc49138-cc8d-4835-aa5f-bb4c75bc2e70 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:13:26.485688 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-8fc49138-cc8d-4835-aa5f-bb4c75bc2e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:13:26.559575 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc49138-cc8d-4835-aa5f-bb4c75bc2e70 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:13:26.564575 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce48e34-bd03-433a-a18d-3f84caf60b71 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '629742b135b2447898e8291d9a360295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:13:26.565220 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce48e34-bd03-433a-a18d-3f84caf60b71 service placement] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:13:26.565499 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce48e34-bd03-433a-a18d-3f84caf60b71 service placement] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:13:26.565804 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce48e34-bd03-433a-a18d-3f84caf60b71 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:13:26.567684 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-8ce48e34-bd03-433a-a18d-3f84caf60b71 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:13:26.578880 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce48e34-bd03-433a-a18d-3f84caf60b71 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:13:26.580476 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce48e34-bd03-433a-a18d-3f84caf60b71 service placement] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:13:26.590474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1155/2302] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:13:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:13:27.310195 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad008be-fb23-4ab7-ba2b-2dc5e6b4aea6 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:13:27.311060 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad008be-fb23-4ab7-ba2b-2dc5e6b4aea6 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:13:27.311559 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad008be-fb23-4ab7-ba2b-2dc5e6b4aea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:13:27.331243 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-dad008be-fb23-4ab7-ba2b-2dc5e6b4aea6 None None] MFA Rules not processed for user `4775e9dd7aea448d95ec7378b4ff3124`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:13:27.332821 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-dad008be-fb23-4ab7-ba2b-2dc5e6b4aea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:13:27.393684 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1148/2303] 10.222.0.24 () {58 vars in 967 bytes} [Mon May 16 19:13:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:13:27.451327 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce48e34-bd03-433a-a18d-3f84caf60b71 service placement] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:13:27.453612 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-8ce48e34-bd03-433a-a18d-3f84caf60b71 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:13:27.528797 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce48e34-bd03-433a-a18d-3f84caf60b71 service placement] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:13:27.535547 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436d52e-c502-4b33-9145-8e1671be6256 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '654e435a35c4491eb87943734ce280f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:13:27.536974 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436d52e-c502-4b33-9145-8e1671be6256 service swift] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:13:27.537475 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436d52e-c502-4b33-9145-8e1671be6256 service swift] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:13:27.537681 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436d52e-c502-4b33-9145-8e1671be6256 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:13:27.551228 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436d52e-c502-4b33-9145-8e1671be6256 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:13:27.553941 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436d52e-c502-4b33-9145-8e1671be6256 service swift] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:13:27.579453 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1156/2304] 10.222.0.24 () {60 vars in 1384 bytes} [Mon May 16 19:13:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 19:13:35.437189 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bde2d0-0507-4bdf-ae4a-64614cc2d273 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:13:35.437769 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bde2d0-0507-4bdf-ae4a-64614cc2d273 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:13:35.437769 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bde2d0-0507-4bdf-ae4a-64614cc2d273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:13:35.481549 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-71bde2d0-0507-4bdf-ae4a-64614cc2d273 None None] MFA Rules not processed for user `64634c902a884b84a8bd2d3c10ce6270`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:13:35.483947 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-71bde2d0-0507-4bdf-ae4a-64614cc2d273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:13:35.666811 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436d52e-c502-4b33-9145-8e1671be6256 service swift] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:13:35.678425 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1149/2305] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:13:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:13:35.681842 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436d52e-c502-4b33-9145-8e1671be6256 service swift] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:13:35.702999 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b4f07-a637-44c6-b09d-127761155870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:13:35.703696 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b4f07-a637-44c6-b09d-127761155870 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:13:35.703970 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b4f07-a637-44c6-b09d-127761155870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:13:35.704236 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b4f07-a637-44c6-b09d-127761155870 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:13:35.705437 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b4f07-a637-44c6-b09d-127761155870 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:13:35.707760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b4f07-a637-44c6-b09d-127761155870 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:13:35.768171 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1157/2306] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:13:35 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:13:35.772303 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bde2d0-0507-4bdf-ae4a-64614cc2d273 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:13:35.783977 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bde2d0-0507-4bdf-ae4a-64614cc2d273 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:13:35.860915 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f9125-e1ec-4526-82fa-e7bf0ff64626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:13:35.861900 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f9125-e1ec-4526-82fa-e7bf0ff64626 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:13:35.862333 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f9125-e1ec-4526-82fa-e7bf0ff64626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:13:35.862770 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f9125-e1ec-4526-82fa-e7bf0ff64626 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:13:35.864268 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f9125-e1ec-4526-82fa-e7bf0ff64626 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:13:35.867008 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f9125-e1ec-4526-82fa-e7bf0ff64626 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:13:35.911058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1150/2307] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:13:35 2022] POST /identity/v3/users => generated 296 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:13:35.914879 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b4f07-a637-44c6-b09d-127761155870 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:13:35.926469 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b4f07-a637-44c6-b09d-127761155870 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:13:35.932460 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9bb1a5-a0a2-4872-8d30-4a0f6612f7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:13:35.933784 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9bb1a5-a0a2-4872-8d30-4a0f6612f7cc admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:13:35.934273 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9bb1a5-a0a2-4872-8d30-4a0f6612f7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:13:35.934850 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9bb1a5-a0a2-4872-8d30-4a0f6612f7cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:13:35.935751 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9bb1a5-a0a2-4872-8d30-4a0f6612f7cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:13:35.937887 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9bb1a5-a0a2-4872-8d30-4a0f6612f7cc admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:13:35.954108 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f9125-e1ec-4526-82fa-e7bf0ff64626 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:13:35.960713 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1158/2308] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:13:35.964955 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f9125-e1ec-4526-82fa-e7bf0ff64626 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:13:35.972555 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113dcfb8-d4d7-40af-8c56-2b1608d52845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:13:35.973888 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113dcfb8-d4d7-40af-8c56-2b1608d52845 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:13:35.974323 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113dcfb8-d4d7-40af-8c56-2b1608d52845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:13:35.974762 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113dcfb8-d4d7-40af-8c56-2b1608d52845 admin admin] PATH_INFO: `/v3/projects/b578e7cebd13462290fbe5dd4dbf9415/users/1a90500c178c491397a0ecf92ce90228/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:13:36.017760 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113dcfb8-d4d7-40af-8c56-2b1608d52845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b578e7cebd13462290fbe5dd4dbf9415, user_id=1a90500c178c491397a0ecf92ce90228, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:13:36.021253 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113dcfb8-d4d7-40af-8c56-2b1608d52845 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:13:36.066863 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1151/2309] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:13:35 2022] PUT /identity/v3/projects/b578e7cebd13462290fbe5dd4dbf9415/users/1a90500c178c491397a0ecf92ce90228/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:13:36.071870 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9bb1a5-a0a2-4872-8d30-4a0f6612f7cc admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:13:36.084996 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9bb1a5-a0a2-4872-8d30-4a0f6612f7cc admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:13:36.180378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62379e1-2bd7-499c-b9ff-b426fa7d9f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:13:36.181378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62379e1-2bd7-499c-b9ff-b426fa7d9f69 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:13:36.182911 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62379e1-2bd7-499c-b9ff-b426fa7d9f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:13:36.183347 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62379e1-2bd7-499c-b9ff-b426fa7d9f69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:13:36.184253 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62379e1-2bd7-499c-b9ff-b426fa7d9f69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:13:36.186960 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62379e1-2bd7-499c-b9ff-b426fa7d9f69 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:13:36.198804 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1159/2310] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:13:36.202575 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113dcfb8-d4d7-40af-8c56-2b1608d52845 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:13:36.216563 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113dcfb8-d4d7-40af-8c56-2b1608d52845 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:13:36.225695 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b200ef0-9f3f-43f1-923a-329cfe2c458c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:13:36.228252 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b200ef0-9f3f-43f1-923a-329cfe2c458c admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:13:36.228602 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b200ef0-9f3f-43f1-923a-329cfe2c458c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:13:36.229879 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b200ef0-9f3f-43f1-923a-329cfe2c458c admin admin] PATH_INFO: `/v3/projects/b578e7cebd13462290fbe5dd4dbf9415/users/1a90500c178c491397a0ecf92ce90228/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:13:36.237038 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b200ef0-9f3f-43f1-923a-329cfe2c458c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b578e7cebd13462290fbe5dd4dbf9415, user_id=1a90500c178c491397a0ecf92ce90228, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:13:36.244387 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b200ef0-9f3f-43f1-923a-329cfe2c458c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:13:36.269457 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1152/2311] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:13:36 2022] PUT /identity/v3/projects/b578e7cebd13462290fbe5dd4dbf9415/users/1a90500c178c491397a0ecf92ce90228/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:13:36.822411 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62379e1-2bd7-499c-b9ff-b426fa7d9f69 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:13:36.824880 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a62379e1-2bd7-499c-b9ff-b426fa7d9f69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:13:36.849962 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62379e1-2bd7-499c-b9ff-b426fa7d9f69 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:13:36.957149 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c0814-17aa-45a8-8f94-f8f051333101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:13:36.958093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c0814-17aa-45a8-8f94-f8f051333101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:13:36.958371 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c0814-17aa-45a8-8f94-f8f051333101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:13:36.958646 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c0814-17aa-45a8-8f94-f8f051333101 admin admin] PATH_INFO: `/v3/users/2aba8a58b6c24e548a8ab08cfa5bb857` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:13:36.967593 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c0814-17aa-45a8-8f94-f8f051333101 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aba8a58b6c24e548a8ab08cfa5bb857)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:13:36.969776 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c0814-17aa-45a8-8f94-f8f051333101 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:13:37.047992 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f82c0814-17aa-45a8-8f94-f8f051333101 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aba8a58b6c24e548a8ab08cfa5bb857'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:13:37.066133 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f82c0814-17aa-45a8-8f94-f8f051333101 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aba8a58b6c24e548a8ab08cfa5bb857'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:13:37.082355 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f82c0814-17aa-45a8-8f94-f8f051333101 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aba8a58b6c24e548a8ab08cfa5bb857'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:13:37.083577 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f82c0814-17aa-45a8-8f94-f8f051333101 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aba8a58b6c24e548a8ab08cfa5bb857'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:13:37.121254 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f82c0814-17aa-45a8-8f94-f8f051333101 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aba8a58b6c24e548a8ab08cfa5bb857'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:13:37.130206 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1160/2312] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:13:36 2022] DELETE /identity/v3/users/2aba8a58b6c24e548a8ab08cfa5bb857 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:13:37.432246 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b200ef0-9f3f-43f1-923a-329cfe2c458c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:13:37.434820 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3b200ef0-9f3f-43f1-923a-329cfe2c458c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:13:37.453996 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b200ef0-9f3f-43f1-923a-329cfe2c458c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:13:37.540408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e3b17-86e2-4c7b-b9d3-dcec3be51744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:13:37.541676 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e3b17-86e2-4c7b-b9d3-dcec3be51744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:13:37.547949 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e3b17-86e2-4c7b-b9d3-dcec3be51744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:13:37.551308 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e3b17-86e2-4c7b-b9d3-dcec3be51744 admin admin] PATH_INFO: `/v3/projects/84949fef3a77459fbf02d0804bafdc4a` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:13:37.553553 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467e3b17-86e2-4c7b-b9d3-dcec3be51744 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84949fef3a77459fbf02d0804bafdc4a)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:13:37.555759 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467e3b17-86e2-4c7b-b9d3-dcec3be51744 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:13:37.706106 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-467e3b17-86e2-4c7b-b9d3-dcec3be51744 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84949fef3a77459fbf02d0804bafdc4a', 'request_id': 'req-467e3b17-86e2-4c7b-b9d3-dcec3be51744'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:13:37.725243 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-467e3b17-86e2-4c7b-b9d3-dcec3be51744 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84949fef3a77459fbf02d0804bafdc4a', 'request_id': 'req-467e3b17-86e2-4c7b-b9d3-dcec3be51744'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:13:37.733509 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-467e3b17-86e2-4c7b-b9d3-dcec3be51744 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84949fef3a77459fbf02d0804bafdc4a', 'request_id': 'req-467e3b17-86e2-4c7b-b9d3-dcec3be51744'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:13:37.761456 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-467e3b17-86e2-4c7b-b9d3-dcec3be51744 admin admin] The token cache is being invalidate because project 84949fef3a77459fbf02d0804bafdc4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:13:37.761802 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-467e3b17-86e2-4c7b-b9d3-dcec3be51744 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:13:37.762452 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-467e3b17-86e2-4c7b-b9d3-dcec3be51744 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:13:37.764330 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1153/2313] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:13:37 2022] DELETE /identity/v3/projects/84949fef3a77459fbf02d0804bafdc4a => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:13:37.768051 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c0814-17aa-45a8-8f94-f8f051333101 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:13:37.782292 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c0814-17aa-45a8-8f94-f8f051333101 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:13:37.919884 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec7aad-ddf1-4911-9fa2-897921777368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:13:37.920856 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec7aad-ddf1-4911-9fa2-897921777368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:13:37.921077 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec7aad-ddf1-4911-9fa2-897921777368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:13:37.921349 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec7aad-ddf1-4911-9fa2-897921777368 admin admin] PATH_INFO: `/v3/users/009e41b8f9844174ac056c52a0b74d1a` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:13:37.932948 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec7aad-ddf1-4911-9fa2-897921777368 admin admin] RBAC: Authorizing `identity:delete_user(user_id=009e41b8f9844174ac056c52a0b74d1a)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:13:37.935103 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec7aad-ddf1-4911-9fa2-897921777368 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:13:38.036425 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a1ec7aad-ddf1-4911-9fa2-897921777368 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '009e41b8f9844174ac056c52a0b74d1a'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:13:38.059715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a1ec7aad-ddf1-4911-9fa2-897921777368 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '009e41b8f9844174ac056c52a0b74d1a'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:13:38.072153 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a1ec7aad-ddf1-4911-9fa2-897921777368 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '009e41b8f9844174ac056c52a0b74d1a'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:13:38.073283 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a1ec7aad-ddf1-4911-9fa2-897921777368 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '009e41b8f9844174ac056c52a0b74d1a'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:13:38.094851 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a1ec7aad-ddf1-4911-9fa2-897921777368 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '009e41b8f9844174ac056c52a0b74d1a'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:13:38.104254 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1161/2314] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:13:37 2022] DELETE /identity/v3/users/009e41b8f9844174ac056c52a0b74d1a => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:13:38.380912 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e3b17-86e2-4c7b-b9d3-dcec3be51744 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:13:38.386936 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-467e3b17-86e2-4c7b-b9d3-dcec3be51744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:13:38.417384 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e3b17-86e2-4c7b-b9d3-dcec3be51744 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:13:38.501740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff64266-2aff-4fec-bdd6-6a1deaed56c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:13:38.503905 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff64266-2aff-4fec-bdd6-6a1deaed56c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:13:38.504341 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff64266-2aff-4fec-bdd6-6a1deaed56c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:13:38.504775 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff64266-2aff-4fec-bdd6-6a1deaed56c5 admin admin] PATH_INFO: `/v3/projects/006a916aeef842d29784440cf91bf8a6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:13:38.506888 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff64266-2aff-4fec-bdd6-6a1deaed56c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=006a916aeef842d29784440cf91bf8a6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:13:38.509452 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff64266-2aff-4fec-bdd6-6a1deaed56c5 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:13:38.570141 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-8ff64266-2aff-4fec-bdd6-6a1deaed56c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '006a916aeef842d29784440cf91bf8a6', 'request_id': 'req-8ff64266-2aff-4fec-bdd6-6a1deaed56c5'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:13:38.583535 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-8ff64266-2aff-4fec-bdd6-6a1deaed56c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '006a916aeef842d29784440cf91bf8a6', 'request_id': 'req-8ff64266-2aff-4fec-bdd6-6a1deaed56c5'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:13:38.591464 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-8ff64266-2aff-4fec-bdd6-6a1deaed56c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '006a916aeef842d29784440cf91bf8a6', 'request_id': 'req-8ff64266-2aff-4fec-bdd6-6a1deaed56c5'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:13:38.605071 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-8ff64266-2aff-4fec-bdd6-6a1deaed56c5 admin admin] The token cache is being invalidate because project 006a916aeef842d29784440cf91bf8a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:13:38.605781 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-8ff64266-2aff-4fec-bdd6-6a1deaed56c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:13:38.606628 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-8ff64266-2aff-4fec-bdd6-6a1deaed56c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:13:38.613783 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1154/2315] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:13:38 2022] DELETE /identity/v3/projects/006a916aeef842d29784440cf91bf8a6 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:13:41.400832 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31899b2-dd50-4b84-ae1e-951d15223ab2 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:13:41.401339 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31899b2-dd50-4b84-ae1e-951d15223ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:13:41.401467 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31899b2-dd50-4b84-ae1e-951d15223ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:13:41.432178 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-a31899b2-dd50-4b84-ae1e-951d15223ab2 None None] MFA Rules not processed for user `1a90500c178c491397a0ecf92ce90228`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:13:41.433415 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a31899b2-dd50-4b84-ae1e-951d15223ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:13:41.531992 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1162/2316] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:13:41 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:13:41.546278 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff64266-2aff-4fec-bdd6-6a1deaed56c5 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:13:41.548233 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-8ff64266-2aff-4fec-bdd6-6a1deaed56c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:13:41.653359 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff64266-2aff-4fec-bdd6-6a1deaed56c5 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:13:41.658935 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01192ef-72d4-4791-8788-41c07c3bf80a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:13:41.659805 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01192ef-72d4-4791-8788-41c07c3bf80a service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:13:41.660381 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01192ef-72d4-4791-8788-41c07c3bf80a service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:13:41.660830 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01192ef-72d4-4791-8788-41c07c3bf80a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:13:41.663666 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e01192ef-72d4-4791-8788-41c07c3bf80a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:13:41.794345 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01192ef-72d4-4791-8788-41c07c3bf80a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:13:41.797418 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31899b2-dd50-4b84-ae1e-951d15223ab2 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:13:41.798989 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a31899b2-dd50-4b84-ae1e-951d15223ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:13:41.801327 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01192ef-72d4-4791-8788-41c07c3bf80a service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:13:41.817265 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31899b2-dd50-4b84-ae1e-951d15223ab2 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:13:41.824047 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f532369-aaf9-44c6-b616-218003176eb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:13:41.824761 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f532369-aaf9-44c6-b616-218003176eb5 service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:13:41.825162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f532369-aaf9-44c6-b616-218003176eb5 service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:13:41.825442 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f532369-aaf9-44c6-b616-218003176eb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:13:41.826615 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1155/2317] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:13:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:13:41.838331 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-4f532369-aaf9-44c6-b616-218003176eb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:13:41.865226 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f532369-aaf9-44c6-b616-218003176eb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:13:41.867121 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f532369-aaf9-44c6-b616-218003176eb5 service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:13:41.890536 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1163/2318] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:13:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:13:44.611229 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01192ef-72d4-4791-8788-41c07c3bf80a service nova] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:13:44.626139 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01192ef-72d4-4791-8788-41c07c3bf80a service nova] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:13:44.632582 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145a0f9-bebd-441f-98c6-d4c45dd9f96d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:13:44.633426 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145a0f9-bebd-441f-98c6-d4c45dd9f96d service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:13:44.633832 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145a0f9-bebd-441f-98c6-d4c45dd9f96d service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:13:44.634201 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145a0f9-bebd-441f-98c6-d4c45dd9f96d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:13:44.636409 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9145a0f9-bebd-441f-98c6-d4c45dd9f96d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:13:44.698892 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9145a0f9-bebd-441f-98c6-d4c45dd9f96d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:13:44.700942 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9145a0f9-bebd-441f-98c6-d4c45dd9f96d service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:13:44.714388 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1156/2319] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:13:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:14:00.475304 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbec3e2-2bc8-4070-b580-5c4d602be743 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:00.475814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbec3e2-2bc8-4070-b580-5c4d602be743 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:00.475814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbec3e2-2bc8-4070-b580-5c4d602be743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:00.493951 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-ddbec3e2-2bc8-4070-b580-5c4d602be743 None None] MFA Rules not processed for user `64634c902a884b84a8bd2d3c10ce6270`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:14:00.495214 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-ddbec3e2-2bc8-4070-b580-5c4d602be743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:00.502167 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1164/2320] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:14:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:14:00.813835 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145a0f9-bebd-441f-98c6-d4c45dd9f96d service nova] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:00.815313 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9145a0f9-bebd-441f-98c6-d4c45dd9f96d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:00.880723 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145a0f9-bebd-441f-98c6-d4c45dd9f96d service nova] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:00.885155 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cb63b-ae93-4a6a-88d5-67e0bde94e8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:00.888167 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cb63b-ae93-4a6a-88d5-67e0bde94e8a service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:00.888167 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cb63b-ae93-4a6a-88d5-67e0bde94e8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:00.888167 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cb63b-ae93-4a6a-88d5-67e0bde94e8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:00.888712 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-fc0cb63b-ae93-4a6a-88d5-67e0bde94e8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:00.899587 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cb63b-ae93-4a6a-88d5-67e0bde94e8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:00.901621 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cb63b-ae93-4a6a-88d5-67e0bde94e8a service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:00.910530 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1157/2321] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:14:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 19:14:01.226951 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0bdba-8c79-451d-9fd9-105de83f1551 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:01.227240 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0bdba-8c79-451d-9fd9-105de83f1551 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:01.227517 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0bdba-8c79-451d-9fd9-105de83f1551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:01.245556 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-dec0bdba-8c79-451d-9fd9-105de83f1551 None None] MFA Rules not processed for user `7d3af11e1ffc4ab1a37669f893d2f3be`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:14:01.247122 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-dec0bdba-8c79-451d-9fd9-105de83f1551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:01.254848 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1165/2322] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:14:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:14:01.570841 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cb63b-ae93-4a6a-88d5-67e0bde94e8a service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:01.572297 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-fc0cb63b-ae93-4a6a-88d5-67e0bde94e8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:01.583474 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cb63b-ae93-4a6a-88d5-67e0bde94e8a service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:01.587212 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b5077-1816-4d27-a3b0-3ea1e6a886ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:01.587861 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b5077-1816-4d27-a3b0-3ea1e6a886ab service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:01.588143 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b5077-1816-4d27-a3b0-3ea1e6a886ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:01.588599 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b5077-1816-4d27-a3b0-3ea1e6a886ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:01.590532 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1f3b5077-1816-4d27-a3b0-3ea1e6a886ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:01.601724 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b5077-1816-4d27-a3b0-3ea1e6a886ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:01.603529 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b5077-1816-4d27-a3b0-3ea1e6a886ab service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:01.611853 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1158/2323] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:14:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:14:08.546386 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0bdba-8c79-451d-9fd9-105de83f1551 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:08.547847 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-dec0bdba-8c79-451d-9fd9-105de83f1551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:08.603232 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0bdba-8c79-451d-9fd9-105de83f1551 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:08.607233 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf5f4c-2747-4c70-9293-3a098eb847f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:08.607903 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf5f4c-2747-4c70-9293-3a098eb847f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:08.608174 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf5f4c-2747-4c70-9293-3a098eb847f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:08.608467 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf5f4c-2747-4c70-9293-3a098eb847f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:08.610378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-bbaf5f4c-2747-4c70-9293-3a098eb847f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:08.667322 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf5f4c-2747-4c70-9293-3a098eb847f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:08.668757 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf5f4c-2747-4c70-9293-3a098eb847f5 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:08.677633 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1166/2324] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:14:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:14:11.618286 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b5077-1816-4d27-a3b0-3ea1e6a886ab service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:11.635273 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b5077-1816-4d27-a3b0-3ea1e6a886ab service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:11.641121 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4770b0e-d251-403b-b304-d635fa7500bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:11.642235 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4770b0e-d251-403b-b304-d635fa7500bf service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:11.642235 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4770b0e-d251-403b-b304-d635fa7500bf service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:11.642442 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4770b0e-d251-403b-b304-d635fa7500bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:11.644783 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e4770b0e-d251-403b-b304-d635fa7500bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:11.658158 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4770b0e-d251-403b-b304-d635fa7500bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:11.659778 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4770b0e-d251-403b-b304-d635fa7500bf service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:11.672683 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1159/2325] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:14:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:14:20.494177 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf5f4c-2747-4c70-9293-3a098eb847f5 service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:20.503738 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf5f4c-2747-4c70-9293-3a098eb847f5 service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:20.507688 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065059d-0907-4af6-a88a-bb5eef0e2680 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:20.508414 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065059d-0907-4af6-a88a-bb5eef0e2680 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:20.508774 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065059d-0907-4af6-a88a-bb5eef0e2680 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:20.509154 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065059d-0907-4af6-a88a-bb5eef0e2680 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:20.518483 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065059d-0907-4af6-a88a-bb5eef0e2680 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:20.520379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065059d-0907-4af6-a88a-bb5eef0e2680 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:20.529856 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1167/2326] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:14:20 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:14:27.860916 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4770b0e-d251-403b-b304-d635fa7500bf service nova] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:27.871893 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4770b0e-d251-403b-b304-d635fa7500bf service nova] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:27.876030 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b681582-b695-44bb-8c4c-8b9cc9e351ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:27.876668 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b681582-b695-44bb-8c4c-8b9cc9e351ff service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:27.876981 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b681582-b695-44bb-8c4c-8b9cc9e351ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:27.877227 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b681582-b695-44bb-8c4c-8b9cc9e351ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:27.879084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3b681582-b695-44bb-8c4c-8b9cc9e351ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:27.959892 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b681582-b695-44bb-8c4c-8b9cc9e351ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:27.961753 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b681582-b695-44bb-8c4c-8b9cc9e351ff service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:27.972118 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1160/2327] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:14:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:14:29.396318 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41d257-57d0-454a-a33a-c936809b9583 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:29.397305 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41d257-57d0-454a-a33a-c936809b9583 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:29.398157 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41d257-57d0-454a-a33a-c936809b9583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:29.419500 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-6c41d257-57d0-454a-a33a-c936809b9583 None None] MFA Rules not processed for user `4775e9dd7aea448d95ec7378b4ff3124`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:14:29.420718 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-6c41d257-57d0-454a-a33a-c936809b9583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:29.491793 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1168/2328] 10.222.0.24 () {58 vars in 1009 bytes} [Mon May 16 19:14:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:14:29.573449 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b681582-b695-44bb-8c4c-8b9cc9e351ff service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:29.575677 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3b681582-b695-44bb-8c4c-8b9cc9e351ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:29.695390 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b681582-b695-44bb-8c4c-8b9cc9e351ff service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:29.706425 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601afe9a-584f-4178-8cd9-8910acea9cb7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '654e435a35c4491eb87943734ce280f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:29.707673 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601afe9a-584f-4178-8cd9-8910acea9cb7 service swift] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:29.707673 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601afe9a-584f-4178-8cd9-8910acea9cb7 service swift] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:29.707881 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601afe9a-584f-4178-8cd9-8910acea9cb7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:29.726744 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601afe9a-584f-4178-8cd9-8910acea9cb7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:29.728647 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601afe9a-584f-4178-8cd9-8910acea9cb7 service swift] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:29.737486 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1161/2329] 10.222.0.24 () {60 vars in 1384 bytes} [Mon May 16 19:14:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 19:14:32.581814 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41d257-57d0-454a-a33a-c936809b9583 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:32.586965 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-6c41d257-57d0-454a-a33a-c936809b9583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:32.602443 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41d257-57d0-454a-a33a-c936809b9583 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:32.607111 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66ef21-b6b4-4804-b7ef-b9975f077383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:32.608003 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66ef21-b6b4-4804-b7ef-b9975f077383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:32.608280 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66ef21-b6b4-4804-b7ef-b9975f077383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:32.608556 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66ef21-b6b4-4804-b7ef-b9975f077383 admin admin] PATH_INFO: `/v3/users/1673e91c8910435499a5d587f4ef59f9` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:32.609791 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a66ef21-b6b4-4804-b7ef-b9975f077383 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1673e91c8910435499a5d587f4ef59f9)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:32.612384 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a66ef21-b6b4-4804-b7ef-b9975f077383 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:32.678003 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-4a66ef21-b6b4-4804-b7ef-b9975f077383 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1673e91c8910435499a5d587f4ef59f9'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:32.686580 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-4a66ef21-b6b4-4804-b7ef-b9975f077383 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1673e91c8910435499a5d587f4ef59f9'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:32.696312 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-4a66ef21-b6b4-4804-b7ef-b9975f077383 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1673e91c8910435499a5d587f4ef59f9'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:32.698010 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-4a66ef21-b6b4-4804-b7ef-b9975f077383 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1673e91c8910435499a5d587f4ef59f9'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:32.711024 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-4a66ef21-b6b4-4804-b7ef-b9975f077383 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1673e91c8910435499a5d587f4ef59f9'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:32.718243 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1169/2330] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:14:32 2022] DELETE /identity/v3/users/1673e91c8910435499a5d587f4ef59f9 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:14:32.910919 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601afe9a-584f-4178-8cd9-8910acea9cb7 service swift] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:32.924932 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601afe9a-584f-4178-8cd9-8910acea9cb7 service swift] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:32.987895 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034bba57-f2dd-4aa7-912f-b82337fa7282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:32.988778 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bba57-f2dd-4aa7-912f-b82337fa7282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:32.989091 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bba57-f2dd-4aa7-912f-b82337fa7282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:32.989373 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bba57-f2dd-4aa7-912f-b82337fa7282 admin admin] PATH_INFO: `/v3/projects/ba2c6e5fee5b402fa68833228d12c8e7` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:32.990618 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034bba57-f2dd-4aa7-912f-b82337fa7282 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba2c6e5fee5b402fa68833228d12c8e7)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:32.992539 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034bba57-f2dd-4aa7-912f-b82337fa7282 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:33.065783 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-034bba57-f2dd-4aa7-912f-b82337fa7282 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba2c6e5fee5b402fa68833228d12c8e7', 'request_id': 'req-034bba57-f2dd-4aa7-912f-b82337fa7282'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:33.073489 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-034bba57-f2dd-4aa7-912f-b82337fa7282 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba2c6e5fee5b402fa68833228d12c8e7', 'request_id': 'req-034bba57-f2dd-4aa7-912f-b82337fa7282'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:33.081039 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-034bba57-f2dd-4aa7-912f-b82337fa7282 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba2c6e5fee5b402fa68833228d12c8e7', 'request_id': 'req-034bba57-f2dd-4aa7-912f-b82337fa7282'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:33.093430 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-034bba57-f2dd-4aa7-912f-b82337fa7282 admin admin] The token cache is being invalidate because project ba2c6e5fee5b402fa68833228d12c8e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:14:33.093981 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-034bba57-f2dd-4aa7-912f-b82337fa7282 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:33.094963 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-034bba57-f2dd-4aa7-912f-b82337fa7282 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:33.100729 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1162/2331] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:14:32 2022] DELETE /identity/v3/projects/ba2c6e5fee5b402fa68833228d12c8e7 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:14:33.102252 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e75cd4-cf31-408b-a4f9-127bb496eb35 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:33.102541 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e75cd4-cf31-408b-a4f9-127bb496eb35 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:33.102813 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e75cd4-cf31-408b-a4f9-127bb496eb35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:33.127454 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-38e75cd4-cf31-408b-a4f9-127bb496eb35 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:14:33.128673 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-38e75cd4-cf31-408b-a4f9-127bb496eb35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:33.201282 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1170/2332] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:14:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:14:33.209201 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff402d-a933-4ab5-9968-78ca21f80b33 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:33.209494 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff402d-a933-4ab5-9968-78ca21f80b33 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:33.209818 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff402d-a933-4ab5-9968-78ca21f80b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:33.232398 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-d9ff402d-a933-4ab5-9968-78ca21f80b33 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:14:33.233673 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d9ff402d-a933-4ab5-9968-78ca21f80b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:33.244519 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1163/2333] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:14:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:14:33.248762 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e75cd4-cf31-408b-a4f9-127bb496eb35 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:33.259641 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e75cd4-cf31-408b-a4f9-127bb496eb35 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:33.265885 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f363258-efaa-4933-81cf-45916120ca65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:33.266781 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f363258-efaa-4933-81cf-45916120ca65 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:33.267223 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f363258-efaa-4933-81cf-45916120ca65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:33.267654 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f363258-efaa-4933-81cf-45916120ca65 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:33.268897 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f363258-efaa-4933-81cf-45916120ca65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:14:33.269202 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f363258-efaa-4933-81cf-45916120ca65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:33.270885 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f363258-efaa-4933-81cf-45916120ca65 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:33.284466 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1171/2334] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:14:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:14:33.289004 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff402d-a933-4ab5-9968-78ca21f80b33 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:33.298703 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff402d-a933-4ab5-9968-78ca21f80b33 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:33.303672 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2519d-3060-4dfc-aaf1-9c73712e76cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:33.304367 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2519d-3060-4dfc-aaf1-9c73712e76cf admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:33.304647 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2519d-3060-4dfc-aaf1-9c73712e76cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:33.304917 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2519d-3060-4dfc-aaf1-9c73712e76cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:33.305701 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2519d-3060-4dfc-aaf1-9c73712e76cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:33.307623 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2519d-3060-4dfc-aaf1-9c73712e76cf admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:33.351735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1164/2335] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:14:33 2022] POST /identity/v3/projects => generated 363 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:14:33.355794 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f363258-efaa-4933-81cf-45916120ca65 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:33.366358 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f363258-efaa-4933-81cf-45916120ca65 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:33.436610 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034dd82e-44b0-495f-85c3-99a289e8d315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:33.437377 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034dd82e-44b0-495f-85c3-99a289e8d315 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:33.437710 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034dd82e-44b0-495f-85c3-99a289e8d315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:33.437983 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034dd82e-44b0-495f-85c3-99a289e8d315 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:33.438688 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034dd82e-44b0-495f-85c3-99a289e8d315 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:33.440667 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034dd82e-44b0-495f-85c3-99a289e8d315 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:33.471602 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1172/2336] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:14:33 2022] POST /identity/v3/users => generated 282 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:14:33.475650 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2519d-3060-4dfc-aaf1-9c73712e76cf admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:33.490429 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2519d-3060-4dfc-aaf1-9c73712e76cf admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:33.496646 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423ee22-4192-4b94-8f81-6fc30555171d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:33.498245 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423ee22-4192-4b94-8f81-6fc30555171d admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:33.498609 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423ee22-4192-4b94-8f81-6fc30555171d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:33.498963 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423ee22-4192-4b94-8f81-6fc30555171d admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:33.499773 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423ee22-4192-4b94-8f81-6fc30555171d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:33.502215 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423ee22-4192-4b94-8f81-6fc30555171d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:33.517963 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1165/2337] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:14:33.520689 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034dd82e-44b0-495f-85c3-99a289e8d315 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:33.532625 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034dd82e-44b0-495f-85c3-99a289e8d315 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:33.541238 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112216d-dcdf-4b87-815d-cc72e5c14181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:33.541917 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112216d-dcdf-4b87-815d-cc72e5c14181 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:33.542296 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112216d-dcdf-4b87-815d-cc72e5c14181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:33.542674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112216d-dcdf-4b87-815d-cc72e5c14181 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:33.543526 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7112216d-dcdf-4b87-815d-cc72e5c14181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:33.545453 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7112216d-dcdf-4b87-815d-cc72e5c14181 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:33.557622 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1173/2338] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 19:14:33.561273 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423ee22-4192-4b94-8f81-6fc30555171d admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:33.571700 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423ee22-4192-4b94-8f81-6fc30555171d admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:33.609672 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7fe9bc-053f-4912-8b91-4be9e5616b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:33.609912 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fe9bc-053f-4912-8b91-4be9e5616b5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:33.610141 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fe9bc-053f-4912-8b91-4be9e5616b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:33.610383 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fe9bc-053f-4912-8b91-4be9e5616b5a admin admin] PATH_INFO: `/v3/projects/9a5cb863dfd143e987303713e8fccdc8/users/cd3c422162ec41b9b64bc0a5de113f29/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:33.644486 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7fe9bc-053f-4912-8b91-4be9e5616b5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a5cb863dfd143e987303713e8fccdc8, user_id=cd3c422162ec41b9b64bc0a5de113f29, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:33.650013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7fe9bc-053f-4912-8b91-4be9e5616b5a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:33.708405 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103dbdf-a483-4944-b501-5794e7a80b4a None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:33.708912 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103dbdf-a483-4944-b501-5794e7a80b4a None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:33.709045 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103dbdf-a483-4944-b501-5794e7a80b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:33.709404 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1166/2339] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:14:33 2022] PUT /identity/v3/projects/9a5cb863dfd143e987303713e8fccdc8/users/cd3c422162ec41b9b64bc0a5de113f29/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:14:33.770965 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-8103dbdf-a483-4944-b501-5794e7a80b4a None None] MFA Rules not processed for user `cd3c422162ec41b9b64bc0a5de113f29`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:14:33.773141 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-8103dbdf-a483-4944-b501-5794e7a80b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:33.853634 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1174/2340] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:14:33 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:14:33.858254 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7fe9bc-053f-4912-8b91-4be9e5616b5a admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:33.923734 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7fe9bc-053f-4912-8b91-4be9e5616b5a admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:33.929601 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c40e89-0bd9-46e8-88f9-aef008ef21aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:33.930594 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c40e89-0bd9-46e8-88f9-aef008ef21aa admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:33.931076 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c40e89-0bd9-46e8-88f9-aef008ef21aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:33.931503 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c40e89-0bd9-46e8-88f9-aef008ef21aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:33.932457 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c40e89-0bd9-46e8-88f9-aef008ef21aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:33.934577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c40e89-0bd9-46e8-88f9-aef008ef21aa admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:33.965583 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1167/2341] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:14:33 2022] POST /identity/v3/projects => generated 365 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:14:33.968697 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103dbdf-a483-4944-b501-5794e7a80b4a None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:33.980614 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103dbdf-a483-4944-b501-5794e7a80b4a None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:34.053899 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3036c17-7d60-4824-a9d6-28b07e97624b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:34.054785 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3036c17-7d60-4824-a9d6-28b07e97624b admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:34.055376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3036c17-7d60-4824-a9d6-28b07e97624b admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:34.055697 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3036c17-7d60-4824-a9d6-28b07e97624b admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:34.056498 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3036c17-7d60-4824-a9d6-28b07e97624b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:34.058391 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3036c17-7d60-4824-a9d6-28b07e97624b admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:34.087270 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1175/2342] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:14:33 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:14:34.088912 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c40e89-0bd9-46e8-88f9-aef008ef21aa admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:34.103018 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c40e89-0bd9-46e8-88f9-aef008ef21aa admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:34.107674 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054ccfb-c7e4-4546-8035-ce492573f2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:34.108338 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054ccfb-c7e4-4546-8035-ce492573f2e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:34.108813 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054ccfb-c7e4-4546-8035-ce492573f2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:34.109243 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054ccfb-c7e4-4546-8035-ce492573f2e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:34.110501 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1054ccfb-c7e4-4546-8035-ce492573f2e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:34.113036 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1054ccfb-c7e4-4546-8035-ce492573f2e6 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:34.128043 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1168/2343] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:14:34.132402 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3036c17-7d60-4824-a9d6-28b07e97624b admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:34.143018 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3036c17-7d60-4824-a9d6-28b07e97624b admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:34.150366 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08cb5e-7b13-459a-b568-21257bcf0d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:34.152316 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08cb5e-7b13-459a-b568-21257bcf0d71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:34.152597 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08cb5e-7b13-459a-b568-21257bcf0d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:34.152865 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08cb5e-7b13-459a-b568-21257bcf0d71 admin admin] PATH_INFO: `/v3/projects/8a38614898ac4faeb893f2a837ba7bc6/users/40f2fa8ee57a4a3a8cef4d7da3d6be09/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:34.177960 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08cb5e-7b13-459a-b568-21257bcf0d71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a38614898ac4faeb893f2a837ba7bc6, user_id=40f2fa8ee57a4a3a8cef4d7da3d6be09, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:34.180846 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08cb5e-7b13-459a-b568-21257bcf0d71 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:34.198186 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1176/2344] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:14:34 2022] PUT /identity/v3/projects/8a38614898ac4faeb893f2a837ba7bc6/users/40f2fa8ee57a4a3a8cef4d7da3d6be09/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:14:34.202218 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054ccfb-c7e4-4546-8035-ce492573f2e6 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:34.214258 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054ccfb-c7e4-4546-8035-ce492573f2e6 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:34.288534 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10992b-c3f5-427a-a1d7-d939ecb62f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:34.289719 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10992b-c3f5-427a-a1d7-d939ecb62f81 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:34.290304 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10992b-c3f5-427a-a1d7-d939ecb62f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:34.290585 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10992b-c3f5-427a-a1d7-d939ecb62f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:34.291374 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc10992b-c3f5-427a-a1d7-d939ecb62f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:34.292986 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc10992b-c3f5-427a-a1d7-d939ecb62f81 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:34.303736 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1169/2345] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 19:14:34.308055 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08cb5e-7b13-459a-b568-21257bcf0d71 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:34.319279 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08cb5e-7b13-459a-b568-21257bcf0d71 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:34.325246 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b51a22-236e-42bd-a6dc-75dd45121fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:34.326178 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b51a22-236e-42bd-a6dc-75dd45121fad admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:34.326456 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b51a22-236e-42bd-a6dc-75dd45121fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:34.326726 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b51a22-236e-42bd-a6dc-75dd45121fad admin admin] PATH_INFO: `/v3/projects/8a38614898ac4faeb893f2a837ba7bc6/users/40f2fa8ee57a4a3a8cef4d7da3d6be09/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:34.328998 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b51a22-236e-42bd-a6dc-75dd45121fad admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a38614898ac4faeb893f2a837ba7bc6, user_id=40f2fa8ee57a4a3a8cef4d7da3d6be09, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:34.331691 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b51a22-236e-42bd-a6dc-75dd45121fad admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:34.346786 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1177/2346] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:14:34 2022] PUT /identity/v3/projects/8a38614898ac4faeb893f2a837ba7bc6/users/40f2fa8ee57a4a3a8cef4d7da3d6be09/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:14:34.360463 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2cd34-afa7-4301-8376-4335d46badec None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:34.360788 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2cd34-afa7-4301-8376-4335d46badec None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:34.361048 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2cd34-afa7-4301-8376-4335d46badec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:34.394443 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-6ee2cd34-afa7-4301-8376-4335d46badec None None] MFA Rules not processed for user `40f2fa8ee57a4a3a8cef4d7da3d6be09`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:14:34.396064 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6ee2cd34-afa7-4301-8376-4335d46badec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:34.473755 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1170/2347] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:14:34 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:14:34.487883 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b51a22-236e-42bd-a6dc-75dd45121fad admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:34.489662 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f8b51a22-236e-42bd-a6dc-75dd45121fad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:34.554975 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b51a22-236e-42bd-a6dc-75dd45121fad admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:34.558739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523310de-b742-416a-8367-29198174be76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:34.559402 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523310de-b742-416a-8367-29198174be76 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:34.559684 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523310de-b742-416a-8367-29198174be76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:34.559961 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523310de-b742-416a-8367-29198174be76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:34.570281 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523310de-b742-416a-8367-29198174be76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:34.572465 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523310de-b742-416a-8367-29198174be76 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:34.585577 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1178/2348] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:14:34 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:14:34.682061 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2cd34-afa7-4301-8376-4335d46badec None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:34.693799 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2cd34-afa7-4301-8376-4335d46badec None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:34.701064 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c74fc3-2f28-4dec-9d97-f47d5f305145 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:34.701721 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c74fc3-2f28-4dec-9d97-f47d5f305145 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:34.701992 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c74fc3-2f28-4dec-9d97-f47d5f305145 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:34.702264 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c74fc3-2f28-4dec-9d97-f47d5f305145 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:34.782983 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c74fc3-2f28-4dec-9d97-f47d5f305145 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:34.784810 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c74fc3-2f28-4dec-9d97-f47d5f305145 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:34.808399 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1171/2349] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:14:34 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:14:44.285512 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523310de-b742-416a-8367-29198174be76 service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:44.346650 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523310de-b742-416a-8367-29198174be76 service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:44.351357 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7e719-5a96-467d-bbed-e3dc256d3776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:44.352869 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7e719-5a96-467d-bbed-e3dc256d3776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:44.352869 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7e719-5a96-467d-bbed-e3dc256d3776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:44.352869 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7e719-5a96-467d-bbed-e3dc256d3776 admin admin] PATH_INFO: `/v3/users/cd3c422162ec41b9b64bc0a5de113f29` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:44.354042 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7e719-5a96-467d-bbed-e3dc256d3776 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd3c422162ec41b9b64bc0a5de113f29)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:44.356048 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7e719-5a96-467d-bbed-e3dc256d3776 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:44.405429 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-79a7e719-5a96-467d-bbed-e3dc256d3776 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd3c422162ec41b9b64bc0a5de113f29'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:44.413235 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-79a7e719-5a96-467d-bbed-e3dc256d3776 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd3c422162ec41b9b64bc0a5de113f29'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:44.419961 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-79a7e719-5a96-467d-bbed-e3dc256d3776 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd3c422162ec41b9b64bc0a5de113f29'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:44.420584 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-79a7e719-5a96-467d-bbed-e3dc256d3776 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd3c422162ec41b9b64bc0a5de113f29'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:44.431626 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-79a7e719-5a96-467d-bbed-e3dc256d3776 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd3c422162ec41b9b64bc0a5de113f29'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:44.442791 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1179/2350] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:14:44 2022] DELETE /identity/v3/users/cd3c422162ec41b9b64bc0a5de113f29 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:14:44.447450 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb04c2-bde3-4498-b9db-cabfc9c9e246 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:44.447957 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb04c2-bde3-4498-b9db-cabfc9c9e246 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:44.448067 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb04c2-bde3-4498-b9db-cabfc9c9e246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:44.466437 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-c1cb04c2-bde3-4498-b9db-cabfc9c9e246 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:14:44.467651 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c1cb04c2-bde3-4498-b9db-cabfc9c9e246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:44.526278 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1172/2351] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:14:44.536312 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7e719-5a96-467d-bbed-e3dc256d3776 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:44.538223 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-79a7e719-5a96-467d-bbed-e3dc256d3776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:44.595364 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7e719-5a96-467d-bbed-e3dc256d3776 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:44.599405 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1406c8-ee31-4204-b21a-d83a63354218 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:44.600067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1406c8-ee31-4204-b21a-d83a63354218 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:44.600350 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1406c8-ee31-4204-b21a-d83a63354218 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:44.600621 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1406c8-ee31-4204-b21a-d83a63354218 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:44.610367 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1406c8-ee31-4204-b21a-d83a63354218 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:44.612024 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1406c8-ee31-4204-b21a-d83a63354218 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:44.622197 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1180/2352] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:14:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:14:44.895693 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb04c2-bde3-4498-b9db-cabfc9c9e246 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:44.897933 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c1cb04c2-bde3-4498-b9db-cabfc9c9e246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:44.911899 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb04c2-bde3-4498-b9db-cabfc9c9e246 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:44.917197 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90e7a4-44c3-418a-a5af-ffbaf36713d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:44.918231 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90e7a4-44c3-418a-a5af-ffbaf36713d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:44.918713 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90e7a4-44c3-418a-a5af-ffbaf36713d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:44.918985 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90e7a4-44c3-418a-a5af-ffbaf36713d2 admin admin] PATH_INFO: `/v3/projects/9a5cb863dfd143e987303713e8fccdc8` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:44.920465 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90e7a4-44c3-418a-a5af-ffbaf36713d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a5cb863dfd143e987303713e8fccdc8)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:44.922701 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90e7a4-44c3-418a-a5af-ffbaf36713d2 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:44.969413 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ff90e7a4-44c3-418a-a5af-ffbaf36713d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a5cb863dfd143e987303713e8fccdc8', 'request_id': 'req-ff90e7a4-44c3-418a-a5af-ffbaf36713d2'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:44.977287 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ff90e7a4-44c3-418a-a5af-ffbaf36713d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a5cb863dfd143e987303713e8fccdc8', 'request_id': 'req-ff90e7a4-44c3-418a-a5af-ffbaf36713d2'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:44.983207 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ff90e7a4-44c3-418a-a5af-ffbaf36713d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a5cb863dfd143e987303713e8fccdc8', 'request_id': 'req-ff90e7a4-44c3-418a-a5af-ffbaf36713d2'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:44.995102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ff90e7a4-44c3-418a-a5af-ffbaf36713d2 admin admin] The token cache is being invalidate because project 9a5cb863dfd143e987303713e8fccdc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:14:44.995372 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ff90e7a4-44c3-418a-a5af-ffbaf36713d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:44.996020 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ff90e7a4-44c3-418a-a5af-ffbaf36713d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:44.997715 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1173/2353] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:14:44 2022] DELETE /identity/v3/projects/9a5cb863dfd143e987303713e8fccdc8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:14:45.002009 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1406c8-ee31-4204-b21a-d83a63354218 service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:45.011681 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1406c8-ee31-4204-b21a-d83a63354218 service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:45.067079 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2c3df-e648-4225-9866-8f8b877976d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:45.067942 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2c3df-e648-4225-9866-8f8b877976d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:45.068215 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2c3df-e648-4225-9866-8f8b877976d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:45.068478 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2c3df-e648-4225-9866-8f8b877976d8 admin admin] PATH_INFO: `/v3/users/40f2fa8ee57a4a3a8cef4d7da3d6be09` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:45.069720 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2c3df-e648-4225-9866-8f8b877976d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40f2fa8ee57a4a3a8cef4d7da3d6be09)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:45.071659 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2c3df-e648-4225-9866-8f8b877976d8 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:45.117077 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-04f2c3df-e648-4225-9866-8f8b877976d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40f2fa8ee57a4a3a8cef4d7da3d6be09'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:45.125237 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-04f2c3df-e648-4225-9866-8f8b877976d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40f2fa8ee57a4a3a8cef4d7da3d6be09'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:45.132417 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-04f2c3df-e648-4225-9866-8f8b877976d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40f2fa8ee57a4a3a8cef4d7da3d6be09'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:45.133135 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-04f2c3df-e648-4225-9866-8f8b877976d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40f2fa8ee57a4a3a8cef4d7da3d6be09'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:45.146356 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-04f2c3df-e648-4225-9866-8f8b877976d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40f2fa8ee57a4a3a8cef4d7da3d6be09'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:45.152499 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1181/2354] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:14:45 2022] DELETE /identity/v3/users/40f2fa8ee57a4a3a8cef4d7da3d6be09 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:14:45.434302 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90e7a4-44c3-418a-a5af-ffbaf36713d2 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:45.437248 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ff90e7a4-44c3-418a-a5af-ffbaf36713d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:45.459144 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90e7a4-44c3-418a-a5af-ffbaf36713d2 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:45.525367 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26553cc7-b3a9-4cba-9c40-b9ab53cbdfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:45.526296 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26553cc7-b3a9-4cba-9c40-b9ab53cbdfb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:45.526576 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26553cc7-b3a9-4cba-9c40-b9ab53cbdfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:45.526907 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26553cc7-b3a9-4cba-9c40-b9ab53cbdfb1 admin admin] PATH_INFO: `/v3/projects/8a38614898ac4faeb893f2a837ba7bc6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:45.528191 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26553cc7-b3a9-4cba-9c40-b9ab53cbdfb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a38614898ac4faeb893f2a837ba7bc6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:45.530150 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26553cc7-b3a9-4cba-9c40-b9ab53cbdfb1 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:45.575014 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-26553cc7-b3a9-4cba-9c40-b9ab53cbdfb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a38614898ac4faeb893f2a837ba7bc6', 'request_id': 'req-26553cc7-b3a9-4cba-9c40-b9ab53cbdfb1'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:45.582157 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-26553cc7-b3a9-4cba-9c40-b9ab53cbdfb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a38614898ac4faeb893f2a837ba7bc6', 'request_id': 'req-26553cc7-b3a9-4cba-9c40-b9ab53cbdfb1'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:45.587834 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-26553cc7-b3a9-4cba-9c40-b9ab53cbdfb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a38614898ac4faeb893f2a837ba7bc6', 'request_id': 'req-26553cc7-b3a9-4cba-9c40-b9ab53cbdfb1'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:45.599624 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-26553cc7-b3a9-4cba-9c40-b9ab53cbdfb1 admin admin] The token cache is being invalidate because project 8a38614898ac4faeb893f2a837ba7bc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:14:45.599900 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-26553cc7-b3a9-4cba-9c40-b9ab53cbdfb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:45.600551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-26553cc7-b3a9-4cba-9c40-b9ab53cbdfb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:45.602105 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1174/2355] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:14:45 2022] DELETE /identity/v3/projects/8a38614898ac4faeb893f2a837ba7bc6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:14:45.607097 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd0093-89fe-496d-8f74-859870c55702 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:45.607584 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd0093-89fe-496d-8f74-859870c55702 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:45.607704 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd0093-89fe-496d-8f74-859870c55702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:45.626148 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-d7dd0093-89fe-496d-8f74-859870c55702 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:14:45.627414 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-d7dd0093-89fe-496d-8f74-859870c55702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:45.692195 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1182/2356] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:14:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:14:45.700126 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b59c1-ef7f-4956-abeb-40bf8ffa089c None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:45.700511 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b59c1-ef7f-4956-abeb-40bf8ffa089c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:45.700874 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b59c1-ef7f-4956-abeb-40bf8ffa089c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:45.719107 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-436b59c1-ef7f-4956-abeb-40bf8ffa089c None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:14:45.720560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-436b59c1-ef7f-4956-abeb-40bf8ffa089c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:45.728821 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1175/2357] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:14:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:14:45.733147 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd0093-89fe-496d-8f74-859870c55702 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:45.742429 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd0093-89fe-496d-8f74-859870c55702 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:45.747081 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba26f56-aae9-43e0-897c-a5fa843f5fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:45.747782 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba26f56-aae9-43e0-897c-a5fa843f5fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:45.748059 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba26f56-aae9-43e0-897c-a5fa843f5fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:45.748330 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba26f56-aae9-43e0-897c-a5fa843f5fa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:45.749055 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba26f56-aae9-43e0-897c-a5fa843f5fa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:14:45.749356 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba26f56-aae9-43e0-897c-a5fa843f5fa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:45.751029 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba26f56-aae9-43e0-897c-a5fa843f5fa5 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:45.764058 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1183/2358] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:14:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:14:45.769046 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b59c1-ef7f-4956-abeb-40bf8ffa089c None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:45.778839 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b59c1-ef7f-4956-abeb-40bf8ffa089c None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:45.783872 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a39b4-e763-4be7-8a09-a9dfb0442fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:45.784535 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a39b4-e763-4be7-8a09-a9dfb0442fc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:45.784824 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a39b4-e763-4be7-8a09-a9dfb0442fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:45.785100 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a39b4-e763-4be7-8a09-a9dfb0442fc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:45.785845 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137a39b4-e763-4be7-8a09-a9dfb0442fc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:45.787765 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137a39b4-e763-4be7-8a09-a9dfb0442fc9 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:45.814642 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1176/2359] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:14:45 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:14:45.819697 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba26f56-aae9-43e0-897c-a5fa843f5fa5 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:45.831572 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba26f56-aae9-43e0-897c-a5fa843f5fa5 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:45.900864 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d6be0-2e90-43c2-a73d-c3d118b76918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:45.901396 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d6be0-2e90-43c2-a73d-c3d118b76918 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:45.901727 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d6be0-2e90-43c2-a73d-c3d118b76918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:45.901971 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d6be0-2e90-43c2-a73d-c3d118b76918 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:45.902677 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d6be0-2e90-43c2-a73d-c3d118b76918 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:45.904619 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d6be0-2e90-43c2-a73d-c3d118b76918 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:45.926560 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1184/2360] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:14:45 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:14:45.932393 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a39b4-e763-4be7-8a09-a9dfb0442fc9 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:45.944069 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a39b4-e763-4be7-8a09-a9dfb0442fc9 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:45.950055 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5258b-f437-4f0e-b8a4-a6a1b6392685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:45.950717 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5258b-f437-4f0e-b8a4-a6a1b6392685 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:45.950998 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5258b-f437-4f0e-b8a4-a6a1b6392685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:45.951268 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5258b-f437-4f0e-b8a4-a6a1b6392685 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:45.952013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a5258b-f437-4f0e-b8a4-a6a1b6392685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:45.953646 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a5258b-f437-4f0e-b8a4-a6a1b6392685 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:45.964474 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1177/2361] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:14:45.968679 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d6be0-2e90-43c2-a73d-c3d118b76918 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:45.979349 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d6be0-2e90-43c2-a73d-c3d118b76918 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:45.985396 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80651f-b31f-4064-9d54-8cd22d03d14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:45.986138 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80651f-b31f-4064-9d54-8cd22d03d14f admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:45.986418 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80651f-b31f-4064-9d54-8cd22d03d14f admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:45.986676 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80651f-b31f-4064-9d54-8cd22d03d14f admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:45.987444 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80651f-b31f-4064-9d54-8cd22d03d14f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:45.989129 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80651f-b31f-4064-9d54-8cd22d03d14f admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:46.000682 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1185/2362] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:14:46.005861 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5258b-f437-4f0e-b8a4-a6a1b6392685 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:46.018481 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5258b-f437-4f0e-b8a4-a6a1b6392685 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:46.024257 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e6182-9622-4574-9c34-70d1dbc5ba07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:46.025562 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e6182-9622-4574-9c34-70d1dbc5ba07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:46.025878 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e6182-9622-4574-9c34-70d1dbc5ba07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:46.026246 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e6182-9622-4574-9c34-70d1dbc5ba07 admin admin] PATH_INFO: `/v3/projects/91cdb2a4377f4c49b73a777d3eaff130/users/6bf9d55e9a824d529eefe0f463e391a7/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:46.047571 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e6182-9622-4574-9c34-70d1dbc5ba07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91cdb2a4377f4c49b73a777d3eaff130, user_id=6bf9d55e9a824d529eefe0f463e391a7, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:46.050283 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e6182-9622-4574-9c34-70d1dbc5ba07 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:46.064461 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1178/2363] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:14:46 2022] PUT /identity/v3/projects/91cdb2a4377f4c49b73a777d3eaff130/users/6bf9d55e9a824d529eefe0f463e391a7/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:14:46.076257 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f0219-b0fc-4eb4-b1fb-0a9b876e10a3 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:46.076726 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f0219-b0fc-4eb4-b1fb-0a9b876e10a3 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:46.076978 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f0219-b0fc-4eb4-b1fb-0a9b876e10a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:46.106670 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-eb4f0219-b0fc-4eb4-b1fb-0a9b876e10a3 None None] MFA Rules not processed for user `6bf9d55e9a824d529eefe0f463e391a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:14:46.108015 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-eb4f0219-b0fc-4eb4-b1fb-0a9b876e10a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:46.188608 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1186/2364] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:14:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:14:46.193714 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e6182-9622-4574-9c34-70d1dbc5ba07 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:46.273870 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e6182-9622-4574-9c34-70d1dbc5ba07 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:46.279121 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8bb1d-dff2-4045-9809-eb4372239769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:46.279795 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8bb1d-dff2-4045-9809-eb4372239769 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:46.280077 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8bb1d-dff2-4045-9809-eb4372239769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:46.280349 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8bb1d-dff2-4045-9809-eb4372239769 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:46.281051 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8bb1d-dff2-4045-9809-eb4372239769 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:46.283006 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8bb1d-dff2-4045-9809-eb4372239769 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:46.310617 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1179/2365] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:14:46 2022] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:14:46.314667 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f0219-b0fc-4eb4-b1fb-0a9b876e10a3 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:46.325075 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f0219-b0fc-4eb4-b1fb-0a9b876e10a3 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:46.378415 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c11ad2-0cff-4fee-8347-8d1e08c51d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:46.379091 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c11ad2-0cff-4fee-8347-8d1e08c51d4c admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:46.379376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c11ad2-0cff-4fee-8347-8d1e08c51d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:46.379653 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c11ad2-0cff-4fee-8347-8d1e08c51d4c admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:46.380354 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c11ad2-0cff-4fee-8347-8d1e08c51d4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:46.382347 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c11ad2-0cff-4fee-8347-8d1e08c51d4c admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:46.404705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1187/2366] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:14:46 2022] POST /identity/v3/users => generated 297 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:14:46.409051 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8bb1d-dff2-4045-9809-eb4372239769 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:46.420882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8bb1d-dff2-4045-9809-eb4372239769 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:46.426078 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7310a-8c38-41c4-999a-fb38a764e99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:46.426800 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7310a-8c38-41c4-999a-fb38a764e99e admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:46.427076 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7310a-8c38-41c4-999a-fb38a764e99e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:46.427343 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7310a-8c38-41c4-999a-fb38a764e99e admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:46.428686 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b7310a-8c38-41c4-999a-fb38a764e99e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:46.430361 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b7310a-8c38-41c4-999a-fb38a764e99e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:46.441132 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1180/2367] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:14:46.446279 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c11ad2-0cff-4fee-8347-8d1e08c51d4c admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:46.458661 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c11ad2-0cff-4fee-8347-8d1e08c51d4c admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:46.463961 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6eb35d-70ce-4e11-87f8-76f5eb7d30de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:46.464941 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6eb35d-70ce-4e11-87f8-76f5eb7d30de admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:46.465314 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6eb35d-70ce-4e11-87f8-76f5eb7d30de admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:46.465710 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6eb35d-70ce-4e11-87f8-76f5eb7d30de admin admin] PATH_INFO: `/v3/projects/0374555e823f4a1c8a6cdd240aa55d89/users/6413c31151ff4575be40bff086cca367/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:46.480828 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6eb35d-70ce-4e11-87f8-76f5eb7d30de admin admin] RBAC: Authorizing `identity:create_grant(project_id=0374555e823f4a1c8a6cdd240aa55d89, user_id=6413c31151ff4575be40bff086cca367, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:46.483530 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6eb35d-70ce-4e11-87f8-76f5eb7d30de admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:46.497630 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1188/2368] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:14:46 2022] PUT /identity/v3/projects/0374555e823f4a1c8a6cdd240aa55d89/users/6413c31151ff4575be40bff086cca367/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:14:46.501585 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7310a-8c38-41c4-999a-fb38a764e99e admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:46.512300 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7310a-8c38-41c4-999a-fb38a764e99e admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:46.601238 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a1892-9fb6-4b6a-92c6-8a64758546c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:46.602153 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a1892-9fb6-4b6a-92c6-8a64758546c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:46.602573 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a1892-9fb6-4b6a-92c6-8a64758546c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:46.603130 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a1892-9fb6-4b6a-92c6-8a64758546c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:46.604316 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143a1892-9fb6-4b6a-92c6-8a64758546c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:46.606491 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143a1892-9fb6-4b6a-92c6-8a64758546c7 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:46.634730 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1181/2369] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:14:46.639441 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6eb35d-70ce-4e11-87f8-76f5eb7d30de admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:46.658137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6eb35d-70ce-4e11-87f8-76f5eb7d30de admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:46.670374 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a2e44-4aca-4b8a-b28d-f5bda0530df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:46.671951 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a2e44-4aca-4b8a-b28d-f5bda0530df9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:46.672380 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a2e44-4aca-4b8a-b28d-f5bda0530df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:46.672830 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a2e44-4aca-4b8a-b28d-f5bda0530df9 admin admin] PATH_INFO: `/v3/projects/0374555e823f4a1c8a6cdd240aa55d89/users/6413c31151ff4575be40bff086cca367/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:46.675956 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a2e44-4aca-4b8a-b28d-f5bda0530df9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0374555e823f4a1c8a6cdd240aa55d89, user_id=6413c31151ff4575be40bff086cca367, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:46.680549 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a2e44-4aca-4b8a-b28d-f5bda0530df9 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:46.702922 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1189/2370] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:14:46 2022] PUT /identity/v3/projects/0374555e823f4a1c8a6cdd240aa55d89/users/6413c31151ff4575be40bff086cca367/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:14:46.718720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379e4dc-ccbf-4709-9705-c11bb8c3821f None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:46.718925 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379e4dc-ccbf-4709-9705-c11bb8c3821f None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:46.719206 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379e4dc-ccbf-4709-9705-c11bb8c3821f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:46.748450 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-0379e4dc-ccbf-4709-9705-c11bb8c3821f None None] MFA Rules not processed for user `6413c31151ff4575be40bff086cca367`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:14:46.749953 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0379e4dc-ccbf-4709-9705-c11bb8c3821f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:46.822917 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1182/2371] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:14:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:14:46.835166 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a2e44-4aca-4b8a-b28d-f5bda0530df9 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:46.837352 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-d50a2e44-4aca-4b8a-b28d-f5bda0530df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:46.900384 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a2e44-4aca-4b8a-b28d-f5bda0530df9 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:46.904453 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92066b0-7394-4f14-bb72-34fe4cc88f11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:46.905145 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92066b0-7394-4f14-bb72-34fe4cc88f11 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:46.905428 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92066b0-7394-4f14-bb72-34fe4cc88f11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:46.906492 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92066b0-7394-4f14-bb72-34fe4cc88f11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:46.916883 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92066b0-7394-4f14-bb72-34fe4cc88f11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:46.918608 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92066b0-7394-4f14-bb72-34fe4cc88f11 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:46.929984 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1190/2372] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:14:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:14:47.291838 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0379e4dc-ccbf-4709-9705-c11bb8c3821f None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:47.304774 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0379e4dc-ccbf-4709-9705-c11bb8c3821f None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:47.315058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2b150-b320-452e-9db8-303953bef59b tempest-VolumeQuotaClassesTest-1002260417 tempest-VolumeQuotaClassesTest-1002260417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6413c31151ff4575be40bff086cca367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0374555e823f4a1c8a6cdd240aa55d89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:47.315838 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2b150-b320-452e-9db8-303953bef59b tempest-VolumeQuotaClassesTest-1002260417 tempest-VolumeQuotaClassesTest-1002260417-project-admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:47.316123 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2b150-b320-452e-9db8-303953bef59b tempest-VolumeQuotaClassesTest-1002260417 tempest-VolumeQuotaClassesTest-1002260417-project-admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:47.316477 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2b150-b320-452e-9db8-303953bef59b tempest-VolumeQuotaClassesTest-1002260417 tempest-VolumeQuotaClassesTest-1002260417-project-admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:47.317227 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2b150-b320-452e-9db8-303953bef59b tempest-VolumeQuotaClassesTest-1002260417 tempest-VolumeQuotaClassesTest-1002260417-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:14:47.317523 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2b150-b320-452e-9db8-303953bef59b tempest-VolumeQuotaClassesTest-1002260417 tempest-VolumeQuotaClassesTest-1002260417-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:47.319172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2b150-b320-452e-9db8-303953bef59b tempest-VolumeQuotaClassesTest-1002260417 tempest-VolumeQuotaClassesTest-1002260417-project-admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:47.331471 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1183/2373] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:14:47.336022 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92066b0-7394-4f14-bb72-34fe4cc88f11 service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:47.355587 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92066b0-7394-4f14-bb72-34fe4cc88f11 service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:47.361872 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae37e2-8287-4253-a30c-c588aac9ac95 tempest-VolumeQuotaClassesTest-1002260417 tempest-VolumeQuotaClassesTest-1002260417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6413c31151ff4575be40bff086cca367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0374555e823f4a1c8a6cdd240aa55d89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:47.362676 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae37e2-8287-4253-a30c-c588aac9ac95 tempest-VolumeQuotaClassesTest-1002260417 tempest-VolumeQuotaClassesTest-1002260417-project-admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:47.363048 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae37e2-8287-4253-a30c-c588aac9ac95 tempest-VolumeQuotaClassesTest-1002260417 tempest-VolumeQuotaClassesTest-1002260417-project-admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:47.363436 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae37e2-8287-4253-a30c-c588aac9ac95 tempest-VolumeQuotaClassesTest-1002260417 tempest-VolumeQuotaClassesTest-1002260417-project-admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:47.364298 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae37e2-8287-4253-a30c-c588aac9ac95 tempest-VolumeQuotaClassesTest-1002260417 tempest-VolumeQuotaClassesTest-1002260417-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:47.366367 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae37e2-8287-4253-a30c-c588aac9ac95 tempest-VolumeQuotaClassesTest-1002260417 tempest-VolumeQuotaClassesTest-1002260417-project-admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:47.399257 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1191/2374] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:14:47 2022] POST /identity/v3/projects => generated 354 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:14:47.401158 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2b150-b320-452e-9db8-303953bef59b tempest-VolumeQuotaClassesTest-1002260417 tempest-VolumeQuotaClassesTest-1002260417-project-admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:47.411184 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2b150-b320-452e-9db8-303953bef59b tempest-VolumeQuotaClassesTest-1002260417 tempest-VolumeQuotaClassesTest-1002260417-project-admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:47.467568 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ffac2-52fc-4649-9985-2040f4088807 tempest-VolumeQuotaClassesTest-1002260417 tempest-VolumeQuotaClassesTest-1002260417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6413c31151ff4575be40bff086cca367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0374555e823f4a1c8a6cdd240aa55d89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:47.468406 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ffac2-52fc-4649-9985-2040f4088807 tempest-VolumeQuotaClassesTest-1002260417 tempest-VolumeQuotaClassesTest-1002260417-project-admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:47.468759 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ffac2-52fc-4649-9985-2040f4088807 tempest-VolumeQuotaClassesTest-1002260417 tempest-VolumeQuotaClassesTest-1002260417-project-admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:47.469022 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ffac2-52fc-4649-9985-2040f4088807 tempest-VolumeQuotaClassesTest-1002260417 tempest-VolumeQuotaClassesTest-1002260417-project-admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:47.469791 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ffac2-52fc-4649-9985-2040f4088807 tempest-VolumeQuotaClassesTest-1002260417 tempest-VolumeQuotaClassesTest-1002260417-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:14:47.470104 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ffac2-52fc-4649-9985-2040f4088807 tempest-VolumeQuotaClassesTest-1002260417 tempest-VolumeQuotaClassesTest-1002260417-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:47.471819 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ffac2-52fc-4649-9985-2040f4088807 tempest-VolumeQuotaClassesTest-1002260417 tempest-VolumeQuotaClassesTest-1002260417-project-admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:47.484022 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1184/2375] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:14:47.520932 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae37e2-8287-4253-a30c-c588aac9ac95 tempest-VolumeQuotaClassesTest-1002260417 tempest-VolumeQuotaClassesTest-1002260417-project-admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:47.531864 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae37e2-8287-4253-a30c-c588aac9ac95 tempest-VolumeQuotaClassesTest-1002260417 tempest-VolumeQuotaClassesTest-1002260417-project-admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:47.536455 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7327bba-64be-4657-b7d1-255c0ec32412 tempest-VolumeQuotaClassesTest-1002260417 tempest-VolumeQuotaClassesTest-1002260417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6413c31151ff4575be40bff086cca367', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0374555e823f4a1c8a6cdd240aa55d89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:47.537371 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7327bba-64be-4657-b7d1-255c0ec32412 tempest-VolumeQuotaClassesTest-1002260417 tempest-VolumeQuotaClassesTest-1002260417-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:47.537749 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7327bba-64be-4657-b7d1-255c0ec32412 tempest-VolumeQuotaClassesTest-1002260417 tempest-VolumeQuotaClassesTest-1002260417-project-admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:47.538082 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7327bba-64be-4657-b7d1-255c0ec32412 tempest-VolumeQuotaClassesTest-1002260417 tempest-VolumeQuotaClassesTest-1002260417-project-admin] PATH_INFO: `/v3/projects/486ac2dd5bc34601a6cd5630b2fa212d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:47.539338 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7327bba-64be-4657-b7d1-255c0ec32412 tempest-VolumeQuotaClassesTest-1002260417 tempest-VolumeQuotaClassesTest-1002260417-project-admin] RBAC: Authorizing `identity:delete_project(project_id=486ac2dd5bc34601a6cd5630b2fa212d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:47.541255 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7327bba-64be-4657-b7d1-255c0ec32412 tempest-VolumeQuotaClassesTest-1002260417 tempest-VolumeQuotaClassesTest-1002260417-project-admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:47.588992 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f7327bba-64be-4657-b7d1-255c0ec32412 tempest-VolumeQuotaClassesTest-1002260417 tempest-VolumeQuotaClassesTest-1002260417-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '486ac2dd5bc34601a6cd5630b2fa212d', 'request_id': 'req-f7327bba-64be-4657-b7d1-255c0ec32412'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:47.595998 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f7327bba-64be-4657-b7d1-255c0ec32412 tempest-VolumeQuotaClassesTest-1002260417 tempest-VolumeQuotaClassesTest-1002260417-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '486ac2dd5bc34601a6cd5630b2fa212d', 'request_id': 'req-f7327bba-64be-4657-b7d1-255c0ec32412'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:47.603705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f7327bba-64be-4657-b7d1-255c0ec32412 tempest-VolumeQuotaClassesTest-1002260417 tempest-VolumeQuotaClassesTest-1002260417-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '486ac2dd5bc34601a6cd5630b2fa212d', 'request_id': 'req-f7327bba-64be-4657-b7d1-255c0ec32412'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:47.617408 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f7327bba-64be-4657-b7d1-255c0ec32412 tempest-VolumeQuotaClassesTest-1002260417 tempest-VolumeQuotaClassesTest-1002260417-project-admin] The token cache is being invalidate because project 486ac2dd5bc34601a6cd5630b2fa212d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:14:47.617725 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f7327bba-64be-4657-b7d1-255c0ec32412 tempest-VolumeQuotaClassesTest-1002260417 tempest-VolumeQuotaClassesTest-1002260417-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:47.618376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f7327bba-64be-4657-b7d1-255c0ec32412 tempest-VolumeQuotaClassesTest-1002260417 tempest-VolumeQuotaClassesTest-1002260417-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:47.619965 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1192/2376] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:14:47 2022] DELETE /identity/v3/projects/486ac2dd5bc34601a6cd5630b2fa212d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:14:47.834809 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ffac2-52fc-4649-9985-2040f4088807 tempest-VolumeQuotaClassesTest-1002260417 tempest-VolumeQuotaClassesTest-1002260417-project-admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:47.837055 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-806ffac2-52fc-4649-9985-2040f4088807 tempest-VolumeQuotaClassesTest-1002260417 tempest-VolumeQuotaClassesTest-1002260417-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:47.904383 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ffac2-52fc-4649-9985-2040f4088807 tempest-VolumeQuotaClassesTest-1002260417 tempest-VolumeQuotaClassesTest-1002260417-project-admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:47.969778 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db1457-c888-4f36-b01c-7821e5ece6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:47.970434 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db1457-c888-4f36-b01c-7821e5ece6fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:47.970865 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db1457-c888-4f36-b01c-7821e5ece6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:47.971249 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db1457-c888-4f36-b01c-7821e5ece6fb admin admin] PATH_INFO: `/v3/users/6bf9d55e9a824d529eefe0f463e391a7` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:47.972632 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db1457-c888-4f36-b01c-7821e5ece6fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bf9d55e9a824d529eefe0f463e391a7)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:47.975449 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db1457-c888-4f36-b01c-7821e5ece6fb admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:48.044560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b6db1457-c888-4f36-b01c-7821e5ece6fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bf9d55e9a824d529eefe0f463e391a7'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:48.052626 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b6db1457-c888-4f36-b01c-7821e5ece6fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bf9d55e9a824d529eefe0f463e391a7'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:48.065039 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b6db1457-c888-4f36-b01c-7821e5ece6fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bf9d55e9a824d529eefe0f463e391a7'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:48.081557 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b6db1457-c888-4f36-b01c-7821e5ece6fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bf9d55e9a824d529eefe0f463e391a7'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:48.082303 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b6db1457-c888-4f36-b01c-7821e5ece6fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bf9d55e9a824d529eefe0f463e391a7'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:48.090842 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1185/2377] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:14:47 2022] DELETE /identity/v3/users/6bf9d55e9a824d529eefe0f463e391a7 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:14:48.095887 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1105b2d-b4b3-4a3b-a5d7-052c97dc0913 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:48.097975 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1105b2d-b4b3-4a3b-a5d7-052c97dc0913 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:48.098491 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1105b2d-b4b3-4a3b-a5d7-052c97dc0913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:48.137267 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-d1105b2d-b4b3-4a3b-a5d7-052c97dc0913 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:14:48.138654 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-d1105b2d-b4b3-4a3b-a5d7-052c97dc0913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:48.155295 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a32246-1b35-4f39-984c-88d5552a5e99 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:48.155758 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a32246-1b35-4f39-984c-88d5552a5e99 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:48.156775 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a32246-1b35-4f39-984c-88d5552a5e99 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:48.163119 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1186/2378] 10.222.0.24 () {54 vars in 921 bytes} [Mon May 16 19:14:48 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:14:48.169444 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb889c0-ccd1-46fa-bff6-8e54fc6b1d98 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:48.169775 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb889c0-ccd1-46fa-bff6-8e54fc6b1d98 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:48.170472 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb889c0-ccd1-46fa-bff6-8e54fc6b1d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:48.198146 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-0cb889c0-ccd1-46fa-bff6-8e54fc6b1d98 None None] MFA Rules not processed for user `ee9e8d17cf1648e0b650df48b8f9487a`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:14:48.199164 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0cb889c0-ccd1-46fa-bff6-8e54fc6b1d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:48.235042 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1193/2379] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:14:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:14:48.243212 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1105b2d-b4b3-4a3b-a5d7-052c97dc0913 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:48.244813 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-d1105b2d-b4b3-4a3b-a5d7-052c97dc0913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:48.263237 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1187/2380] 10.222.0.24 () {58 vars in 1018 bytes} [Mon May 16 19:14:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:14:48.277262 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb889c0-ccd1-46fa-bff6-8e54fc6b1d98 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:48.279376 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0cb889c0-ccd1-46fa-bff6-8e54fc6b1d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:48.291416 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb889c0-ccd1-46fa-bff6-8e54fc6b1d98 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:48.295999 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec8aa5-8087-47a1-88b5-3a7a8fb8f7bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:48.296842 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec8aa5-8087-47a1-88b5-3a7a8fb8f7bd service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:48.297216 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec8aa5-8087-47a1-88b5-3a7a8fb8f7bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:48.297576 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec8aa5-8087-47a1-88b5-3a7a8fb8f7bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:48.308278 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec8aa5-8087-47a1-88b5-3a7a8fb8f7bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:48.309931 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec8aa5-8087-47a1-88b5-3a7a8fb8f7bd service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:48.319507 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1188/2381] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:14:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 19:14:48.324709 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1105b2d-b4b3-4a3b-a5d7-052c97dc0913 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:48.329664 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074eb64-ffae-4b96-b607-337d24e0ae31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:48.330510 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074eb64-ffae-4b96-b607-337d24e0ae31 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:48.330799 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074eb64-ffae-4b96-b607-337d24e0ae31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:48.331070 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074eb64-ffae-4b96-b607-337d24e0ae31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:48.341376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074eb64-ffae-4b96-b607-337d24e0ae31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:48.343234 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074eb64-ffae-4b96-b607-337d24e0ae31 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:48.356881 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1194/2382] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:14:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 19:14:48.459383 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e6c53-5c16-438e-9709-e19616518411 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:48.459383 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e6c53-5c16-438e-9709-e19616518411 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:48.459660 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e6c53-5c16-438e-9709-e19616518411 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:48.461204 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1189/2383] 10.222.0.24 () {54 vars in 921 bytes} [Mon May 16 19:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 19:14:48.482652 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fe2ee-dcfe-4db9-815e-3e6dce6ad124 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:48.482939 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fe2ee-dcfe-4db9-815e-3e6dce6ad124 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:48.483222 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fe2ee-dcfe-4db9-815e-3e6dce6ad124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:48.503936 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-ed5fe2ee-dcfe-4db9-815e-3e6dce6ad124 None None] MFA Rules not processed for user `1f03aa520ee14615b802cdbc3cd4f87d`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:14:48.505180 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-ed5fe2ee-dcfe-4db9-815e-3e6dce6ad124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:48.621974 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1195/2384] 10.222.0.24 () {58 vars in 1018 bytes} [Mon May 16 19:14:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:14:48.633653 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e6c53-5c16-438e-9709-e19616518411 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:48.646634 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e6c53-5c16-438e-9709-e19616518411 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:48.650652 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e7c407-d333-43a7-a9db-e94ebf3ee657 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:48.651628 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7c407-d333-43a7-a9db-e94ebf3ee657 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:48.651766 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7c407-d333-43a7-a9db-e94ebf3ee657 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:48.652051 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7c407-d333-43a7-a9db-e94ebf3ee657 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:48.663540 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e7c407-d333-43a7-a9db-e94ebf3ee657 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:48.664848 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e7c407-d333-43a7-a9db-e94ebf3ee657 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:48.678405 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1190/2385] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:14:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:14:48.758026 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5fe2ee-dcfe-4db9-815e-3e6dce6ad124 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:48.759723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-ed5fe2ee-dcfe-4db9-815e-3e6dce6ad124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:48.793426 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5fe2ee-dcfe-4db9-815e-3e6dce6ad124 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:48.800719 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192643f8-0464-4a90-b012-5917f6deb2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:48.812055 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192643f8-0464-4a90-b012-5917f6deb2e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:48.812314 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192643f8-0464-4a90-b012-5917f6deb2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:48.813383 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192643f8-0464-4a90-b012-5917f6deb2e6 admin admin] PATH_INFO: `/v3/projects/91cdb2a4377f4c49b73a777d3eaff130` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:48.814909 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192643f8-0464-4a90-b012-5917f6deb2e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91cdb2a4377f4c49b73a777d3eaff130)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:48.818141 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192643f8-0464-4a90-b012-5917f6deb2e6 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:48.877444 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-192643f8-0464-4a90-b012-5917f6deb2e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91cdb2a4377f4c49b73a777d3eaff130', 'request_id': 'req-192643f8-0464-4a90-b012-5917f6deb2e6'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:48.882733 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-192643f8-0464-4a90-b012-5917f6deb2e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91cdb2a4377f4c49b73a777d3eaff130', 'request_id': 'req-192643f8-0464-4a90-b012-5917f6deb2e6'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:48.888819 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-192643f8-0464-4a90-b012-5917f6deb2e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91cdb2a4377f4c49b73a777d3eaff130', 'request_id': 'req-192643f8-0464-4a90-b012-5917f6deb2e6'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:48.903381 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-192643f8-0464-4a90-b012-5917f6deb2e6 admin admin] The token cache is being invalidate because project 91cdb2a4377f4c49b73a777d3eaff130 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:14:48.903668 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-192643f8-0464-4a90-b012-5917f6deb2e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:48.904348 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-192643f8-0464-4a90-b012-5917f6deb2e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:48.906038 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1196/2386] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:14:48 2022] DELETE /identity/v3/projects/91cdb2a4377f4c49b73a777d3eaff130 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:14:48.910154 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e7c407-d333-43a7-a9db-e94ebf3ee657 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:48.920324 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e7c407-d333-43a7-a9db-e94ebf3ee657 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:48.983969 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f5487-95ec-47de-b78f-4391ec45a65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:48.984867 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f5487-95ec-47de-b78f-4391ec45a65e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:48.985134 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f5487-95ec-47de-b78f-4391ec45a65e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:48.985405 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f5487-95ec-47de-b78f-4391ec45a65e admin admin] PATH_INFO: `/v3/users/6413c31151ff4575be40bff086cca367` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:48.986627 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f5487-95ec-47de-b78f-4391ec45a65e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6413c31151ff4575be40bff086cca367)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:48.988625 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f5487-95ec-47de-b78f-4391ec45a65e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:49.034436 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7d6f5487-95ec-47de-b78f-4391ec45a65e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6413c31151ff4575be40bff086cca367'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:49.041692 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7d6f5487-95ec-47de-b78f-4391ec45a65e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6413c31151ff4575be40bff086cca367'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:49.050583 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7d6f5487-95ec-47de-b78f-4391ec45a65e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6413c31151ff4575be40bff086cca367'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:49.063182 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7d6f5487-95ec-47de-b78f-4391ec45a65e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6413c31151ff4575be40bff086cca367'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:49.063855 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7d6f5487-95ec-47de-b78f-4391ec45a65e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6413c31151ff4575be40bff086cca367'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:49.070841 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1191/2387] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:14:48 2022] DELETE /identity/v3/users/6413c31151ff4575be40bff086cca367 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:14:49.368564 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192643f8-0464-4a90-b012-5917f6deb2e6 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:49.370082 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-192643f8-0464-4a90-b012-5917f6deb2e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:49.391440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192643f8-0464-4a90-b012-5917f6deb2e6 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:49.493381 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aacd9e-0ead-43d7-a517-fa327f6b7a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:49.494848 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aacd9e-0ead-43d7-a517-fa327f6b7a67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:49.495133 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aacd9e-0ead-43d7-a517-fa327f6b7a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:49.495407 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aacd9e-0ead-43d7-a517-fa327f6b7a67 admin admin] PATH_INFO: `/v3/projects/0374555e823f4a1c8a6cdd240aa55d89` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:49.496870 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aacd9e-0ead-43d7-a517-fa327f6b7a67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0374555e823f4a1c8a6cdd240aa55d89)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:49.499215 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aacd9e-0ead-43d7-a517-fa327f6b7a67 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:49.552044 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a6aacd9e-0ead-43d7-a517-fa327f6b7a67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0374555e823f4a1c8a6cdd240aa55d89', 'request_id': 'req-a6aacd9e-0ead-43d7-a517-fa327f6b7a67'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:49.560802 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a6aacd9e-0ead-43d7-a517-fa327f6b7a67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0374555e823f4a1c8a6cdd240aa55d89', 'request_id': 'req-a6aacd9e-0ead-43d7-a517-fa327f6b7a67'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:49.567009 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a6aacd9e-0ead-43d7-a517-fa327f6b7a67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0374555e823f4a1c8a6cdd240aa55d89', 'request_id': 'req-a6aacd9e-0ead-43d7-a517-fa327f6b7a67'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:49.580556 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a6aacd9e-0ead-43d7-a517-fa327f6b7a67 admin admin] The token cache is being invalidate because project 0374555e823f4a1c8a6cdd240aa55d89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:14:49.580920 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a6aacd9e-0ead-43d7-a517-fa327f6b7a67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:49.581629 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a6aacd9e-0ead-43d7-a517-fa327f6b7a67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:49.586640 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1197/2388] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:14:49 2022] DELETE /identity/v3/projects/0374555e823f4a1c8a6cdd240aa55d89 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:14:49.588684 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1490c7-5fa2-473d-9334-2fedb72df62a None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:49.588846 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1490c7-5fa2-473d-9334-2fedb72df62a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:49.589243 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1490c7-5fa2-473d-9334-2fedb72df62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:49.610529 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-5f1490c7-5fa2-473d-9334-2fedb72df62a None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:14:49.611748 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5f1490c7-5fa2-473d-9334-2fedb72df62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:49.677363 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1192/2389] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:14:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:14:49.685496 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616854b-30dc-44f8-ba48-800f2e554a93 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:49.686019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616854b-30dc-44f8-ba48-800f2e554a93 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:49.686538 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616854b-30dc-44f8-ba48-800f2e554a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:49.708474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-c616854b-30dc-44f8-ba48-800f2e554a93 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:14:49.710053 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-c616854b-30dc-44f8-ba48-800f2e554a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:49.725514 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1198/2390] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:14:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:14:49.727787 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1490c7-5fa2-473d-9334-2fedb72df62a None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:49.737374 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1490c7-5fa2-473d-9334-2fedb72df62a None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:49.744014 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f6b67-3ddd-4602-ba5c-f9aeaa0ee386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:49.746195 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f6b67-3ddd-4602-ba5c-f9aeaa0ee386 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:49.746547 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f6b67-3ddd-4602-ba5c-f9aeaa0ee386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:49.746881 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f6b67-3ddd-4602-ba5c-f9aeaa0ee386 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:49.747686 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2f6b67-3ddd-4602-ba5c-f9aeaa0ee386 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:14:49.748078 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2f6b67-3ddd-4602-ba5c-f9aeaa0ee386 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:49.749824 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2f6b67-3ddd-4602-ba5c-f9aeaa0ee386 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:49.763659 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1193/2391] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:14:49.768634 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616854b-30dc-44f8-ba48-800f2e554a93 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:49.778439 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616854b-30dc-44f8-ba48-800f2e554a93 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:49.788219 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f60b9-be10-4cad-a9cf-2d53de001144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:49.789219 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f60b9-be10-4cad-a9cf-2d53de001144 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:49.789595 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f60b9-be10-4cad-a9cf-2d53de001144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:49.790021 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f60b9-be10-4cad-a9cf-2d53de001144 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:49.791164 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f60b9-be10-4cad-a9cf-2d53de001144 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:49.794203 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f60b9-be10-4cad-a9cf-2d53de001144 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:49.833571 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1199/2392] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:14:49 2022] POST /identity/v3/projects => generated 367 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:14:49.837928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f6b67-3ddd-4602-ba5c-f9aeaa0ee386 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:49.848560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f6b67-3ddd-4602-ba5c-f9aeaa0ee386 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:49.917970 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260de16-1547-4891-b15f-ecaa1569a7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:49.918702 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260de16-1547-4891-b15f-ecaa1569a7c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:49.918976 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260de16-1547-4891-b15f-ecaa1569a7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:49.919243 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260de16-1547-4891-b15f-ecaa1569a7c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:49.919934 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260de16-1547-4891-b15f-ecaa1569a7c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:49.923326 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260de16-1547-4891-b15f-ecaa1569a7c5 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:49.952484 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1194/2393] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:14:49 2022] POST /identity/v3/users => generated 284 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:14:49.953711 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f60b9-be10-4cad-a9cf-2d53de001144 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:49.964166 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f60b9-be10-4cad-a9cf-2d53de001144 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:49.969108 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da906fb-1d4a-45d6-99c8-62c9fbfa20c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:49.969807 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da906fb-1d4a-45d6-99c8-62c9fbfa20c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:49.970086 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da906fb-1d4a-45d6-99c8-62c9fbfa20c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:49.970356 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da906fb-1d4a-45d6-99c8-62c9fbfa20c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:49.971114 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da906fb-1d4a-45d6-99c8-62c9fbfa20c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:49.972870 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da906fb-1d4a-45d6-99c8-62c9fbfa20c0 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:49.984651 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1200/2394] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:14:49.990218 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260de16-1547-4891-b15f-ecaa1569a7c5 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:50.004034 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260de16-1547-4891-b15f-ecaa1569a7c5 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:50.010562 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff31224-9202-4503-83cc-bd6979b3c96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:50.011734 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff31224-9202-4503-83cc-bd6979b3c96e admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:50.012224 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff31224-9202-4503-83cc-bd6979b3c96e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:50.013111 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff31224-9202-4503-83cc-bd6979b3c96e admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:50.014499 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff31224-9202-4503-83cc-bd6979b3c96e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:50.016240 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff31224-9202-4503-83cc-bd6979b3c96e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:50.034185 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1195/2395] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 19:14:50.038381 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da906fb-1d4a-45d6-99c8-62c9fbfa20c0 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:50.049787 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da906fb-1d4a-45d6-99c8-62c9fbfa20c0 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:50.056362 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead1f0c-c270-4f71-a781-2c043a13ad2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:50.061107 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead1f0c-c270-4f71-a781-2c043a13ad2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:50.061390 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead1f0c-c270-4f71-a781-2c043a13ad2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:50.061840 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead1f0c-c270-4f71-a781-2c043a13ad2b admin admin] PATH_INFO: `/v3/projects/e45e7e61c70d433586e20961ab4530b0/users/e95b752e04004ba7a736b58e15216a4b/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:50.084695 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead1f0c-c270-4f71-a781-2c043a13ad2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e45e7e61c70d433586e20961ab4530b0, user_id=e95b752e04004ba7a736b58e15216a4b, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:50.088322 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead1f0c-c270-4f71-a781-2c043a13ad2b admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:50.106839 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1201/2396] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:14:50 2022] PUT /identity/v3/projects/e45e7e61c70d433586e20961ab4530b0/users/e95b752e04004ba7a736b58e15216a4b/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:14:50.118371 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69791cdc-e738-429c-bda9-7b920f5b7274 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:50.118724 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69791cdc-e738-429c-bda9-7b920f5b7274 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:50.119075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69791cdc-e738-429c-bda9-7b920f5b7274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:50.151492 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-69791cdc-e738-429c-bda9-7b920f5b7274 None None] MFA Rules not processed for user `e95b752e04004ba7a736b58e15216a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:14:50.152882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-69791cdc-e738-429c-bda9-7b920f5b7274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:50.233629 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1196/2397] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:14:50 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:14:50.235422 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead1f0c-c270-4f71-a781-2c043a13ad2b admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:50.252133 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45caa9f2-4da5-43ff-bec1-9676f2f7ce72 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:50.252541 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45caa9f2-4da5-43ff-bec1-9676f2f7ce72 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:50.252819 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45caa9f2-4da5-43ff-bec1-9676f2f7ce72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:50.272364 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-45caa9f2-4da5-43ff-bec1-9676f2f7ce72 None None] MFA Rules not processed for user `4775e9dd7aea448d95ec7378b4ff3124`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:14:50.273553 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-45caa9f2-4da5-43ff-bec1-9676f2f7ce72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:50.319505 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead1f0c-c270-4f71-a781-2c043a13ad2b admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:50.325019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e84b5-3f7a-4881-9d6d-0c288eacd42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:50.325938 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e84b5-3f7a-4881-9d6d-0c288eacd42b admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:50.326392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e84b5-3f7a-4881-9d6d-0c288eacd42b admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:50.326846 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e84b5-3f7a-4881-9d6d-0c288eacd42b admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:50.327737 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768e84b5-3f7a-4881-9d6d-0c288eacd42b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:50.330099 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768e84b5-3f7a-4881-9d6d-0c288eacd42b admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:50.355446 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1197/2398] 10.222.0.24 () {58 vars in 1009 bytes} [Mon May 16 19:14:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:14:50.361716 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1202/2399] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:14:50 2022] POST /identity/v3/projects => generated 365 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:14:50.365319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45caa9f2-4da5-43ff-bec1-9676f2f7ce72 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:50.370766 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e84b5-3f7a-4881-9d6d-0c288eacd42b admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:50.372768 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-768e84b5-3f7a-4881-9d6d-0c288eacd42b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:50.384285 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45caa9f2-4da5-43ff-bec1-9676f2f7ce72 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:50.449400 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943ca1b-9b49-4c53-bac9-85f33796e321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:50.450119 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943ca1b-9b49-4c53-bac9-85f33796e321 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:50.450398 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943ca1b-9b49-4c53-bac9-85f33796e321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:50.450671 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943ca1b-9b49-4c53-bac9-85f33796e321 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:50.451372 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943ca1b-9b49-4c53-bac9-85f33796e321 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:50.453800 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943ca1b-9b49-4c53-bac9-85f33796e321 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:50.457048 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e84b5-3f7a-4881-9d6d-0c288eacd42b admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:50.462497 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9c63c-d210-4957-b8d0-4d1d054555a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '654e435a35c4491eb87943734ce280f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:50.463476 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9c63c-d210-4957-b8d0-4d1d054555a6 service swift] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:50.463957 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9c63c-d210-4957-b8d0-4d1d054555a6 service swift] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:50.464313 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9c63c-d210-4957-b8d0-4d1d054555a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:50.480077 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1198/2400] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:14:50 2022] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:14:50.486200 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943ca1b-9b49-4c53-bac9-85f33796e321 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:50.498320 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943ca1b-9b49-4c53-bac9-85f33796e321 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:50.503817 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa76b4-3a1a-4288-b54a-8f4246f08486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:50.504544 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa76b4-3a1a-4288-b54a-8f4246f08486 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:50.504824 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa76b4-3a1a-4288-b54a-8f4246f08486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:50.505094 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa76b4-3a1a-4288-b54a-8f4246f08486 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:50.505862 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa76b4-3a1a-4288-b54a-8f4246f08486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:50.508167 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa76b4-3a1a-4288-b54a-8f4246f08486 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:50.522816 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1199/2401] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:14:50.524897 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa76b4-3a1a-4288-b54a-8f4246f08486 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:50.535461 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa76b4-3a1a-4288-b54a-8f4246f08486 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:50.540423 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d03af-046a-4bb9-a326-26bb33ec2c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:50.541341 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d03af-046a-4bb9-a326-26bb33ec2c99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:50.541651 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d03af-046a-4bb9-a326-26bb33ec2c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:50.541925 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d03af-046a-4bb9-a326-26bb33ec2c99 admin admin] PATH_INFO: `/v3/projects/da0a642e3a704ed1b289ab518acbc0b7/users/0cf0c822e05e4f62ac2085016525515f/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:50.546427 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf9c63c-d210-4957-b8d0-4d1d054555a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:50.548242 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf9c63c-d210-4957-b8d0-4d1d054555a6 service swift] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:50.557750 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1203/2402] 10.222.0.24 () {60 vars in 1384 bytes} [Mon May 16 19:14:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 19:14:50.558251 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d03af-046a-4bb9-a326-26bb33ec2c99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da0a642e3a704ed1b289ab518acbc0b7, user_id=0cf0c822e05e4f62ac2085016525515f, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:50.561258 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d03af-046a-4bb9-a326-26bb33ec2c99 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:50.577292 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1200/2403] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:14:50 2022] PUT /identity/v3/projects/da0a642e3a704ed1b289ab518acbc0b7/users/0cf0c822e05e4f62ac2085016525515f/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:14:50.589279 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9c63c-d210-4957-b8d0-4d1d054555a6 service swift] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:50.608251 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9c63c-d210-4957-b8d0-4d1d054555a6 service swift] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:50.686486 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856c922-9aee-490a-af57-616798478b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:50.687612 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856c922-9aee-490a-af57-616798478b55 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:50.688092 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856c922-9aee-490a-af57-616798478b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:50.688482 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856c922-9aee-490a-af57-616798478b55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:50.689437 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5856c922-9aee-490a-af57-616798478b55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:50.691631 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5856c922-9aee-490a-af57-616798478b55 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:50.706585 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1204/2404] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:14:50.710506 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d03af-046a-4bb9-a326-26bb33ec2c99 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:50.731039 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d03af-046a-4bb9-a326-26bb33ec2c99 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:50.738930 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfdd322-82eb-445e-90e4-999604c20cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:50.739965 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdd322-82eb-445e-90e4-999604c20cf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:50.740310 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdd322-82eb-445e-90e4-999604c20cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:50.740646 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdd322-82eb-445e-90e4-999604c20cf5 admin admin] PATH_INFO: `/v3/projects/da0a642e3a704ed1b289ab518acbc0b7/users/0cf0c822e05e4f62ac2085016525515f/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:50.746745 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfdd322-82eb-445e-90e4-999604c20cf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da0a642e3a704ed1b289ab518acbc0b7, user_id=0cf0c822e05e4f62ac2085016525515f, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:50.750026 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfdd322-82eb-445e-90e4-999604c20cf5 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:50.763971 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1201/2405] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:14:50 2022] PUT /identity/v3/projects/da0a642e3a704ed1b289ab518acbc0b7/users/0cf0c822e05e4f62ac2085016525515f/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:14:50.775134 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a690f42-5906-4a7e-9dc4-730743343a05 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:50.775352 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a690f42-5906-4a7e-9dc4-730743343a05 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:50.775631 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a690f42-5906-4a7e-9dc4-730743343a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:50.803706 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-4a690f42-5906-4a7e-9dc4-730743343a05 None None] MFA Rules not processed for user `0cf0c822e05e4f62ac2085016525515f`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:14:50.804938 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-4a690f42-5906-4a7e-9dc4-730743343a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:50.874977 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1205/2406] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:14:50 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:14:50.890899 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfdd322-82eb-445e-90e4-999604c20cf5 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:50.894292 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0dfdd322-82eb-445e-90e4-999604c20cf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:50.957901 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfdd322-82eb-445e-90e4-999604c20cf5 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:50.962409 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9557b5-98f0-42ad-bfae-854f9187fa90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:50.963046 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9557b5-98f0-42ad-bfae-854f9187fa90 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:50.963323 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9557b5-98f0-42ad-bfae-854f9187fa90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:50.963594 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9557b5-98f0-42ad-bfae-854f9187fa90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:50.973682 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9557b5-98f0-42ad-bfae-854f9187fa90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:50.975130 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9557b5-98f0-42ad-bfae-854f9187fa90 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:50.984822 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1202/2407] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:14:50 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:14:51.069126 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a690f42-5906-4a7e-9dc4-730743343a05 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:51.079286 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a690f42-5906-4a7e-9dc4-730743343a05 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:51.083272 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc04ae-fe9e-4d45-a814-c8c9612e2a54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:51.083911 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc04ae-fe9e-4d45-a814-c8c9612e2a54 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:51.084190 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc04ae-fe9e-4d45-a814-c8c9612e2a54 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:51.084462 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc04ae-fe9e-4d45-a814-c8c9612e2a54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:51.140577 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc04ae-fe9e-4d45-a814-c8c9612e2a54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:51.142068 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc04ae-fe9e-4d45-a814-c8c9612e2a54 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:51.151064 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1206/2408] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:14:51 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:14:56.202080 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9557b5-98f0-42ad-bfae-854f9187fa90 service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:56.271772 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9557b5-98f0-42ad-bfae-854f9187fa90 service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:56.276802 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efef92-63aa-4de8-bcaa-f4756bfa580d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:56.278077 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efef92-63aa-4de8-bcaa-f4756bfa580d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:56.278356 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efef92-63aa-4de8-bcaa-f4756bfa580d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:56.278704 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efef92-63aa-4de8-bcaa-f4756bfa580d admin admin] PATH_INFO: `/v3/users/e95b752e04004ba7a736b58e15216a4b` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:56.280058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53efef92-63aa-4de8-bcaa-f4756bfa580d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e95b752e04004ba7a736b58e15216a4b)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:56.282061 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53efef92-63aa-4de8-bcaa-f4756bfa580d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:56.330256 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-53efef92-63aa-4de8-bcaa-f4756bfa580d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e95b752e04004ba7a736b58e15216a4b'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:56.336855 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-53efef92-63aa-4de8-bcaa-f4756bfa580d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e95b752e04004ba7a736b58e15216a4b'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:56.344968 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-53efef92-63aa-4de8-bcaa-f4756bfa580d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e95b752e04004ba7a736b58e15216a4b'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:56.356233 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-53efef92-63aa-4de8-bcaa-f4756bfa580d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e95b752e04004ba7a736b58e15216a4b'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:56.357012 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-53efef92-63aa-4de8-bcaa-f4756bfa580d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e95b752e04004ba7a736b58e15216a4b'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:56.362705 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1203/2409] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:14:56 2022] DELETE /identity/v3/users/e95b752e04004ba7a736b58e15216a4b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:14:56.367537 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27907e86-1b33-4230-9fc1-33e34b9a0ac0 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:56.368036 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27907e86-1b33-4230-9fc1-33e34b9a0ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:56.368223 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27907e86-1b33-4230-9fc1-33e34b9a0ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:56.385484 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-27907e86-1b33-4230-9fc1-33e34b9a0ac0 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:14:56.386720 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-27907e86-1b33-4230-9fc1-33e34b9a0ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:56.451836 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1207/2410] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:14:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:14:56.462602 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efef92-63aa-4de8-bcaa-f4756bfa580d admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:56.464266 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-53efef92-63aa-4de8-bcaa-f4756bfa580d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:56.547956 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efef92-63aa-4de8-bcaa-f4756bfa580d admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:56.551782 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34abe703-9681-4b08-8279-1a284dd74654 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:56.552447 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abe703-9681-4b08-8279-1a284dd74654 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:56.552732 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abe703-9681-4b08-8279-1a284dd74654 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:56.552993 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abe703-9681-4b08-8279-1a284dd74654 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:56.562805 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34abe703-9681-4b08-8279-1a284dd74654 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:56.564245 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34abe703-9681-4b08-8279-1a284dd74654 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:56.573748 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1204/2411] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:14:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:14:56.898895 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27907e86-1b33-4230-9fc1-33e34b9a0ac0 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:56.900976 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-27907e86-1b33-4230-9fc1-33e34b9a0ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:56.915601 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27907e86-1b33-4230-9fc1-33e34b9a0ac0 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:56.921063 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73fc86-c989-4ad9-9bd0-aa82df140e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:56.922076 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73fc86-c989-4ad9-9bd0-aa82df140e13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:56.922466 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73fc86-c989-4ad9-9bd0-aa82df140e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:56.922830 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73fc86-c989-4ad9-9bd0-aa82df140e13 admin admin] PATH_INFO: `/v3/projects/e45e7e61c70d433586e20961ab4530b0` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:56.924290 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73fc86-c989-4ad9-9bd0-aa82df140e13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e45e7e61c70d433586e20961ab4530b0)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:56.926408 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73fc86-c989-4ad9-9bd0-aa82df140e13 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:57.018017 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ed73fc86-c989-4ad9-9bd0-aa82df140e13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e45e7e61c70d433586e20961ab4530b0', 'request_id': 'req-ed73fc86-c989-4ad9-9bd0-aa82df140e13'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:57.024461 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ed73fc86-c989-4ad9-9bd0-aa82df140e13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e45e7e61c70d433586e20961ab4530b0', 'request_id': 'req-ed73fc86-c989-4ad9-9bd0-aa82df140e13'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:57.031446 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ed73fc86-c989-4ad9-9bd0-aa82df140e13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e45e7e61c70d433586e20961ab4530b0', 'request_id': 'req-ed73fc86-c989-4ad9-9bd0-aa82df140e13'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:57.045487 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ed73fc86-c989-4ad9-9bd0-aa82df140e13 admin admin] The token cache is being invalidate because project e45e7e61c70d433586e20961ab4530b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:14:57.045825 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ed73fc86-c989-4ad9-9bd0-aa82df140e13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:57.046497 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ed73fc86-c989-4ad9-9bd0-aa82df140e13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:57.048169 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1208/2412] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:14:56 2022] DELETE /identity/v3/projects/e45e7e61c70d433586e20961ab4530b0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:14:57.052539 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34abe703-9681-4b08-8279-1a284dd74654 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:57.062994 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34abe703-9681-4b08-8279-1a284dd74654 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:57.140565 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a67d2-5957-4dc9-8bc8-d256e822bae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:57.143953 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a67d2-5957-4dc9-8bc8-d256e822bae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:57.143953 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a67d2-5957-4dc9-8bc8-d256e822bae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:57.143953 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a67d2-5957-4dc9-8bc8-d256e822bae4 admin admin] PATH_INFO: `/v3/users/0cf0c822e05e4f62ac2085016525515f` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:57.144829 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a67d2-5957-4dc9-8bc8-d256e822bae4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cf0c822e05e4f62ac2085016525515f)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:57.147334 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a67d2-5957-4dc9-8bc8-d256e822bae4 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:57.306350 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-138a67d2-5957-4dc9-8bc8-d256e822bae4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cf0c822e05e4f62ac2085016525515f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:57.313808 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-138a67d2-5957-4dc9-8bc8-d256e822bae4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cf0c822e05e4f62ac2085016525515f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:57.323206 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-138a67d2-5957-4dc9-8bc8-d256e822bae4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cf0c822e05e4f62ac2085016525515f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:57.342033 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-138a67d2-5957-4dc9-8bc8-d256e822bae4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cf0c822e05e4f62ac2085016525515f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:57.342822 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-138a67d2-5957-4dc9-8bc8-d256e822bae4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cf0c822e05e4f62ac2085016525515f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:57.349256 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1205/2413] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:14:57 2022] DELETE /identity/v3/users/0cf0c822e05e4f62ac2085016525515f => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:14:57.621727 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73fc86-c989-4ad9-9bd0-aa82df140e13 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:57.623723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-ed73fc86-c989-4ad9-9bd0-aa82df140e13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:57.660268 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73fc86-c989-4ad9-9bd0-aa82df140e13 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:57.761855 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836495d-6238-4578-af03-4ab5364c2e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:57.763125 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836495d-6238-4578-af03-4ab5364c2e16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:57.763407 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836495d-6238-4578-af03-4ab5364c2e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:57.763682 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836495d-6238-4578-af03-4ab5364c2e16 admin admin] PATH_INFO: `/v3/projects/da0a642e3a704ed1b289ab518acbc0b7` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:57.764933 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836495d-6238-4578-af03-4ab5364c2e16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da0a642e3a704ed1b289ab518acbc0b7)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:57.766956 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836495d-6238-4578-af03-4ab5364c2e16 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:57.822501 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-2836495d-6238-4578-af03-4ab5364c2e16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da0a642e3a704ed1b289ab518acbc0b7', 'request_id': 'req-2836495d-6238-4578-af03-4ab5364c2e16'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:57.828937 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-2836495d-6238-4578-af03-4ab5364c2e16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da0a642e3a704ed1b289ab518acbc0b7', 'request_id': 'req-2836495d-6238-4578-af03-4ab5364c2e16'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:57.835893 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-2836495d-6238-4578-af03-4ab5364c2e16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da0a642e3a704ed1b289ab518acbc0b7', 'request_id': 'req-2836495d-6238-4578-af03-4ab5364c2e16'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:57.855713 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-2836495d-6238-4578-af03-4ab5364c2e16 admin admin] The token cache is being invalidate because project da0a642e3a704ed1b289ab518acbc0b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:14:57.856086 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-2836495d-6238-4578-af03-4ab5364c2e16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:57.857991 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-2836495d-6238-4578-af03-4ab5364c2e16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:57.860860 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1209/2414] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:14:57 2022] DELETE /identity/v3/projects/da0a642e3a704ed1b289ab518acbc0b7 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:14:57.865821 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982820c-78a9-4602-b24f-8508db0524db None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:57.866178 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982820c-78a9-4602-b24f-8508db0524db None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:57.866525 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982820c-78a9-4602-b24f-8508db0524db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:57.886672 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-1982820c-78a9-4602-b24f-8508db0524db None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:14:57.888383 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1982820c-78a9-4602-b24f-8508db0524db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:57.954445 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1206/2415] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:14:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:14:57.963149 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3381bca-53d7-418f-a4f3-c135a08dad16 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:57.963700 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3381bca-53d7-418f-a4f3-c135a08dad16 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:57.964135 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3381bca-53d7-418f-a4f3-c135a08dad16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:57.984622 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-f3381bca-53d7-418f-a4f3-c135a08dad16 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:14:57.985847 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f3381bca-53d7-418f-a4f3-c135a08dad16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:57.993739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1210/2416] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:14:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:14:57.998996 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982820c-78a9-4602-b24f-8508db0524db None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:58.024140 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982820c-78a9-4602-b24f-8508db0524db None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:58.043137 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fdda40-d524-4f5a-b23a-fb8888851646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:58.044139 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdda40-d524-4f5a-b23a-fb8888851646 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:58.044659 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdda40-d524-4f5a-b23a-fb8888851646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:58.045096 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdda40-d524-4f5a-b23a-fb8888851646 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:58.046060 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fdda40-d524-4f5a-b23a-fb8888851646 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:14:58.046377 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fdda40-d524-4f5a-b23a-fb8888851646 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:58.048046 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fdda40-d524-4f5a-b23a-fb8888851646 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:58.065370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1207/2417] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:14:58.070114 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3381bca-53d7-418f-a4f3-c135a08dad16 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:58.081679 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3381bca-53d7-418f-a4f3-c135a08dad16 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:58.090371 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa7e61-5b8a-4374-938e-5d160c14b322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:58.092100 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa7e61-5b8a-4374-938e-5d160c14b322 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:58.092475 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa7e61-5b8a-4374-938e-5d160c14b322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:58.092861 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa7e61-5b8a-4374-938e-5d160c14b322 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:58.093706 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa7e61-5b8a-4374-938e-5d160c14b322 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:58.096602 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa7e61-5b8a-4374-938e-5d160c14b322 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:58.131977 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1211/2418] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:14:58 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:14:58.136133 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fdda40-d524-4f5a-b23a-fb8888851646 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:58.147839 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fdda40-d524-4f5a-b23a-fb8888851646 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:58.227509 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5ee31-c811-467e-9fdd-17e8d43feaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:58.228268 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5ee31-c811-467e-9fdd-17e8d43feaa8 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:58.228733 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5ee31-c811-467e-9fdd-17e8d43feaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:58.228906 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5ee31-c811-467e-9fdd-17e8d43feaa8 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:58.229645 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb5ee31-c811-467e-9fdd-17e8d43feaa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:58.231685 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb5ee31-c811-467e-9fdd-17e8d43feaa8 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:58.259607 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1208/2419] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:14:58 2022] POST /identity/v3/users => generated 287 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:14:58.261129 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa7e61-5b8a-4374-938e-5d160c14b322 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:58.273063 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa7e61-5b8a-4374-938e-5d160c14b322 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:58.277743 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02884cd-944c-436b-803b-747d521b5854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:58.278419 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02884cd-944c-436b-803b-747d521b5854 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:58.278823 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02884cd-944c-436b-803b-747d521b5854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:58.279104 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02884cd-944c-436b-803b-747d521b5854 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:58.279840 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02884cd-944c-436b-803b-747d521b5854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:58.281474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02884cd-944c-436b-803b-747d521b5854 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:58.295451 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1212/2420] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:14:58.296683 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5ee31-c811-467e-9fdd-17e8d43feaa8 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:58.306856 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5ee31-c811-467e-9fdd-17e8d43feaa8 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:58.312180 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9efde41-93fb-4afd-9879-7bae8a92b171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:58.312883 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efde41-93fb-4afd-9879-7bae8a92b171 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:58.313167 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efde41-93fb-4afd-9879-7bae8a92b171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:58.313473 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efde41-93fb-4afd-9879-7bae8a92b171 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:58.314240 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9efde41-93fb-4afd-9879-7bae8a92b171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:58.315850 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9efde41-93fb-4afd-9879-7bae8a92b171 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:58.325990 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1209/2421] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:14:58.330298 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02884cd-944c-436b-803b-747d521b5854 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:58.341251 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02884cd-944c-436b-803b-747d521b5854 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:58.346364 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14396d56-2db5-4a93-abab-77ef9034c6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:58.347259 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14396d56-2db5-4a93-abab-77ef9034c6fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:58.347535 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14396d56-2db5-4a93-abab-77ef9034c6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:58.347806 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14396d56-2db5-4a93-abab-77ef9034c6fd admin admin] PATH_INFO: `/v3/projects/7caf91c85e3348b0b862d04cb63b7043/users/c44ff9bd26e745259a2ad800f3ef04e5/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:58.362941 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14396d56-2db5-4a93-abab-77ef9034c6fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7caf91c85e3348b0b862d04cb63b7043, user_id=c44ff9bd26e745259a2ad800f3ef04e5, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:58.365837 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14396d56-2db5-4a93-abab-77ef9034c6fd admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:58.382279 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1213/2422] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:14:58 2022] PUT /identity/v3/projects/7caf91c85e3348b0b862d04cb63b7043/users/c44ff9bd26e745259a2ad800f3ef04e5/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:14:58.395123 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef37dc4-975c-4ef5-a118-f78ac5f25ed0 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:58.395846 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef37dc4-975c-4ef5-a118-f78ac5f25ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:58.396682 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef37dc4-975c-4ef5-a118-f78ac5f25ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:58.433272 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-aef37dc4-975c-4ef5-a118-f78ac5f25ed0 None None] MFA Rules not processed for user `c44ff9bd26e745259a2ad800f3ef04e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:14:58.434652 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-aef37dc4-975c-4ef5-a118-f78ac5f25ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:58.503561 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1210/2423] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:14:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:14:58.514893 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14396d56-2db5-4a93-abab-77ef9034c6fd admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:58.516805 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-14396d56-2db5-4a93-abab-77ef9034c6fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:58.594810 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14396d56-2db5-4a93-abab-77ef9034c6fd admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:58.598444 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e9c53-ffbb-4b4a-af0c-e2fcd9fc6314 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:58.599099 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e9c53-ffbb-4b4a-af0c-e2fcd9fc6314 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:58.599377 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e9c53-ffbb-4b4a-af0c-e2fcd9fc6314 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:58.599645 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e9c53-ffbb-4b4a-af0c-e2fcd9fc6314 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:58.608562 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e9c53-ffbb-4b4a-af0c-e2fcd9fc6314 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:58.610081 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e9c53-ffbb-4b4a-af0c-e2fcd9fc6314 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:58.619953 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1214/2424] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:14:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:14:58.639769 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef37dc4-975c-4ef5-a118-f78ac5f25ed0 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:58.700219 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef37dc4-975c-4ef5-a118-f78ac5f25ed0 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:58.705679 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc640b7e-e2de-4b52-82df-f0e19c3bdc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:58.706560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc640b7e-e2de-4b52-82df-f0e19c3bdc95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:58.706833 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc640b7e-e2de-4b52-82df-f0e19c3bdc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:58.707101 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc640b7e-e2de-4b52-82df-f0e19c3bdc95 admin admin] PATH_INFO: `/v3/users/c44ff9bd26e745259a2ad800f3ef04e5` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:58.708318 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc640b7e-e2de-4b52-82df-f0e19c3bdc95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c44ff9bd26e745259a2ad800f3ef04e5)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:58.710456 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc640b7e-e2de-4b52-82df-f0e19c3bdc95 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:58.777145 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-bc640b7e-e2de-4b52-82df-f0e19c3bdc95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c44ff9bd26e745259a2ad800f3ef04e5'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:58.785653 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-bc640b7e-e2de-4b52-82df-f0e19c3bdc95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c44ff9bd26e745259a2ad800f3ef04e5'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:58.794862 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-bc640b7e-e2de-4b52-82df-f0e19c3bdc95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c44ff9bd26e745259a2ad800f3ef04e5'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:58.807999 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-bc640b7e-e2de-4b52-82df-f0e19c3bdc95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c44ff9bd26e745259a2ad800f3ef04e5'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:58.808825 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-bc640b7e-e2de-4b52-82df-f0e19c3bdc95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c44ff9bd26e745259a2ad800f3ef04e5'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:58.817795 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1211/2425] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:14:58 2022] DELETE /identity/v3/users/c44ff9bd26e745259a2ad800f3ef04e5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:14:58.821093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb79d7e-1291-4d51-97e3-5c6481b96715 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:58.821781 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb79d7e-1291-4d51-97e3-5c6481b96715 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:58.821905 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb79d7e-1291-4d51-97e3-5c6481b96715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:58.841791 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-abb79d7e-1291-4d51-97e3-5c6481b96715 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:14:58.843009 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-abb79d7e-1291-4d51-97e3-5c6481b96715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:58.901737 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1215/2426] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:14:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:14:58.912065 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc640b7e-e2de-4b52-82df-f0e19c3bdc95 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:58.913611 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-bc640b7e-e2de-4b52-82df-f0e19c3bdc95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:59.032159 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc640b7e-e2de-4b52-82df-f0e19c3bdc95 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:59.036285 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3369a0-2223-437f-bcb4-681b77a43b3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:59.036989 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3369a0-2223-437f-bcb4-681b77a43b3f service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:59.037335 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3369a0-2223-437f-bcb4-681b77a43b3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:59.037717 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3369a0-2223-437f-bcb4-681b77a43b3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:59.047252 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3369a0-2223-437f-bcb4-681b77a43b3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:59.048685 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3369a0-2223-437f-bcb4-681b77a43b3f service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:59.057859 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1212/2427] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:14:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 19:14:59.482768 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb79d7e-1291-4d51-97e3-5c6481b96715 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:59.484215 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-abb79d7e-1291-4d51-97e3-5c6481b96715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:59.507519 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb79d7e-1291-4d51-97e3-5c6481b96715 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:59.512373 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b74180-d039-489a-8072-84489d310740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:59.513344 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b74180-d039-489a-8072-84489d310740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:59.513626 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b74180-d039-489a-8072-84489d310740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:59.513933 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b74180-d039-489a-8072-84489d310740 admin admin] PATH_INFO: `/v3/projects/7caf91c85e3348b0b862d04cb63b7043` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:59.515507 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b74180-d039-489a-8072-84489d310740 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7caf91c85e3348b0b862d04cb63b7043)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:59.517868 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b74180-d039-489a-8072-84489d310740 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:59.563034 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-86b74180-d039-489a-8072-84489d310740 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7caf91c85e3348b0b862d04cb63b7043', 'request_id': 'req-86b74180-d039-489a-8072-84489d310740'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:59.568223 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-86b74180-d039-489a-8072-84489d310740 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7caf91c85e3348b0b862d04cb63b7043', 'request_id': 'req-86b74180-d039-489a-8072-84489d310740'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:59.574249 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-86b74180-d039-489a-8072-84489d310740 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7caf91c85e3348b0b862d04cb63b7043', 'request_id': 'req-86b74180-d039-489a-8072-84489d310740'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:59.591165 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-86b74180-d039-489a-8072-84489d310740 admin admin] The token cache is being invalidate because project 7caf91c85e3348b0b862d04cb63b7043 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:14:59.591165 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-86b74180-d039-489a-8072-84489d310740 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:59.592070 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-86b74180-d039-489a-8072-84489d310740 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:14:59.594041 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1216/2428] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:14:59 2022] DELETE /identity/v3/projects/7caf91c85e3348b0b862d04cb63b7043 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:14:59.598703 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744537de-1871-4c5a-9553-c2b2c7650cb5 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:59.599234 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744537de-1871-4c5a-9553-c2b2c7650cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:59.599436 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744537de-1871-4c5a-9553-c2b2c7650cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:59.618204 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-744537de-1871-4c5a-9553-c2b2c7650cb5 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:14:59.619391 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-744537de-1871-4c5a-9553-c2b2c7650cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:59.685605 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1213/2429] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:14:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:14:59.693650 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a6d4d-12f3-4e37-a8cb-9e0371d6e7dc None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:59.693985 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a6d4d-12f3-4e37-a8cb-9e0371d6e7dc None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:59.694155 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a6d4d-12f3-4e37-a8cb-9e0371d6e7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:59.715246 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-2f7a6d4d-12f3-4e37-a8cb-9e0371d6e7dc None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:14:59.717254 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-2f7a6d4d-12f3-4e37-a8cb-9e0371d6e7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:14:59.726386 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1217/2430] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:14:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:14:59.731108 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744537de-1871-4c5a-9553-c2b2c7650cb5 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:59.740928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744537de-1871-4c5a-9553-c2b2c7650cb5 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:59.745543 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d3085-aeec-4fd1-8ad8-27e462736ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:59.746225 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d3085-aeec-4fd1-8ad8-27e462736ffc admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:59.746501 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d3085-aeec-4fd1-8ad8-27e462736ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:59.746773 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d3085-aeec-4fd1-8ad8-27e462736ffc admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:59.747628 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3d3085-aeec-4fd1-8ad8-27e462736ffc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:14:59.747939 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3d3085-aeec-4fd1-8ad8-27e462736ffc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:59.749603 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3d3085-aeec-4fd1-8ad8-27e462736ffc admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:59.764785 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1214/2431] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:14:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:14:59.766309 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a6d4d-12f3-4e37-a8cb-9e0371d6e7dc None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:59.776102 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a6d4d-12f3-4e37-a8cb-9e0371d6e7dc None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:59.780792 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6d1f4-cf4f-4f94-9e7a-e1681b8905b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:59.781493 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6d1f4-cf4f-4f94-9e7a-e1681b8905b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:59.781808 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6d1f4-cf4f-4f94-9e7a-e1681b8905b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:59.782069 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6d1f4-cf4f-4f94-9e7a-e1681b8905b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:59.782813 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e6d1f4-cf4f-4f94-9e7a-e1681b8905b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:59.784753 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e6d1f4-cf4f-4f94-9e7a-e1681b8905b8 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:59.810907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1218/2432] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:14:59 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:14:59.815219 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d3085-aeec-4fd1-8ad8-27e462736ffc admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:59.825094 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d3085-aeec-4fd1-8ad8-27e462736ffc admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:59.895236 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963ded5-a900-493c-ab76-3049b10d1932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:59.895995 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963ded5-a900-493c-ab76-3049b10d1932 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:59.896273 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963ded5-a900-493c-ab76-3049b10d1932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:59.896710 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963ded5-a900-493c-ab76-3049b10d1932 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:59.897258 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1963ded5-a900-493c-ab76-3049b10d1932 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:59.899579 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1963ded5-a900-493c-ab76-3049b10d1932 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:59.925856 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1215/2433] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:14:59 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:14:59.928184 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6d1f4-cf4f-4f94-9e7a-e1681b8905b8 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:59.938917 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6d1f4-cf4f-4f94-9e7a-e1681b8905b8 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:59.943623 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97277b-3e7f-406a-941f-4cdebe4282d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:59.944384 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97277b-3e7f-406a-941f-4cdebe4282d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:59.944595 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97277b-3e7f-406a-941f-4cdebe4282d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:59.944858 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97277b-3e7f-406a-941f-4cdebe4282d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:59.945617 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e97277b-3e7f-406a-941f-4cdebe4282d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:59.949572 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e97277b-3e7f-406a-941f-4cdebe4282d7 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:14:59.974652 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1219/2434] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:14:59.978861 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963ded5-a900-493c-ab76-3049b10d1932 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:14:59.989489 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963ded5-a900-493c-ab76-3049b10d1932 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:14:59.994105 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817f9db-142c-47ce-bbf7-95203b8cdf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:14:59.994783 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817f9db-142c-47ce-bbf7-95203b8cdf4d admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:14:59.995062 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817f9db-142c-47ce-bbf7-95203b8cdf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:14:59.995351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817f9db-142c-47ce-bbf7-95203b8cdf4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:14:59.996070 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817f9db-142c-47ce-bbf7-95203b8cdf4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:14:59.997868 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817f9db-142c-47ce-bbf7-95203b8cdf4d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:00.008369 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1216/2435] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:15:00.012927 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97277b-3e7f-406a-941f-4cdebe4282d7 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:00.023457 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97277b-3e7f-406a-941f-4cdebe4282d7 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:00.028319 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c6d6e-e411-4269-a50d-9d77f64ae45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:00.029236 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c6d6e-e411-4269-a50d-9d77f64ae45a admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:00.029520 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c6d6e-e411-4269-a50d-9d77f64ae45a admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:00.029856 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c6d6e-e411-4269-a50d-9d77f64ae45a admin admin] PATH_INFO: `/v3/projects/55e445cb3c534dbb8f0a16aac81d961a/users/da9d8ef8eefb4bf28a3cda971a3b9994/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:00.044229 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c6d6e-e411-4269-a50d-9d77f64ae45a admin admin] RBAC: Authorizing `identity:create_grant(project_id=55e445cb3c534dbb8f0a16aac81d961a, user_id=da9d8ef8eefb4bf28a3cda971a3b9994, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:00.047184 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c6d6e-e411-4269-a50d-9d77f64ae45a admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:00.088024 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1220/2436] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:15:00 2022] PUT /identity/v3/projects/55e445cb3c534dbb8f0a16aac81d961a/users/da9d8ef8eefb4bf28a3cda971a3b9994/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:00.090110 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac810c-985f-4263-974a-596ea2937add None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:00.094035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac810c-985f-4263-974a-596ea2937add None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:00.094370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac810c-985f-4263-974a-596ea2937add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:00.140790 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-06ac810c-985f-4263-974a-596ea2937add None None] MFA Rules not processed for user `da9d8ef8eefb4bf28a3cda971a3b9994`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:00.142108 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-06ac810c-985f-4263-974a-596ea2937add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:00.209223 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1217/2437] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:00.221038 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c6d6e-e411-4269-a50d-9d77f64ae45a admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:00.222818 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-c17c6d6e-e411-4269-a50d-9d77f64ae45a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:00.302386 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c6d6e-e411-4269-a50d-9d77f64ae45a admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:00.306383 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ed0ed-93e2-41db-a057-7f23ac158fd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:00.307022 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ed0ed-93e2-41db-a057-7f23ac158fd1 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:00.307303 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ed0ed-93e2-41db-a057-7f23ac158fd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:00.307673 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ed0ed-93e2-41db-a057-7f23ac158fd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:00.317928 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ed0ed-93e2-41db-a057-7f23ac158fd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:00.319509 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ed0ed-93e2-41db-a057-7f23ac158fd1 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:00.329121 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1221/2438] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:15:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:15:07.908150 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac810c-985f-4263-974a-596ea2937add None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:08.015668 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac810c-985f-4263-974a-596ea2937add None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:08.021240 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22ad8c-02a6-4a5b-861a-55a6dd0730b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:08.022281 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22ad8c-02a6-4a5b-861a-55a6dd0730b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:08.022564 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22ad8c-02a6-4a5b-861a-55a6dd0730b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:08.023809 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22ad8c-02a6-4a5b-861a-55a6dd0730b9 admin admin] PATH_INFO: `/v3/users/da9d8ef8eefb4bf28a3cda971a3b9994` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:08.024868 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f22ad8c-02a6-4a5b-861a-55a6dd0730b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da9d8ef8eefb4bf28a3cda971a3b9994)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:08.028093 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f22ad8c-02a6-4a5b-861a-55a6dd0730b9 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:08.139950 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1f22ad8c-02a6-4a5b-861a-55a6dd0730b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da9d8ef8eefb4bf28a3cda971a3b9994'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:08.148093 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1f22ad8c-02a6-4a5b-861a-55a6dd0730b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da9d8ef8eefb4bf28a3cda971a3b9994'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:08.156412 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1f22ad8c-02a6-4a5b-861a-55a6dd0730b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da9d8ef8eefb4bf28a3cda971a3b9994'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:08.170178 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1f22ad8c-02a6-4a5b-861a-55a6dd0730b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da9d8ef8eefb4bf28a3cda971a3b9994'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:08.170910 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1f22ad8c-02a6-4a5b-861a-55a6dd0730b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da9d8ef8eefb4bf28a3cda971a3b9994'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:08.177103 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1218/2439] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:15:07 2022] DELETE /identity/v3/users/da9d8ef8eefb4bf28a3cda971a3b9994 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:08.181610 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b89805-3238-463b-9c28-be0e873a1a3b None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:08.182487 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b89805-3238-463b-9c28-be0e873a1a3b None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:08.182772 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b89805-3238-463b-9c28-be0e873a1a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:08.203413 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-b0b89805-3238-463b-9c28-be0e873a1a3b None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:08.204839 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-b0b89805-3238-463b-9c28-be0e873a1a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:08.271038 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1222/2440] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:08.281059 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22ad8c-02a6-4a5b-861a-55a6dd0730b9 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:08.282704 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1f22ad8c-02a6-4a5b-861a-55a6dd0730b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:08.345799 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22ad8c-02a6-4a5b-861a-55a6dd0730b9 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:08.350739 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689b6b5-9b7b-48a0-bcdd-9ac1572acf50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:08.351433 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689b6b5-9b7b-48a0-bcdd-9ac1572acf50 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:08.351724 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689b6b5-9b7b-48a0-bcdd-9ac1572acf50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:08.352023 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689b6b5-9b7b-48a0-bcdd-9ac1572acf50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:08.363913 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689b6b5-9b7b-48a0-bcdd-9ac1572acf50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:08.365379 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689b6b5-9b7b-48a0-bcdd-9ac1572acf50 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:08.377864 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1219/2441] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:15:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:15:08.659209 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b89805-3238-463b-9c28-be0e873a1a3b None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:08.660831 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-b0b89805-3238-463b-9c28-be0e873a1a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:08.712665 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b89805-3238-463b-9c28-be0e873a1a3b None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:08.725292 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8fe34-2f0a-4d6f-a5d9-5bfdfc1581ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:08.725696 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8fe34-2f0a-4d6f-a5d9-5bfdfc1581ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:08.725982 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8fe34-2f0a-4d6f-a5d9-5bfdfc1581ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:08.726248 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8fe34-2f0a-4d6f-a5d9-5bfdfc1581ec admin admin] PATH_INFO: `/v3/projects/55e445cb3c534dbb8f0a16aac81d961a` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:08.727570 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8fe34-2f0a-4d6f-a5d9-5bfdfc1581ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=55e445cb3c534dbb8f0a16aac81d961a)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:08.729507 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8fe34-2f0a-4d6f-a5d9-5bfdfc1581ec admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:08.782758 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-82b8fe34-2f0a-4d6f-a5d9-5bfdfc1581ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55e445cb3c534dbb8f0a16aac81d961a', 'request_id': 'req-82b8fe34-2f0a-4d6f-a5d9-5bfdfc1581ec'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:08.789018 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-82b8fe34-2f0a-4d6f-a5d9-5bfdfc1581ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55e445cb3c534dbb8f0a16aac81d961a', 'request_id': 'req-82b8fe34-2f0a-4d6f-a5d9-5bfdfc1581ec'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:08.796876 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-82b8fe34-2f0a-4d6f-a5d9-5bfdfc1581ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55e445cb3c534dbb8f0a16aac81d961a', 'request_id': 'req-82b8fe34-2f0a-4d6f-a5d9-5bfdfc1581ec'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:08.816833 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-82b8fe34-2f0a-4d6f-a5d9-5bfdfc1581ec admin admin] The token cache is being invalidate because project 55e445cb3c534dbb8f0a16aac81d961a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:15:08.817719 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-82b8fe34-2f0a-4d6f-a5d9-5bfdfc1581ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:08.818564 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-82b8fe34-2f0a-4d6f-a5d9-5bfdfc1581ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:08.820495 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1223/2442] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:15:08 2022] DELETE /identity/v3/projects/55e445cb3c534dbb8f0a16aac81d961a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:08.826725 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502f3ec-c805-4605-865e-fe76c3294ec9 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:08.827047 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502f3ec-c805-4605-865e-fe76c3294ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:08.827398 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502f3ec-c805-4605-865e-fe76c3294ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:08.845401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-7502f3ec-c805-4605-865e-fe76c3294ec9 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:08.846677 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7502f3ec-c805-4605-865e-fe76c3294ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:08.905280 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1220/2443] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:08.913165 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fd0fe-9fc3-4b39-9385-59652d601d8f None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:08.913584 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fd0fe-9fc3-4b39-9385-59652d601d8f None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:08.913959 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fd0fe-9fc3-4b39-9385-59652d601d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:08.932591 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-633fd0fe-9fc3-4b39-9385-59652d601d8f None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:08.933903 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-633fd0fe-9fc3-4b39-9385-59652d601d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:08.942363 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1224/2444] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:08.946940 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502f3ec-c805-4605-865e-fe76c3294ec9 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:08.958535 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502f3ec-c805-4605-865e-fe76c3294ec9 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:08.966027 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a027d-8625-46ec-bd0f-369f84303a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:08.966858 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a027d-8625-46ec-bd0f-369f84303a84 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:08.967653 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a027d-8625-46ec-bd0f-369f84303a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:08.967653 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a027d-8625-46ec-bd0f-369f84303a84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:08.968407 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a027d-8625-46ec-bd0f-369f84303a84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:15:08.968784 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a027d-8625-46ec-bd0f-369f84303a84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:08.970685 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a027d-8625-46ec-bd0f-369f84303a84 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:08.985986 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1221/2445] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:15:08.987289 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fd0fe-9fc3-4b39-9385-59652d601d8f None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:08.997269 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fd0fe-9fc3-4b39-9385-59652d601d8f None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:09.002194 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab38e37-9067-4a9d-922b-eb5cb8054b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:09.002881 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab38e37-9067-4a9d-922b-eb5cb8054b44 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:09.003165 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab38e37-9067-4a9d-922b-eb5cb8054b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:09.003442 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab38e37-9067-4a9d-922b-eb5cb8054b44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:09.004145 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab38e37-9067-4a9d-922b-eb5cb8054b44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:09.006170 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab38e37-9067-4a9d-922b-eb5cb8054b44 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:09.037956 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1225/2446] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:15:08 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:15:09.042454 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a027d-8625-46ec-bd0f-369f84303a84 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:09.052533 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a027d-8625-46ec-bd0f-369f84303a84 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:09.107197 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11afe2-6fd8-41df-a247-12f6c2fa25ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:09.107899 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11afe2-6fd8-41df-a247-12f6c2fa25ea admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:09.108189 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11afe2-6fd8-41df-a247-12f6c2fa25ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:09.108461 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11afe2-6fd8-41df-a247-12f6c2fa25ea admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:09.109162 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc11afe2-6fd8-41df-a247-12f6c2fa25ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:09.111212 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc11afe2-6fd8-41df-a247-12f6c2fa25ea admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:09.137165 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1222/2447] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:15:09 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:15:09.141345 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab38e37-9067-4a9d-922b-eb5cb8054b44 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:09.152387 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab38e37-9067-4a9d-922b-eb5cb8054b44 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:09.163426 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd67662-eaa7-4f75-9b8d-65d4fc9caeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:09.164160 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd67662-eaa7-4f75-9b8d-65d4fc9caeb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:09.164435 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd67662-eaa7-4f75-9b8d-65d4fc9caeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:09.164705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd67662-eaa7-4f75-9b8d-65d4fc9caeb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:09.165601 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd67662-eaa7-4f75-9b8d-65d4fc9caeb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:09.167215 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd67662-eaa7-4f75-9b8d-65d4fc9caeb2 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:09.178894 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1226/2448] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:15:09.182941 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11afe2-6fd8-41df-a247-12f6c2fa25ea admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:09.192749 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11afe2-6fd8-41df-a247-12f6c2fa25ea admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:09.197262 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42c3cb-e414-4c0f-bc6b-0ce6a7705874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:09.197950 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42c3cb-e414-4c0f-bc6b-0ce6a7705874 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:09.198232 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42c3cb-e414-4c0f-bc6b-0ce6a7705874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:09.198501 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42c3cb-e414-4c0f-bc6b-0ce6a7705874 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:09.199227 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d42c3cb-e414-4c0f-bc6b-0ce6a7705874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:09.200827 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d42c3cb-e414-4c0f-bc6b-0ce6a7705874 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:09.211742 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1223/2449] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:15:09.215824 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd67662-eaa7-4f75-9b8d-65d4fc9caeb2 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:09.225914 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd67662-eaa7-4f75-9b8d-65d4fc9caeb2 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:09.230669 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0687229-8e03-42db-b9b1-5661b69a1af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:09.231559 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0687229-8e03-42db-b9b1-5661b69a1af9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:09.231838 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0687229-8e03-42db-b9b1-5661b69a1af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:09.232110 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0687229-8e03-42db-b9b1-5661b69a1af9 admin admin] PATH_INFO: `/v3/projects/91480b92cae8454aa6c00973b05d26af/users/1ee83fed84a945d0baaa64ad3399ec3f/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:09.247720 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0687229-8e03-42db-b9b1-5661b69a1af9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91480b92cae8454aa6c00973b05d26af, user_id=1ee83fed84a945d0baaa64ad3399ec3f, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:09.250450 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0687229-8e03-42db-b9b1-5661b69a1af9 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:09.265015 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1227/2450] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:15:09 2022] PUT /identity/v3/projects/91480b92cae8454aa6c00973b05d26af/users/1ee83fed84a945d0baaa64ad3399ec3f/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:09.275635 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e5ea1-240c-4545-8d90-796bbc183db8 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:09.275924 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e5ea1-240c-4545-8d90-796bbc183db8 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:09.276198 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e5ea1-240c-4545-8d90-796bbc183db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:09.301652 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-e26e5ea1-240c-4545-8d90-796bbc183db8 None None] MFA Rules not processed for user `1ee83fed84a945d0baaa64ad3399ec3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:09.302846 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e26e5ea1-240c-4545-8d90-796bbc183db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:09.368792 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1224/2451] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:09.379980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0687229-8e03-42db-b9b1-5661b69a1af9 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:09.382132 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-e0687229-8e03-42db-b9b1-5661b69a1af9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:09.439516 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0687229-8e03-42db-b9b1-5661b69a1af9 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:09.443527 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72135710-e004-4587-96a2-cd56e57cb2af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:09.444167 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72135710-e004-4587-96a2-cd56e57cb2af service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:09.444447 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72135710-e004-4587-96a2-cd56e57cb2af service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:09.444744 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72135710-e004-4587-96a2-cd56e57cb2af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:09.453094 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72135710-e004-4587-96a2-cd56e57cb2af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:09.454560 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72135710-e004-4587-96a2-cd56e57cb2af service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:09.463264 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1228/2452] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:15:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:15:11.513356 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd7a76-fc2c-45b5-928d-d28e37b6cbc1 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:11.513888 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd7a76-fc2c-45b5-928d-d28e37b6cbc1 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:11.513988 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd7a76-fc2c-45b5-928d-d28e37b6cbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:11.532500 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-20dd7a76-fc2c-45b5-928d-d28e37b6cbc1 None None] MFA Rules not processed for user `4775e9dd7aea448d95ec7378b4ff3124`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:11.533768 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-20dd7a76-fc2c-45b5-928d-d28e37b6cbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:11.587124 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1225/2453] 10.222.0.24 () {58 vars in 967 bytes} [Mon May 16 19:15:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:15:11.601088 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72135710-e004-4587-96a2-cd56e57cb2af service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:11.603383 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-72135710-e004-4587-96a2-cd56e57cb2af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:11.678156 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72135710-e004-4587-96a2-cd56e57cb2af service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:11.685723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7620c31-5798-4f85-98a4-3b5beda6bba1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '654e435a35c4491eb87943734ce280f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:11.686711 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7620c31-5798-4f85-98a4-3b5beda6bba1 service swift] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:11.687033 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7620c31-5798-4f85-98a4-3b5beda6bba1 service swift] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:11.687436 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7620c31-5798-4f85-98a4-3b5beda6bba1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:11.705094 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7620c31-5798-4f85-98a4-3b5beda6bba1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:11.708080 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7620c31-5798-4f85-98a4-3b5beda6bba1 service swift] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:11.720022 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1229/2454] 10.222.0.24 () {60 vars in 1384 bytes} [Mon May 16 19:15:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 16 19:15:12.274896 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd7a76-fc2c-45b5-928d-d28e37b6cbc1 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:12.276333 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-20dd7a76-fc2c-45b5-928d-d28e37b6cbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:12.333730 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd7a76-fc2c-45b5-928d-d28e37b6cbc1 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:12.337195 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b7644-e0c9-45ab-9691-2f684cc3aaf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:12.337882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b7644-e0c9-45ab-9691-2f684cc3aaf7 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:12.338171 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b7644-e0c9-45ab-9691-2f684cc3aaf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:12.338446 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b7644-e0c9-45ab-9691-2f684cc3aaf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:12.340207 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e35b7644-e0c9-45ab-9691-2f684cc3aaf7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:12.402775 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b7644-e0c9-45ab-9691-2f684cc3aaf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:12.404141 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b7644-e0c9-45ab-9691-2f684cc3aaf7 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:12.415465 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1226/2455] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:15:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:15:12.531381 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7620c31-5798-4f85-98a4-3b5beda6bba1 service swift] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:12.543559 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7620c31-5798-4f85-98a4-3b5beda6bba1 service swift] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:12.549021 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c23abe-0702-4b0b-ab10-4220cbb943f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:12.549994 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c23abe-0702-4b0b-ab10-4220cbb943f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:12.550457 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c23abe-0702-4b0b-ab10-4220cbb943f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:12.550901 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c23abe-0702-4b0b-ab10-4220cbb943f0 admin admin] PATH_INFO: `/v3/users/1ee83fed84a945d0baaa64ad3399ec3f` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:12.552769 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c23abe-0702-4b0b-ab10-4220cbb943f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ee83fed84a945d0baaa64ad3399ec3f)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:12.554738 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c23abe-0702-4b0b-ab10-4220cbb943f0 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:12.604584 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-d7c23abe-0702-4b0b-ab10-4220cbb943f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ee83fed84a945d0baaa64ad3399ec3f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:12.614482 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-d7c23abe-0702-4b0b-ab10-4220cbb943f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ee83fed84a945d0baaa64ad3399ec3f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:12.623031 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-d7c23abe-0702-4b0b-ab10-4220cbb943f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ee83fed84a945d0baaa64ad3399ec3f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:12.623925 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-d7c23abe-0702-4b0b-ab10-4220cbb943f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ee83fed84a945d0baaa64ad3399ec3f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:12.638357 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-d7c23abe-0702-4b0b-ab10-4220cbb943f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ee83fed84a945d0baaa64ad3399ec3f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:12.645237 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1230/2456] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:15:12 2022] DELETE /identity/v3/users/1ee83fed84a945d0baaa64ad3399ec3f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:12.650259 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a036fd7-f25a-4ade-b40e-bd211fb95504 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:12.650812 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a036fd7-f25a-4ade-b40e-bd211fb95504 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:12.651008 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a036fd7-f25a-4ade-b40e-bd211fb95504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:12.672940 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-5a036fd7-f25a-4ade-b40e-bd211fb95504 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:12.674845 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5a036fd7-f25a-4ade-b40e-bd211fb95504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:12.742317 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1227/2457] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:12.752162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c23abe-0702-4b0b-ab10-4220cbb943f0 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:12.753681 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-d7c23abe-0702-4b0b-ab10-4220cbb943f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:12.816059 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c23abe-0702-4b0b-ab10-4220cbb943f0 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:12.820247 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76087a-bd42-4ca7-bf3f-8a02df3c431a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:12.820913 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76087a-bd42-4ca7-bf3f-8a02df3c431a service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:12.821195 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76087a-bd42-4ca7-bf3f-8a02df3c431a service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:12.821468 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76087a-bd42-4ca7-bf3f-8a02df3c431a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:12.831778 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76087a-bd42-4ca7-bf3f-8a02df3c431a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:12.833257 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76087a-bd42-4ca7-bf3f-8a02df3c431a service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:12.843613 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1231/2458] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:15:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:15:13.132092 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a036fd7-f25a-4ade-b40e-bd211fb95504 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:13.133740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5a036fd7-f25a-4ade-b40e-bd211fb95504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:13.146707 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a036fd7-f25a-4ade-b40e-bd211fb95504 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:13.159018 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570c0a6-7f16-42ea-91cd-75038e9bb5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:13.160184 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570c0a6-7f16-42ea-91cd-75038e9bb5b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:13.160640 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570c0a6-7f16-42ea-91cd-75038e9bb5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:13.161069 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570c0a6-7f16-42ea-91cd-75038e9bb5b1 admin admin] PATH_INFO: `/v3/projects/91480b92cae8454aa6c00973b05d26af` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:13.162760 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a570c0a6-7f16-42ea-91cd-75038e9bb5b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91480b92cae8454aa6c00973b05d26af)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:13.165060 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a570c0a6-7f16-42ea-91cd-75038e9bb5b1 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:13.216250 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a570c0a6-7f16-42ea-91cd-75038e9bb5b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91480b92cae8454aa6c00973b05d26af', 'request_id': 'req-a570c0a6-7f16-42ea-91cd-75038e9bb5b1'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:13.224358 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a570c0a6-7f16-42ea-91cd-75038e9bb5b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91480b92cae8454aa6c00973b05d26af', 'request_id': 'req-a570c0a6-7f16-42ea-91cd-75038e9bb5b1'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:13.230125 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a570c0a6-7f16-42ea-91cd-75038e9bb5b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91480b92cae8454aa6c00973b05d26af', 'request_id': 'req-a570c0a6-7f16-42ea-91cd-75038e9bb5b1'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:13.241390 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a570c0a6-7f16-42ea-91cd-75038e9bb5b1 admin admin] The token cache is being invalidate because project 91480b92cae8454aa6c00973b05d26af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:15:13.241708 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a570c0a6-7f16-42ea-91cd-75038e9bb5b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:13.242346 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a570c0a6-7f16-42ea-91cd-75038e9bb5b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:13.243907 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1228/2459] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:15:13 2022] DELETE /identity/v3/projects/91480b92cae8454aa6c00973b05d26af => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:13.248915 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097965e4-5349-437f-9a26-6a82c7e5e164 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:13.249241 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097965e4-5349-437f-9a26-6a82c7e5e164 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:13.249520 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097965e4-5349-437f-9a26-6a82c7e5e164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:13.267983 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-097965e4-5349-437f-9a26-6a82c7e5e164 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:13.269236 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-097965e4-5349-437f-9a26-6a82c7e5e164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:13.331252 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1232/2460] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:13.338935 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39fb88-8c85-4e64-81af-866b82ff9841 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:13.339221 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39fb88-8c85-4e64-81af-866b82ff9841 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:13.339490 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39fb88-8c85-4e64-81af-866b82ff9841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:13.358439 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-9d39fb88-8c85-4e64-81af-866b82ff9841 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:13.359980 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9d39fb88-8c85-4e64-81af-866b82ff9841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:13.368784 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1229/2461] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:13.373929 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097965e4-5349-437f-9a26-6a82c7e5e164 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:13.384240 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097965e4-5349-437f-9a26-6a82c7e5e164 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:13.406641 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f525d3-c17f-458e-8bd3-615e1a87dd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:13.407893 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f525d3-c17f-458e-8bd3-615e1a87dd58 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:13.408883 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f525d3-c17f-458e-8bd3-615e1a87dd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:13.409311 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f525d3-c17f-458e-8bd3-615e1a87dd58 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:13.410691 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f525d3-c17f-458e-8bd3-615e1a87dd58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:15:13.411294 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f525d3-c17f-458e-8bd3-615e1a87dd58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:13.414289 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f525d3-c17f-458e-8bd3-615e1a87dd58 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:13.429503 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1233/2462] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:15:13.434390 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39fb88-8c85-4e64-81af-866b82ff9841 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:13.446183 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39fb88-8c85-4e64-81af-866b82ff9841 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:13.458003 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e0dbb-29d2-498a-9ff8-fe8f830cc2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:13.458534 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e0dbb-29d2-498a-9ff8-fe8f830cc2e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:13.459151 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e0dbb-29d2-498a-9ff8-fe8f830cc2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:13.459430 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e0dbb-29d2-498a-9ff8-fe8f830cc2e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:13.460743 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e0dbb-29d2-498a-9ff8-fe8f830cc2e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:13.462965 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e0dbb-29d2-498a-9ff8-fe8f830cc2e6 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:13.496430 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1230/2463] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:15:13 2022] POST /identity/v3/projects => generated 369 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:15:13.502009 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f525d3-c17f-458e-8bd3-615e1a87dd58 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:13.514427 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f525d3-c17f-458e-8bd3-615e1a87dd58 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:13.589514 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459c806-1da5-4ee4-995c-d27ed6b0e6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:13.590414 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459c806-1da5-4ee4-995c-d27ed6b0e6f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:13.591782 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459c806-1da5-4ee4-995c-d27ed6b0e6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:13.592160 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459c806-1da5-4ee4-995c-d27ed6b0e6f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:13.593859 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459c806-1da5-4ee4-995c-d27ed6b0e6f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:13.595980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459c806-1da5-4ee4-995c-d27ed6b0e6f5 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:13.623710 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1234/2464] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:15:13 2022] POST /identity/v3/users => generated 285 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:15:13.625316 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e0dbb-29d2-498a-9ff8-fe8f830cc2e6 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:13.637569 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e0dbb-29d2-498a-9ff8-fe8f830cc2e6 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:13.643907 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34f70d-28a5-4051-8678-d223eafac956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:13.644931 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34f70d-28a5-4051-8678-d223eafac956 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:13.645419 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34f70d-28a5-4051-8678-d223eafac956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:13.645983 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34f70d-28a5-4051-8678-d223eafac956 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:13.647243 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b34f70d-28a5-4051-8678-d223eafac956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:13.651177 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b34f70d-28a5-4051-8678-d223eafac956 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:13.669051 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1231/2465] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 19:15:13.673229 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459c806-1da5-4ee4-995c-d27ed6b0e6f5 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:13.694242 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459c806-1da5-4ee4-995c-d27ed6b0e6f5 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:13.706634 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b76a0d-599e-4d49-8595-f2494c4a854f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:13.707331 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b76a0d-599e-4d49-8595-f2494c4a854f admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:13.707609 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b76a0d-599e-4d49-8595-f2494c4a854f admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:13.707880 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b76a0d-599e-4d49-8595-f2494c4a854f admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:13.708804 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b76a0d-599e-4d49-8595-f2494c4a854f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:13.710641 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b76a0d-599e-4d49-8595-f2494c4a854f admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:13.722890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1235/2466] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 19:15:13.726802 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34f70d-28a5-4051-8678-d223eafac956 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:13.738742 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34f70d-28a5-4051-8678-d223eafac956 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:13.746410 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c6e9a-0c72-459a-8014-1387412d995b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:13.747592 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c6e9a-0c72-459a-8014-1387412d995b admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:13.748089 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c6e9a-0c72-459a-8014-1387412d995b admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:13.748512 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c6e9a-0c72-459a-8014-1387412d995b admin admin] PATH_INFO: `/v3/projects/b54df7954cc542dca20105a0f56e2e0b/users/a8296c4f36cd4df8b93bc2b673811e5e/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:13.766658 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c6e9a-0c72-459a-8014-1387412d995b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b54df7954cc542dca20105a0f56e2e0b, user_id=a8296c4f36cd4df8b93bc2b673811e5e, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:13.770167 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c6e9a-0c72-459a-8014-1387412d995b admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:13.801217 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1232/2467] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:15:13 2022] PUT /identity/v3/projects/b54df7954cc542dca20105a0f56e2e0b/users/a8296c4f36cd4df8b93bc2b673811e5e/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:13.813283 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d76c4-0d98-4bcd-a3bb-fa5a94911f99 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:13.813651 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d76c4-0d98-4bcd-a3bb-fa5a94911f99 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:13.813973 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d76c4-0d98-4bcd-a3bb-fa5a94911f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:13.854572 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-921d76c4-0d98-4bcd-a3bb-fa5a94911f99 None None] MFA Rules not processed for user `a8296c4f36cd4df8b93bc2b673811e5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:13.855953 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-921d76c4-0d98-4bcd-a3bb-fa5a94911f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:13.920200 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1236/2468] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:13 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:13.931719 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c6e9a-0c72-459a-8014-1387412d995b admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:13.933437 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-dc9c6e9a-0c72-459a-8014-1387412d995b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:14.002071 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c6e9a-0c72-459a-8014-1387412d995b admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:14.006395 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1fa16-823d-40e9-a34f-7394a3d77783 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dfa8e8908804c0e8908e2a8c6b377e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:14.007123 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1fa16-823d-40e9-a34f-7394a3d77783 service glance] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:14.007470 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1fa16-823d-40e9-a34f-7394a3d77783 service glance] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:14.007806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1fa16-823d-40e9-a34f-7394a3d77783 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:14.017359 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1fa16-823d-40e9-a34f-7394a3d77783 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:14.019317 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1fa16-823d-40e9-a34f-7394a3d77783 service glance] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:14.029046 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1233/2469] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:15:13 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:15:16.297875 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d76c4-0d98-4bcd-a3bb-fa5a94911f99 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:16.299975 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-921d76c4-0d98-4bcd-a3bb-fa5a94911f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:16.371479 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d76c4-0d98-4bcd-a3bb-fa5a94911f99 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:16.378874 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523d430-9fe8-47a6-9e1f-6121a0df2050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:16.379887 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523d430-9fe8-47a6-9e1f-6121a0df2050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:16.380918 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523d430-9fe8-47a6-9e1f-6121a0df2050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:16.381294 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523d430-9fe8-47a6-9e1f-6121a0df2050 admin admin] PATH_INFO: `/v3/users/a7d2aea046214bfcbbe6d5b3581fc155` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:16.382677 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523d430-9fe8-47a6-9e1f-6121a0df2050 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7d2aea046214bfcbbe6d5b3581fc155)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:16.384847 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523d430-9fe8-47a6-9e1f-6121a0df2050 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:16.441817 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-3523d430-9fe8-47a6-9e1f-6121a0df2050 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7d2aea046214bfcbbe6d5b3581fc155'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:16.452213 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-3523d430-9fe8-47a6-9e1f-6121a0df2050 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7d2aea046214bfcbbe6d5b3581fc155'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:16.459844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-3523d430-9fe8-47a6-9e1f-6121a0df2050 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7d2aea046214bfcbbe6d5b3581fc155'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:16.466990 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-3523d430-9fe8-47a6-9e1f-6121a0df2050 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7d2aea046214bfcbbe6d5b3581fc155'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:16.490446 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-3523d430-9fe8-47a6-9e1f-6121a0df2050 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7d2aea046214bfcbbe6d5b3581fc155'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:16.497147 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1237/2470] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:15:16 2022] DELETE /identity/v3/users/a7d2aea046214bfcbbe6d5b3581fc155 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:16.747357 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1fa16-823d-40e9-a34f-7394a3d77783 service glance] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:16.760012 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1fa16-823d-40e9-a34f-7394a3d77783 service glance] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:16.828303 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1270e-d3f0-4e29-9b56-d9ce4b06d30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:16.829185 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1270e-d3f0-4e29-9b56-d9ce4b06d30e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:16.829473 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1270e-d3f0-4e29-9b56-d9ce4b06d30e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:16.829782 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1270e-d3f0-4e29-9b56-d9ce4b06d30e admin admin] PATH_INFO: `/v3/projects/dee1963e977f4ac7b6d1877a6dd740a9` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:16.831013 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1270e-d3f0-4e29-9b56-d9ce4b06d30e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dee1963e977f4ac7b6d1877a6dd740a9)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:16.833141 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1270e-d3f0-4e29-9b56-d9ce4b06d30e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:16.881936 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-05a1270e-d3f0-4e29-9b56-d9ce4b06d30e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dee1963e977f4ac7b6d1877a6dd740a9', 'request_id': 'req-05a1270e-d3f0-4e29-9b56-d9ce4b06d30e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:16.890343 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-05a1270e-d3f0-4e29-9b56-d9ce4b06d30e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dee1963e977f4ac7b6d1877a6dd740a9', 'request_id': 'req-05a1270e-d3f0-4e29-9b56-d9ce4b06d30e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:16.895899 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-05a1270e-d3f0-4e29-9b56-d9ce4b06d30e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dee1963e977f4ac7b6d1877a6dd740a9', 'request_id': 'req-05a1270e-d3f0-4e29-9b56-d9ce4b06d30e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:16.907161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-05a1270e-d3f0-4e29-9b56-d9ce4b06d30e admin admin] The token cache is being invalidate because project dee1963e977f4ac7b6d1877a6dd740a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:15:16.907451 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-05a1270e-d3f0-4e29-9b56-d9ce4b06d30e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:16.908102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-05a1270e-d3f0-4e29-9b56-d9ce4b06d30e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:16.909968 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1234/2471] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:15:16 2022] DELETE /identity/v3/projects/dee1963e977f4ac7b6d1877a6dd740a9 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:16.914791 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e1bd2-6867-4dc2-8f20-a89706200b3c None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:16.915105 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e1bd2-6867-4dc2-8f20-a89706200b3c None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:16.915389 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e1bd2-6867-4dc2-8f20-a89706200b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:16.934960 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-787e1bd2-6867-4dc2-8f20-a89706200b3c None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:16.936668 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-787e1bd2-6867-4dc2-8f20-a89706200b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:16.999284 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1238/2472] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:17.007455 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69891844-5d50-48df-b4c4-ef6e10f038d5 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:17.007910 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69891844-5d50-48df-b4c4-ef6e10f038d5 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:17.008192 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69891844-5d50-48df-b4c4-ef6e10f038d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:17.029050 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-69891844-5d50-48df-b4c4-ef6e10f038d5 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:17.030350 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-69891844-5d50-48df-b4c4-ef6e10f038d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:17.041939 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1235/2473] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:17.046281 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e1bd2-6867-4dc2-8f20-a89706200b3c None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:17.056693 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e1bd2-6867-4dc2-8f20-a89706200b3c None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:17.065736 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b282d5-78bc-4766-ad98-dd42241a1ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:17.066425 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b282d5-78bc-4766-ad98-dd42241a1ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:17.066706 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b282d5-78bc-4766-ad98-dd42241a1ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:17.066982 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b282d5-78bc-4766-ad98-dd42241a1ba3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:17.067723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b282d5-78bc-4766-ad98-dd42241a1ba3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:15:17.068028 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b282d5-78bc-4766-ad98-dd42241a1ba3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:17.070999 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b282d5-78bc-4766-ad98-dd42241a1ba3 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:17.085960 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1239/2474] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:15:17.087247 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69891844-5d50-48df-b4c4-ef6e10f038d5 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:17.096562 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69891844-5d50-48df-b4c4-ef6e10f038d5 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:17.101737 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea81a33-3c1f-48fa-90e6-efa714805834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:17.102404 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea81a33-3c1f-48fa-90e6-efa714805834 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:17.102681 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea81a33-3c1f-48fa-90e6-efa714805834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:17.103067 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea81a33-3c1f-48fa-90e6-efa714805834 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:17.103980 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea81a33-3c1f-48fa-90e6-efa714805834 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:17.106476 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea81a33-3c1f-48fa-90e6-efa714805834 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:17.141291 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1236/2475] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:15:17 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:15:17.143302 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b282d5-78bc-4766-ad98-dd42241a1ba3 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:17.153476 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b282d5-78bc-4766-ad98-dd42241a1ba3 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:17.214459 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e5b8e-7be8-4c60-b20d-208e65aae19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:17.215146 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e5b8e-7be8-4c60-b20d-208e65aae19f admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:17.215458 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e5b8e-7be8-4c60-b20d-208e65aae19f admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:17.215727 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e5b8e-7be8-4c60-b20d-208e65aae19f admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:17.216431 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30e5b8e-7be8-4c60-b20d-208e65aae19f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:17.218550 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30e5b8e-7be8-4c60-b20d-208e65aae19f admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:17.238745 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1240/2476] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:15:17 2022] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:15:17.243417 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea81a33-3c1f-48fa-90e6-efa714805834 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:17.253399 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea81a33-3c1f-48fa-90e6-efa714805834 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:17.258757 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff5747-bb62-4543-8848-7c40916d1748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:17.259452 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff5747-bb62-4543-8848-7c40916d1748 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:17.259795 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff5747-bb62-4543-8848-7c40916d1748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:17.260047 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff5747-bb62-4543-8848-7c40916d1748 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:17.260783 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff5747-bb62-4543-8848-7c40916d1748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:17.262817 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff5747-bb62-4543-8848-7c40916d1748 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:17.275885 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1237/2477] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:15:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:15:17.279938 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e5b8e-7be8-4c60-b20d-208e65aae19f admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:17.296540 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e5b8e-7be8-4c60-b20d-208e65aae19f admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:17.301622 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53282edf-f2d6-4a19-acf5-0af02cec253c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:17.302344 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53282edf-f2d6-4a19-acf5-0af02cec253c admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:17.302585 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53282edf-f2d6-4a19-acf5-0af02cec253c admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:17.302860 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53282edf-f2d6-4a19-acf5-0af02cec253c admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:17.303603 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53282edf-f2d6-4a19-acf5-0af02cec253c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:17.305460 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53282edf-f2d6-4a19-acf5-0af02cec253c admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:17.317038 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1241/2478] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:15:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:15:17.321162 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff5747-bb62-4543-8848-7c40916d1748 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:17.331379 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff5747-bb62-4543-8848-7c40916d1748 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:17.339950 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e6ae8-6d00-4c75-9de1-421eee1c8275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:17.340869 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e6ae8-6d00-4c75-9de1-421eee1c8275 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:17.341150 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e6ae8-6d00-4c75-9de1-421eee1c8275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:17.341408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e6ae8-6d00-4c75-9de1-421eee1c8275 admin admin] PATH_INFO: `/v3/projects/81ad1abf5d024da79d9830979d222432/users/1ab9978f6a2d43368cd63a87d8331085/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:17.356687 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e6ae8-6d00-4c75-9de1-421eee1c8275 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81ad1abf5d024da79d9830979d222432, user_id=1ab9978f6a2d43368cd63a87d8331085, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:17.359505 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e6ae8-6d00-4c75-9de1-421eee1c8275 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:17.374153 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1238/2479] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:15:17 2022] PUT /identity/v3/projects/81ad1abf5d024da79d9830979d222432/users/1ab9978f6a2d43368cd63a87d8331085/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:17.386649 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c080661-5bd6-46c8-ab4b-62a4a17d1df3 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:17.387091 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c080661-5bd6-46c8-ab4b-62a4a17d1df3 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:17.387376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c080661-5bd6-46c8-ab4b-62a4a17d1df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:17.416053 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-6c080661-5bd6-46c8-ab4b-62a4a17d1df3 None None] MFA Rules not processed for user `1ab9978f6a2d43368cd63a87d8331085`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:17.417297 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-6c080661-5bd6-46c8-ab4b-62a4a17d1df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:17.481881 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1242/2480] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:17 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:17.486677 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e6ae8-6d00-4c75-9de1-421eee1c8275 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:17.567269 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e6ae8-6d00-4c75-9de1-421eee1c8275 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:17.572599 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09e10d-faad-408e-8592-4f96a28b49f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:17.573299 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09e10d-faad-408e-8592-4f96a28b49f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:17.573607 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09e10d-faad-408e-8592-4f96a28b49f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:17.574018 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09e10d-faad-408e-8592-4f96a28b49f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:17.574721 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09e10d-faad-408e-8592-4f96a28b49f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:17.576631 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09e10d-faad-408e-8592-4f96a28b49f7 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:17.633882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1239/2481] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:15:17 2022] POST /identity/v3/projects => generated 363 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:15:17.635881 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c080661-5bd6-46c8-ab4b-62a4a17d1df3 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:17.655926 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c080661-5bd6-46c8-ab4b-62a4a17d1df3 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:17.784741 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa9f66-6a59-44b7-98fd-cfa69c3ef6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:17.785757 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa9f66-6a59-44b7-98fd-cfa69c3ef6b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:17.786289 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa9f66-6a59-44b7-98fd-cfa69c3ef6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:17.787736 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa9f66-6a59-44b7-98fd-cfa69c3ef6b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:17.793859 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa9f66-6a59-44b7-98fd-cfa69c3ef6b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:17.795911 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa9f66-6a59-44b7-98fd-cfa69c3ef6b4 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:17.837717 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09e10d-faad-408e-8592-4f96a28b49f7 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:17.838494 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1243/2482] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:15:17 2022] POST /identity/v3/users => generated 288 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:15:17.854272 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09e10d-faad-408e-8592-4f96a28b49f7 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:17.860957 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213a6f2-2f16-42d3-81ae-dee6412aeba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:17.861921 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213a6f2-2f16-42d3-81ae-dee6412aeba5 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:17.862563 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213a6f2-2f16-42d3-81ae-dee6412aeba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:17.863015 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213a6f2-2f16-42d3-81ae-dee6412aeba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:17.863925 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213a6f2-2f16-42d3-81ae-dee6412aeba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:17.865792 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213a6f2-2f16-42d3-81ae-dee6412aeba5 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:17.880380 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1240/2483] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:15:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 19:15:17.884307 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa9f66-6a59-44b7-98fd-cfa69c3ef6b4 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:17.900792 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa9f66-6a59-44b7-98fd-cfa69c3ef6b4 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:17.906152 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697b11a-20b9-4e1b-90ca-7f50a80eb6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:17.907008 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697b11a-20b9-4e1b-90ca-7f50a80eb6a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:17.907293 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697b11a-20b9-4e1b-90ca-7f50a80eb6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:17.907570 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697b11a-20b9-4e1b-90ca-7f50a80eb6a1 admin admin] PATH_INFO: `/v3/projects/7880040bc502421a8c8e9fa978d46925/users/bd004265e78f420d849a27e62d78f480/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:17.926903 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d697b11a-20b9-4e1b-90ca-7f50a80eb6a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7880040bc502421a8c8e9fa978d46925, user_id=bd004265e78f420d849a27e62d78f480, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:17.929839 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d697b11a-20b9-4e1b-90ca-7f50a80eb6a1 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:17.952267 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1244/2484] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:15:17 2022] PUT /identity/v3/projects/7880040bc502421a8c8e9fa978d46925/users/bd004265e78f420d849a27e62d78f480/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:17.957975 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213a6f2-2f16-42d3-81ae-dee6412aeba5 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:17.969666 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213a6f2-2f16-42d3-81ae-dee6412aeba5 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:18.040167 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae873e-64a6-430e-ab01-0c8595b22a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:18.041455 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae873e-64a6-430e-ab01-0c8595b22a7b admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:18.042077 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae873e-64a6-430e-ab01-0c8595b22a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:18.042713 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae873e-64a6-430e-ab01-0c8595b22a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:18.043628 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae873e-64a6-430e-ab01-0c8595b22a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:18.045988 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae873e-64a6-430e-ab01-0c8595b22a7b admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:18.057367 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1241/2485] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:15:17 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:15:18.061936 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697b11a-20b9-4e1b-90ca-7f50a80eb6a1 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:18.072492 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697b11a-20b9-4e1b-90ca-7f50a80eb6a1 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:18.081522 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4225cb-2415-4ab3-8b57-7dbafb3e09f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:18.082577 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4225cb-2415-4ab3-8b57-7dbafb3e09f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:18.082876 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4225cb-2415-4ab3-8b57-7dbafb3e09f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:18.083308 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4225cb-2415-4ab3-8b57-7dbafb3e09f5 admin admin] PATH_INFO: `/v3/projects/7880040bc502421a8c8e9fa978d46925/users/bd004265e78f420d849a27e62d78f480/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:18.085621 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4225cb-2415-4ab3-8b57-7dbafb3e09f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7880040bc502421a8c8e9fa978d46925, user_id=bd004265e78f420d849a27e62d78f480, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:18.088219 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4225cb-2415-4ab3-8b57-7dbafb3e09f5 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:18.110993 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1245/2486] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:15:18 2022] PUT /identity/v3/projects/7880040bc502421a8c8e9fa978d46925/users/bd004265e78f420d849a27e62d78f480/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:18.113301 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9216e-82da-48d3-87e9-00bae924a3c7 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:18.113645 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9216e-82da-48d3-87e9-00bae924a3c7 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:18.113937 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9216e-82da-48d3-87e9-00bae924a3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:18.152779 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-c5c9216e-82da-48d3-87e9-00bae924a3c7 None None] MFA Rules not processed for user `bd004265e78f420d849a27e62d78f480`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:18.154818 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c5c9216e-82da-48d3-87e9-00bae924a3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:18.270394 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1242/2487] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:18 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:18.282593 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4225cb-2415-4ab3-8b57-7dbafb3e09f5 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:18.284441 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-9d4225cb-2415-4ab3-8b57-7dbafb3e09f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:18.349123 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4225cb-2415-4ab3-8b57-7dbafb3e09f5 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:18.353518 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33b214-c0ea-4039-9d7e-97a38520ba77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:18.353894 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33b214-c0ea-4039-9d7e-97a38520ba77 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:18.354230 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33b214-c0ea-4039-9d7e-97a38520ba77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:18.354501 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33b214-c0ea-4039-9d7e-97a38520ba77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:18.364220 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e33b214-c0ea-4039-9d7e-97a38520ba77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:18.365840 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e33b214-c0ea-4039-9d7e-97a38520ba77 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:18.377030 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1246/2488] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:15:18 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:15:18.832270 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9216e-82da-48d3-87e9-00bae924a3c7 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:18.913799 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9216e-82da-48d3-87e9-00bae924a3c7 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:18.918419 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f072c8a-81f8-485a-9bc4-2e598aabc386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:18.919417 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f072c8a-81f8-485a-9bc4-2e598aabc386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:18.919782 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f072c8a-81f8-485a-9bc4-2e598aabc386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:18.920204 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f072c8a-81f8-485a-9bc4-2e598aabc386 admin admin] PATH_INFO: `/v3/users/1ab9978f6a2d43368cd63a87d8331085` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:18.921648 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f072c8a-81f8-485a-9bc4-2e598aabc386 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ab9978f6a2d43368cd63a87d8331085)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:18.923672 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f072c8a-81f8-485a-9bc4-2e598aabc386 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:18.983091 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5f072c8a-81f8-485a-9bc4-2e598aabc386 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ab9978f6a2d43368cd63a87d8331085'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:19.003774 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5f072c8a-81f8-485a-9bc4-2e598aabc386 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ab9978f6a2d43368cd63a87d8331085'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:19.014217 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5f072c8a-81f8-485a-9bc4-2e598aabc386 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ab9978f6a2d43368cd63a87d8331085'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:19.034365 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5f072c8a-81f8-485a-9bc4-2e598aabc386 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ab9978f6a2d43368cd63a87d8331085'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:19.035525 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5f072c8a-81f8-485a-9bc4-2e598aabc386 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ab9978f6a2d43368cd63a87d8331085'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:19.042682 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1243/2489] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:15:18 2022] DELETE /identity/v3/users/1ab9978f6a2d43368cd63a87d8331085 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:19.047924 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6a02e-c770-440a-a558-4c75ade1259c None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:19.048215 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6a02e-c770-440a-a558-4c75ade1259c None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:19.048603 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6a02e-c770-440a-a558-4c75ade1259c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:19.104811 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-52c6a02e-c770-440a-a558-4c75ade1259c None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:19.107749 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-52c6a02e-c770-440a-a558-4c75ade1259c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:19.226718 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1247/2490] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:19.239761 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f072c8a-81f8-485a-9bc4-2e598aabc386 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:19.242722 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5f072c8a-81f8-485a-9bc4-2e598aabc386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:19.307758 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f072c8a-81f8-485a-9bc4-2e598aabc386 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:19.311543 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950d69d-2daa-4198-9e91-cdc0313bcbbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:19.312207 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950d69d-2daa-4198-9e91-cdc0313bcbbf service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:19.312636 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950d69d-2daa-4198-9e91-cdc0313bcbbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:19.312910 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950d69d-2daa-4198-9e91-cdc0313bcbbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:19.322126 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3950d69d-2daa-4198-9e91-cdc0313bcbbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:19.323707 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3950d69d-2daa-4198-9e91-cdc0313bcbbf service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:19.334333 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1244/2491] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:15:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:15:19.720221 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6a02e-c770-440a-a558-4c75ade1259c None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:19.722411 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-52c6a02e-c770-440a-a558-4c75ade1259c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:19.738927 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6a02e-c770-440a-a558-4c75ade1259c None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:19.744494 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6101c-6bfe-4381-b286-021d96c313fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:19.745378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6101c-6bfe-4381-b286-021d96c313fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:19.746002 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6101c-6bfe-4381-b286-021d96c313fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:19.746347 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6101c-6bfe-4381-b286-021d96c313fb admin admin] PATH_INFO: `/v3/projects/81ad1abf5d024da79d9830979d222432` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:19.747552 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6101c-6bfe-4381-b286-021d96c313fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=81ad1abf5d024da79d9830979d222432)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:19.749806 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6101c-6bfe-4381-b286-021d96c313fb admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:19.802301 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-c2e6101c-6bfe-4381-b286-021d96c313fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81ad1abf5d024da79d9830979d222432', 'request_id': 'req-c2e6101c-6bfe-4381-b286-021d96c313fb'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:19.807877 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-c2e6101c-6bfe-4381-b286-021d96c313fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81ad1abf5d024da79d9830979d222432', 'request_id': 'req-c2e6101c-6bfe-4381-b286-021d96c313fb'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:19.814596 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-c2e6101c-6bfe-4381-b286-021d96c313fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81ad1abf5d024da79d9830979d222432', 'request_id': 'req-c2e6101c-6bfe-4381-b286-021d96c313fb'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:19.829063 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-c2e6101c-6bfe-4381-b286-021d96c313fb admin admin] The token cache is being invalidate because project 81ad1abf5d024da79d9830979d222432 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:15:19.829352 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-c2e6101c-6bfe-4381-b286-021d96c313fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:19.830029 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-c2e6101c-6bfe-4381-b286-021d96c313fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:19.831668 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1248/2492] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:15:19 2022] DELETE /identity/v3/projects/81ad1abf5d024da79d9830979d222432 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:19.835552 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950d69d-2daa-4198-9e91-cdc0313bcbbf service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:19.845391 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950d69d-2daa-4198-9e91-cdc0313bcbbf service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:19.908704 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c48cd-4a44-4092-bec3-47c3407db227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:19.909611 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c48cd-4a44-4092-bec3-47c3407db227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:19.909896 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c48cd-4a44-4092-bec3-47c3407db227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:19.910168 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c48cd-4a44-4092-bec3-47c3407db227 admin admin] PATH_INFO: `/v3/users/bd004265e78f420d849a27e62d78f480` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:19.911393 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3c48cd-4a44-4092-bec3-47c3407db227 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd004265e78f420d849a27e62d78f480)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:19.913354 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3c48cd-4a44-4092-bec3-47c3407db227 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:19.962807 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1a3c48cd-4a44-4092-bec3-47c3407db227 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd004265e78f420d849a27e62d78f480'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:19.969776 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1a3c48cd-4a44-4092-bec3-47c3407db227 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd004265e78f420d849a27e62d78f480'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:19.977818 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1a3c48cd-4a44-4092-bec3-47c3407db227 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd004265e78f420d849a27e62d78f480'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:19.991667 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1a3c48cd-4a44-4092-bec3-47c3407db227 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd004265e78f420d849a27e62d78f480'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:19.992625 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1a3c48cd-4a44-4092-bec3-47c3407db227 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd004265e78f420d849a27e62d78f480'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:19.999060 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1245/2493] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:15:19 2022] DELETE /identity/v3/users/bd004265e78f420d849a27e62d78f480 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:20.287184 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6101c-6bfe-4381-b286-021d96c313fb admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:20.288707 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-c2e6101c-6bfe-4381-b286-021d96c313fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:20.305188 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6101c-6bfe-4381-b286-021d96c313fb admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:20.372687 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08871cf-7a32-4295-be25-395cdc5a3b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:20.373653 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08871cf-7a32-4295-be25-395cdc5a3b05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:20.373932 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08871cf-7a32-4295-be25-395cdc5a3b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:20.374250 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08871cf-7a32-4295-be25-395cdc5a3b05 admin admin] PATH_INFO: `/v3/projects/7880040bc502421a8c8e9fa978d46925` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:20.375427 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08871cf-7a32-4295-be25-395cdc5a3b05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7880040bc502421a8c8e9fa978d46925)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:20.377372 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08871cf-7a32-4295-be25-395cdc5a3b05 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:20.426375 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f08871cf-7a32-4295-be25-395cdc5a3b05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7880040bc502421a8c8e9fa978d46925', 'request_id': 'req-f08871cf-7a32-4295-be25-395cdc5a3b05'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:20.432247 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f08871cf-7a32-4295-be25-395cdc5a3b05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7880040bc502421a8c8e9fa978d46925', 'request_id': 'req-f08871cf-7a32-4295-be25-395cdc5a3b05'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:20.438594 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f08871cf-7a32-4295-be25-395cdc5a3b05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7880040bc502421a8c8e9fa978d46925', 'request_id': 'req-f08871cf-7a32-4295-be25-395cdc5a3b05'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:20.454721 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f08871cf-7a32-4295-be25-395cdc5a3b05 admin admin] The token cache is being invalidate because project 7880040bc502421a8c8e9fa978d46925 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:15:20.455018 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f08871cf-7a32-4295-be25-395cdc5a3b05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:20.455679 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f08871cf-7a32-4295-be25-395cdc5a3b05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:20.457242 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1249/2494] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:15:20 2022] DELETE /identity/v3/projects/7880040bc502421a8c8e9fa978d46925 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:15:20.462306 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d5be9-6da7-4a59-9b09-8a82612b36ea None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:20.462593 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d5be9-6da7-4a59-9b09-8a82612b36ea None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:20.462868 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d5be9-6da7-4a59-9b09-8a82612b36ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:20.481379 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-284d5be9-6da7-4a59-9b09-8a82612b36ea None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:20.482650 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-284d5be9-6da7-4a59-9b09-8a82612b36ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:20.543769 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1246/2495] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:15:20.551957 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d92b9-e207-4419-9f8d-436c0582ce97 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:20.552207 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d92b9-e207-4419-9f8d-436c0582ce97 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:20.552468 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d92b9-e207-4419-9f8d-436c0582ce97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:20.571072 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-5d7d92b9-e207-4419-9f8d-436c0582ce97 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:20.572277 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-5d7d92b9-e207-4419-9f8d-436c0582ce97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:20.580642 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1250/2496] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:20.585115 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d5be9-6da7-4a59-9b09-8a82612b36ea None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:20.595022 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d5be9-6da7-4a59-9b09-8a82612b36ea None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:20.600625 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89300d7-dbf3-4409-a17b-a442f921bfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:20.601298 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89300d7-dbf3-4409-a17b-a442f921bfff admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:20.601602 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89300d7-dbf3-4409-a17b-a442f921bfff admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:20.601876 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89300d7-dbf3-4409-a17b-a442f921bfff admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:20.602613 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89300d7-dbf3-4409-a17b-a442f921bfff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:15:20.602919 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89300d7-dbf3-4409-a17b-a442f921bfff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:20.604540 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89300d7-dbf3-4409-a17b-a442f921bfff admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:20.618350 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1247/2497] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:15:20.622735 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d92b9-e207-4419-9f8d-436c0582ce97 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:20.632460 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d92b9-e207-4419-9f8d-436c0582ce97 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:20.638404 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78707fd4-dc11-4cd6-8e05-f08ce920b5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:20.639065 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78707fd4-dc11-4cd6-8e05-f08ce920b5c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:20.639333 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78707fd4-dc11-4cd6-8e05-f08ce920b5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:20.639644 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78707fd4-dc11-4cd6-8e05-f08ce920b5c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:20.640304 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78707fd4-dc11-4cd6-8e05-f08ce920b5c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:20.642708 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78707fd4-dc11-4cd6-8e05-f08ce920b5c5 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:20.672524 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1251/2498] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:15:20 2022] POST /identity/v3/projects => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:15:20.676707 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89300d7-dbf3-4409-a17b-a442f921bfff admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:20.687065 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89300d7-dbf3-4409-a17b-a442f921bfff admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:20.749418 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5372d-ea2d-4160-8460-af51a9c673c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:20.750235 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5372d-ea2d-4160-8460-af51a9c673c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:20.750523 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5372d-ea2d-4160-8460-af51a9c673c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:20.750793 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5372d-ea2d-4160-8460-af51a9c673c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:20.751495 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5372d-ea2d-4160-8460-af51a9c673c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:20.753421 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5372d-ea2d-4160-8460-af51a9c673c8 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:20.775251 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1248/2499] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:15:20 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:15:20.780859 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78707fd4-dc11-4cd6-8e05-f08ce920b5c5 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:20.791543 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78707fd4-dc11-4cd6-8e05-f08ce920b5c5 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:20.796640 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af59529-eab0-4369-ad25-b2ceb871d026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:20.797312 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af59529-eab0-4369-ad25-b2ceb871d026 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:20.797606 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af59529-eab0-4369-ad25-b2ceb871d026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:20.797910 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af59529-eab0-4369-ad25-b2ceb871d026 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:20.798640 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af59529-eab0-4369-ad25-b2ceb871d026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:20.800262 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af59529-eab0-4369-ad25-b2ceb871d026 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:20.811120 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1252/2500] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:15:20.815535 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5372d-ea2d-4160-8460-af51a9c673c8 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:20.826380 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5372d-ea2d-4160-8460-af51a9c673c8 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:20.833919 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10a050-2907-4d64-a75f-6f8d3987c030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:20.834617 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10a050-2907-4d64-a75f-6f8d3987c030 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:20.834899 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10a050-2907-4d64-a75f-6f8d3987c030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:20.835180 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10a050-2907-4d64-a75f-6f8d3987c030 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:20.836021 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10a050-2907-4d64-a75f-6f8d3987c030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:20.837689 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10a050-2907-4d64-a75f-6f8d3987c030 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:20.848634 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1249/2501] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:15:20.853082 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af59529-eab0-4369-ad25-b2ceb871d026 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:20.863618 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af59529-eab0-4369-ad25-b2ceb871d026 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:20.868605 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9f6c6-990e-44e1-9c05-b23daec88a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:20.869705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9f6c6-990e-44e1-9c05-b23daec88a83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:20.870052 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9f6c6-990e-44e1-9c05-b23daec88a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:20.870383 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9f6c6-990e-44e1-9c05-b23daec88a83 admin admin] PATH_INFO: `/v3/projects/ab4b9fe0893244308819fb2e3a40eef3/users/13d365d5544e422db7995d2a2fc38785/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:20.895284 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9f6c6-990e-44e1-9c05-b23daec88a83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab4b9fe0893244308819fb2e3a40eef3, user_id=13d365d5544e422db7995d2a2fc38785, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:20.898294 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9f6c6-990e-44e1-9c05-b23daec88a83 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:20.913650 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1253/2502] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:15:20 2022] PUT /identity/v3/projects/ab4b9fe0893244308819fb2e3a40eef3/users/13d365d5544e422db7995d2a2fc38785/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:20.925604 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58578685-ea83-45a9-9569-c6e8cbea4118 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:20.925903 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58578685-ea83-45a9-9569-c6e8cbea4118 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:20.926187 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58578685-ea83-45a9-9569-c6e8cbea4118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:20.957283 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-58578685-ea83-45a9-9569-c6e8cbea4118 None None] MFA Rules not processed for user `13d365d5544e422db7995d2a2fc38785`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:20.958551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-58578685-ea83-45a9-9569-c6e8cbea4118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:21.030532 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1250/2503] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:20 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:21.031748 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9f6c6-990e-44e1-9c05-b23daec88a83 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:21.091387 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9f6c6-990e-44e1-9c05-b23daec88a83 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:21.096378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16367c-72e1-4fc7-8247-77169b48cfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:21.097153 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16367c-72e1-4fc7-8247-77169b48cfa1 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:21.097438 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16367c-72e1-4fc7-8247-77169b48cfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:21.097847 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16367c-72e1-4fc7-8247-77169b48cfa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:21.098555 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e16367c-72e1-4fc7-8247-77169b48cfa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:21.100719 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e16367c-72e1-4fc7-8247-77169b48cfa1 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:21.129331 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1254/2504] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:15:21 2022] POST /identity/v3/projects => generated 369 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:15:21.133648 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58578685-ea83-45a9-9569-c6e8cbea4118 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:21.146066 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58578685-ea83-45a9-9569-c6e8cbea4118 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:21.207294 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406f92a-f0db-4427-ba2a-506148bda5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:21.208006 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406f92a-f0db-4427-ba2a-506148bda5b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:21.208288 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406f92a-f0db-4427-ba2a-506148bda5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:21.208562 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406f92a-f0db-4427-ba2a-506148bda5b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:21.209298 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7406f92a-f0db-4427-ba2a-506148bda5b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:21.211289 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7406f92a-f0db-4427-ba2a-506148bda5b6 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:21.232248 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1251/2505] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:15:21 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:15:21.236956 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16367c-72e1-4fc7-8247-77169b48cfa1 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:21.248476 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16367c-72e1-4fc7-8247-77169b48cfa1 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:21.253874 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97e7fe-0bf7-40fa-918a-6acda7c8dcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:21.254600 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97e7fe-0bf7-40fa-918a-6acda7c8dcb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:21.254880 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97e7fe-0bf7-40fa-918a-6acda7c8dcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:21.255150 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97e7fe-0bf7-40fa-918a-6acda7c8dcb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:21.255864 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db97e7fe-0bf7-40fa-918a-6acda7c8dcb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:21.257625 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db97e7fe-0bf7-40fa-918a-6acda7c8dcb0 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:21.269223 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1255/2506] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:15:21.273738 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406f92a-f0db-4427-ba2a-506148bda5b6 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:21.284962 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406f92a-f0db-4427-ba2a-506148bda5b6 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:21.290533 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4df77-5be5-4847-89ef-ec6ddcd4b4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:21.291437 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4df77-5be5-4847-89ef-ec6ddcd4b4e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:21.291715 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4df77-5be5-4847-89ef-ec6ddcd4b4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:21.291987 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4df77-5be5-4847-89ef-ec6ddcd4b4e6 admin admin] PATH_INFO: `/v3/projects/77a68f5d570947048451c967b5b73f83/users/165e5739a7984f73a2e5e73c832993cd/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:21.308721 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb4df77-5be5-4847-89ef-ec6ddcd4b4e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77a68f5d570947048451c967b5b73f83, user_id=165e5739a7984f73a2e5e73c832993cd, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:21.311458 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb4df77-5be5-4847-89ef-ec6ddcd4b4e6 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:21.326347 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1252/2507] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:15:21 2022] PUT /identity/v3/projects/77a68f5d570947048451c967b5b73f83/users/165e5739a7984f73a2e5e73c832993cd/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:21.330921 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97e7fe-0bf7-40fa-918a-6acda7c8dcb0 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:21.340992 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97e7fe-0bf7-40fa-918a-6acda7c8dcb0 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:21.396875 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00846c36-8216-495b-90b7-1ff6eb8dccae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:21.397552 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00846c36-8216-495b-90b7-1ff6eb8dccae admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:21.397896 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00846c36-8216-495b-90b7-1ff6eb8dccae admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:21.398188 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00846c36-8216-495b-90b7-1ff6eb8dccae admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:21.399004 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00846c36-8216-495b-90b7-1ff6eb8dccae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:21.400731 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00846c36-8216-495b-90b7-1ff6eb8dccae admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:21.411097 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1256/2508] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:15:21.415642 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4df77-5be5-4847-89ef-ec6ddcd4b4e6 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:21.426563 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4df77-5be5-4847-89ef-ec6ddcd4b4e6 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:21.431928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55caccad-2c8b-4654-9c4e-a1eabdf81cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:21.432825 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55caccad-2c8b-4654-9c4e-a1eabdf81cf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:21.433119 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55caccad-2c8b-4654-9c4e-a1eabdf81cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:21.433411 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55caccad-2c8b-4654-9c4e-a1eabdf81cf5 admin admin] PATH_INFO: `/v3/projects/77a68f5d570947048451c967b5b73f83/users/165e5739a7984f73a2e5e73c832993cd/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:21.435458 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55caccad-2c8b-4654-9c4e-a1eabdf81cf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77a68f5d570947048451c967b5b73f83, user_id=165e5739a7984f73a2e5e73c832993cd, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:21.438546 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55caccad-2c8b-4654-9c4e-a1eabdf81cf5 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:21.449727 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1253/2509] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:15:21 2022] PUT /identity/v3/projects/77a68f5d570947048451c967b5b73f83/users/165e5739a7984f73a2e5e73c832993cd/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:21.460661 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655b57d-003b-4a8d-a10d-73fb3a03c418 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:21.461060 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655b57d-003b-4a8d-a10d-73fb3a03c418 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:21.461340 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655b57d-003b-4a8d-a10d-73fb3a03c418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:21.488840 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-3655b57d-003b-4a8d-a10d-73fb3a03c418 None None] MFA Rules not processed for user `165e5739a7984f73a2e5e73c832993cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:21.490109 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-3655b57d-003b-4a8d-a10d-73fb3a03c418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:21.566001 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1257/2510] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:21 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:21.580753 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55caccad-2c8b-4654-9c4e-a1eabdf81cf5 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:21.583253 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-55caccad-2c8b-4654-9c4e-a1eabdf81cf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:21.658615 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55caccad-2c8b-4654-9c4e-a1eabdf81cf5 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:21.662528 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa045a-4efe-4b6b-bf35-39f0de8fa3c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:21.663195 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa045a-4efe-4b6b-bf35-39f0de8fa3c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:21.663474 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa045a-4efe-4b6b-bf35-39f0de8fa3c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:21.663865 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa045a-4efe-4b6b-bf35-39f0de8fa3c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:21.674474 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa045a-4efe-4b6b-bf35-39f0de8fa3c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:21.675960 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa045a-4efe-4b6b-bf35-39f0de8fa3c7 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:21.686280 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1254/2511] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:15:21 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:15:23.143558 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655b57d-003b-4a8d-a10d-73fb3a03c418 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:23.206316 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655b57d-003b-4a8d-a10d-73fb3a03c418 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:23.211961 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c383e-1176-4d97-9e6c-4bbd0422dc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:23.212855 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c383e-1176-4d97-9e6c-4bbd0422dc73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:23.213142 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c383e-1176-4d97-9e6c-4bbd0422dc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:23.213420 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c383e-1176-4d97-9e6c-4bbd0422dc73 admin admin] PATH_INFO: `/v3/users/13d365d5544e422db7995d2a2fc38785` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:23.214866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c383e-1176-4d97-9e6c-4bbd0422dc73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13d365d5544e422db7995d2a2fc38785)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:23.216853 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c383e-1176-4d97-9e6c-4bbd0422dc73 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:23.282263 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-079c383e-1176-4d97-9e6c-4bbd0422dc73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13d365d5544e422db7995d2a2fc38785'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:23.292555 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-079c383e-1176-4d97-9e6c-4bbd0422dc73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13d365d5544e422db7995d2a2fc38785'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:23.300858 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-079c383e-1176-4d97-9e6c-4bbd0422dc73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13d365d5544e422db7995d2a2fc38785'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:23.301554 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-079c383e-1176-4d97-9e6c-4bbd0422dc73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13d365d5544e422db7995d2a2fc38785'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:23.314892 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-079c383e-1176-4d97-9e6c-4bbd0422dc73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13d365d5544e422db7995d2a2fc38785'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:23.321268 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1258/2512] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:15:23 2022] DELETE /identity/v3/users/13d365d5544e422db7995d2a2fc38785 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:23.325842 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd07e61-83e9-446a-bd81-9a309ad8ea70 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:23.326354 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd07e61-83e9-446a-bd81-9a309ad8ea70 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:23.326464 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd07e61-83e9-446a-bd81-9a309ad8ea70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:23.347820 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-ccd07e61-83e9-446a-bd81-9a309ad8ea70 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:23.349645 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ccd07e61-83e9-446a-bd81-9a309ad8ea70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:23.421567 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1255/2513] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:23.422298 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c383e-1176-4d97-9e6c-4bbd0422dc73 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:23.423800 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-079c383e-1176-4d97-9e6c-4bbd0422dc73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:23.430720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd07e61-83e9-446a-bd81-9a309ad8ea70 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:23.432082 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ccd07e61-83e9-446a-bd81-9a309ad8ea70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:23.482967 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c383e-1176-4d97-9e6c-4bbd0422dc73 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:23.486867 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c343b-db9f-423f-bca1-8b2d0e7e347e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:23.487530 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c343b-db9f-423f-bca1-8b2d0e7e347e service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:23.487815 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd07e61-83e9-446a-bd81-9a309ad8ea70 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:23.488022 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c343b-db9f-423f-bca1-8b2d0e7e347e service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:23.488129 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c343b-db9f-423f-bca1-8b2d0e7e347e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:23.489991 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-105c343b-db9f-423f-bca1-8b2d0e7e347e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:23.491512 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541759c-e05a-460c-959f-c1fb1f356524 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:23.492214 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541759c-e05a-460c-959f-c1fb1f356524 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:23.492474 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541759c-e05a-460c-959f-c1fb1f356524 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:23.492745 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541759c-e05a-460c-959f-c1fb1f356524 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:23.502210 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0541759c-e05a-460c-959f-c1fb1f356524 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:23.502362 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c343b-db9f-423f-bca1-8b2d0e7e347e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:23.503674 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0541759c-e05a-460c-959f-c1fb1f356524 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:23.503828 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c343b-db9f-423f-bca1-8b2d0e7e347e service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:23.513735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1256/2514] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:15:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:15:23.517058 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1259/2515] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:15:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 19:15:24.127356 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541759c-e05a-460c-959f-c1fb1f356524 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:24.128891 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0541759c-e05a-460c-959f-c1fb1f356524 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:24.143039 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541759c-e05a-460c-959f-c1fb1f356524 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:24.148172 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d2d5e2-82ca-4cc3-a53a-a2f2d2382543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:24.149056 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2d5e2-82ca-4cc3-a53a-a2f2d2382543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:24.149339 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2d5e2-82ca-4cc3-a53a-a2f2d2382543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:24.149713 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2d5e2-82ca-4cc3-a53a-a2f2d2382543 admin admin] PATH_INFO: `/v3/projects/ab4b9fe0893244308819fb2e3a40eef3` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:24.151324 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d2d5e2-82ca-4cc3-a53a-a2f2d2382543 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab4b9fe0893244308819fb2e3a40eef3)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:24.153279 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d2d5e2-82ca-4cc3-a53a-a2f2d2382543 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:24.207855 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-80d2d5e2-82ca-4cc3-a53a-a2f2d2382543 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab4b9fe0893244308819fb2e3a40eef3', 'request_id': 'req-80d2d5e2-82ca-4cc3-a53a-a2f2d2382543'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:24.216441 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-80d2d5e2-82ca-4cc3-a53a-a2f2d2382543 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab4b9fe0893244308819fb2e3a40eef3', 'request_id': 'req-80d2d5e2-82ca-4cc3-a53a-a2f2d2382543'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:24.222468 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-80d2d5e2-82ca-4cc3-a53a-a2f2d2382543 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab4b9fe0893244308819fb2e3a40eef3', 'request_id': 'req-80d2d5e2-82ca-4cc3-a53a-a2f2d2382543'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:24.233199 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-80d2d5e2-82ca-4cc3-a53a-a2f2d2382543 admin admin] The token cache is being invalidate because project ab4b9fe0893244308819fb2e3a40eef3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:15:24.234156 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-80d2d5e2-82ca-4cc3-a53a-a2f2d2382543 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:24.234300 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-80d2d5e2-82ca-4cc3-a53a-a2f2d2382543 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:24.236078 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1257/2516] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:15:24 2022] DELETE /identity/v3/projects/ab4b9fe0893244308819fb2e3a40eef3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:24.240265 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c343b-db9f-423f-bca1-8b2d0e7e347e service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:24.251147 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c343b-db9f-423f-bca1-8b2d0e7e347e service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:24.316308 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427f04e-c3b9-4426-871c-2a843ac41bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:24.317093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427f04e-c3b9-4426-871c-2a843ac41bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:24.317369 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427f04e-c3b9-4426-871c-2a843ac41bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:24.317679 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427f04e-c3b9-4426-871c-2a843ac41bc7 admin admin] PATH_INFO: `/v3/users/165e5739a7984f73a2e5e73c832993cd` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:24.318883 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427f04e-c3b9-4426-871c-2a843ac41bc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=165e5739a7984f73a2e5e73c832993cd)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:24.320867 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427f04e-c3b9-4426-871c-2a843ac41bc7 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:24.367673 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-6427f04e-c3b9-4426-871c-2a843ac41bc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '165e5739a7984f73a2e5e73c832993cd'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:24.375822 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-6427f04e-c3b9-4426-871c-2a843ac41bc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '165e5739a7984f73a2e5e73c832993cd'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:24.383362 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-6427f04e-c3b9-4426-871c-2a843ac41bc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '165e5739a7984f73a2e5e73c832993cd'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:24.384074 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-6427f04e-c3b9-4426-871c-2a843ac41bc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '165e5739a7984f73a2e5e73c832993cd'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:24.396084 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-6427f04e-c3b9-4426-871c-2a843ac41bc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '165e5739a7984f73a2e5e73c832993cd'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:24.401858 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1260/2517] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:15:24 2022] DELETE /identity/v3/users/165e5739a7984f73a2e5e73c832993cd => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:24.798949 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d2d5e2-82ca-4cc3-a53a-a2f2d2382543 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:24.800944 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-80d2d5e2-82ca-4cc3-a53a-a2f2d2382543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:24.816971 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d2d5e2-82ca-4cc3-a53a-a2f2d2382543 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:24.882500 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22278de8-1c29-405a-8252-3e93f085b36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:24.883403 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22278de8-1c29-405a-8252-3e93f085b36f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:24.883683 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22278de8-1c29-405a-8252-3e93f085b36f admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:24.883956 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22278de8-1c29-405a-8252-3e93f085b36f admin admin] PATH_INFO: `/v3/projects/77a68f5d570947048451c967b5b73f83` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:24.885376 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22278de8-1c29-405a-8252-3e93f085b36f admin admin] RBAC: Authorizing `identity:delete_project(project_id=77a68f5d570947048451c967b5b73f83)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:24.887452 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22278de8-1c29-405a-8252-3e93f085b36f admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:24.934136 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-22278de8-1c29-405a-8252-3e93f085b36f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77a68f5d570947048451c967b5b73f83', 'request_id': 'req-22278de8-1c29-405a-8252-3e93f085b36f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:24.941810 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-22278de8-1c29-405a-8252-3e93f085b36f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77a68f5d570947048451c967b5b73f83', 'request_id': 'req-22278de8-1c29-405a-8252-3e93f085b36f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:24.947354 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-22278de8-1c29-405a-8252-3e93f085b36f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77a68f5d570947048451c967b5b73f83', 'request_id': 'req-22278de8-1c29-405a-8252-3e93f085b36f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:24.958951 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-22278de8-1c29-405a-8252-3e93f085b36f admin admin] The token cache is being invalidate because project 77a68f5d570947048451c967b5b73f83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:15:24.959164 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-22278de8-1c29-405a-8252-3e93f085b36f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:24.959808 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-22278de8-1c29-405a-8252-3e93f085b36f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:24.962880 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1258/2518] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:15:24 2022] DELETE /identity/v3/projects/77a68f5d570947048451c967b5b73f83 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:24.966705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0e2db-2616-4df3-8142-81cc6c43daa9 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:24.966999 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0e2db-2616-4df3-8142-81cc6c43daa9 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:24.967275 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0e2db-2616-4df3-8142-81cc6c43daa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:24.986740 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-24b0e2db-2616-4df3-8142-81cc6c43daa9 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:24.987950 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-24b0e2db-2616-4df3-8142-81cc6c43daa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:25.046137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1261/2519] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:25.054300 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7370cd-9341-41c7-92a8-ef32e0550726 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:25.054700 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7370cd-9341-41c7-92a8-ef32e0550726 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:25.055045 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7370cd-9341-41c7-92a8-ef32e0550726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:25.073493 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-0d7370cd-9341-41c7-92a8-ef32e0550726 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:25.074844 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0d7370cd-9341-41c7-92a8-ef32e0550726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:25.082915 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1259/2520] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:25.087386 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0e2db-2616-4df3-8142-81cc6c43daa9 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:25.097397 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0e2db-2616-4df3-8142-81cc6c43daa9 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:25.103990 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e36bb-7c6f-4718-9ffc-6111d71d8544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:25.105163 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e36bb-7c6f-4718-9ffc-6111d71d8544 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:25.105283 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e36bb-7c6f-4718-9ffc-6111d71d8544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:25.105596 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e36bb-7c6f-4718-9ffc-6111d71d8544 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:25.106336 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e36bb-7c6f-4718-9ffc-6111d71d8544 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:15:25.106670 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e36bb-7c6f-4718-9ffc-6111d71d8544 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:25.108293 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e36bb-7c6f-4718-9ffc-6111d71d8544 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:25.122318 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1262/2521] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:15:25.126606 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7370cd-9341-41c7-92a8-ef32e0550726 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:25.136386 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7370cd-9341-41c7-92a8-ef32e0550726 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:25.142842 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f0790-9f0c-4f39-b90f-9e6f3255c3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:25.143520 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f0790-9f0c-4f39-b90f-9e6f3255c3c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:25.143918 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f0790-9f0c-4f39-b90f-9e6f3255c3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:25.144070 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f0790-9f0c-4f39-b90f-9e6f3255c3c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:25.144779 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f0790-9f0c-4f39-b90f-9e6f3255c3c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:25.146840 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f0790-9f0c-4f39-b90f-9e6f3255c3c3 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:25.174641 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1260/2522] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:15:25 2022] POST /identity/v3/projects => generated 391 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:15:25.180273 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e36bb-7c6f-4718-9ffc-6111d71d8544 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:25.190577 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e36bb-7c6f-4718-9ffc-6111d71d8544 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:25.249945 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb79c11-4fd9-44bc-a184-1af67142165b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:25.250641 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb79c11-4fd9-44bc-a184-1af67142165b admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:25.250912 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb79c11-4fd9-44bc-a184-1af67142165b admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:25.251200 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb79c11-4fd9-44bc-a184-1af67142165b admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:25.251905 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb79c11-4fd9-44bc-a184-1af67142165b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:25.253917 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb79c11-4fd9-44bc-a184-1af67142165b admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:25.277952 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1263/2523] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:15:25 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:15:25.279572 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f0790-9f0c-4f39-b90f-9e6f3255c3c3 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:25.290753 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f0790-9f0c-4f39-b90f-9e6f3255c3c3 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:25.296416 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26335dc8-d86a-472d-95bf-b1d8a4f83abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:25.297196 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26335dc8-d86a-472d-95bf-b1d8a4f83abc admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:25.297573 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26335dc8-d86a-472d-95bf-b1d8a4f83abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:25.297921 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26335dc8-d86a-472d-95bf-b1d8a4f83abc admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:25.298766 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26335dc8-d86a-472d-95bf-b1d8a4f83abc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:25.300473 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26335dc8-d86a-472d-95bf-b1d8a4f83abc admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:25.312240 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1261/2524] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:15:25.316805 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb79c11-4fd9-44bc-a184-1af67142165b admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:25.328823 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb79c11-4fd9-44bc-a184-1af67142165b admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:25.334737 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f3657-ad9c-4e04-9371-6c0a8e460517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:25.335874 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f3657-ad9c-4e04-9371-6c0a8e460517 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:25.336158 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f3657-ad9c-4e04-9371-6c0a8e460517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:25.336432 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f3657-ad9c-4e04-9371-6c0a8e460517 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:25.337184 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f3657-ad9c-4e04-9371-6c0a8e460517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:25.338916 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f3657-ad9c-4e04-9371-6c0a8e460517 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:25.350189 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1264/2525] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:15:25.354687 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26335dc8-d86a-472d-95bf-b1d8a4f83abc admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:25.366817 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26335dc8-d86a-472d-95bf-b1d8a4f83abc admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:25.373117 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151c84a-06ad-4df1-9e50-2eaf8e4c7cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:25.374128 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151c84a-06ad-4df1-9e50-2eaf8e4c7cc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:25.374771 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151c84a-06ad-4df1-9e50-2eaf8e4c7cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:25.374894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151c84a-06ad-4df1-9e50-2eaf8e4c7cc5 admin admin] PATH_INFO: `/v3/projects/348f4f2298d143c0886cc9e661242e90/users/ef447955878a484eab0151cd1d3b55ec/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:25.392357 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4151c84a-06ad-4df1-9e50-2eaf8e4c7cc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=348f4f2298d143c0886cc9e661242e90, user_id=ef447955878a484eab0151cd1d3b55ec, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:25.395362 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4151c84a-06ad-4df1-9e50-2eaf8e4c7cc5 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:25.410184 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1262/2526] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:15:25 2022] PUT /identity/v3/projects/348f4f2298d143c0886cc9e661242e90/users/ef447955878a484eab0151cd1d3b55ec/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:25.420738 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9246d1-fc72-4f35-8a2c-cce8b9f65364 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:25.421093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9246d1-fc72-4f35-8a2c-cce8b9f65364 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:25.421441 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9246d1-fc72-4f35-8a2c-cce8b9f65364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:25.449938 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-4d9246d1-fc72-4f35-8a2c-cce8b9f65364 None None] MFA Rules not processed for user `ef447955878a484eab0151cd1d3b55ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:25.451148 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-4d9246d1-fc72-4f35-8a2c-cce8b9f65364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:25.529577 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1265/2527] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:25.533625 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151c84a-06ad-4df1-9e50-2eaf8e4c7cc5 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:25.600083 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151c84a-06ad-4df1-9e50-2eaf8e4c7cc5 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:25.606353 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f96b2-fb0c-4af7-bd85-2b17a76bb16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:25.606770 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f96b2-fb0c-4af7-bd85-2b17a76bb16f admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:25.607050 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f96b2-fb0c-4af7-bd85-2b17a76bb16f admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:25.607309 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f96b2-fb0c-4af7-bd85-2b17a76bb16f admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:25.608625 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f96b2-fb0c-4af7-bd85-2b17a76bb16f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:25.610035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f96b2-fb0c-4af7-bd85-2b17a76bb16f admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:25.644649 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1263/2528] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:15:25 2022] POST /identity/v3/projects => generated 391 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:15:25.648754 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9246d1-fc72-4f35-8a2c-cce8b9f65364 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:25.665122 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9246d1-fc72-4f35-8a2c-cce8b9f65364 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:25.736452 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781e7ba-c500-4ba4-a991-2a6d2881ee5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:25.737566 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781e7ba-c500-4ba4-a991-2a6d2881ee5a admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:25.738000 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781e7ba-c500-4ba4-a991-2a6d2881ee5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:25.738426 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781e7ba-c500-4ba4-a991-2a6d2881ee5a admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:25.739952 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b781e7ba-c500-4ba4-a991-2a6d2881ee5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:25.742390 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b781e7ba-c500-4ba4-a991-2a6d2881ee5a admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:25.770846 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1266/2529] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:15:25 2022] POST /identity/v3/users => generated 302 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:15:25.772601 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f96b2-fb0c-4af7-bd85-2b17a76bb16f admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:25.787180 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f96b2-fb0c-4af7-bd85-2b17a76bb16f admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:25.793566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab883f16-e17d-4ae3-bcab-092a77c01b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:25.794514 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab883f16-e17d-4ae3-bcab-092a77c01b0c admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:25.794801 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab883f16-e17d-4ae3-bcab-092a77c01b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:25.795073 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab883f16-e17d-4ae3-bcab-092a77c01b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:25.795812 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab883f16-e17d-4ae3-bcab-092a77c01b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:25.797594 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab883f16-e17d-4ae3-bcab-092a77c01b0c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:25.809821 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1264/2530] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:15:25.814356 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781e7ba-c500-4ba4-a991-2a6d2881ee5a admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:25.825224 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781e7ba-c500-4ba4-a991-2a6d2881ee5a admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:25.830712 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9a4d8d-9097-4f77-b893-1ae7140bb71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:25.831688 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a4d8d-9097-4f77-b893-1ae7140bb71c admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:25.832044 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a4d8d-9097-4f77-b893-1ae7140bb71c admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:25.832415 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a4d8d-9097-4f77-b893-1ae7140bb71c admin admin] PATH_INFO: `/v3/projects/98a149d539dc48d3878e3782a44c2eae/users/1fbae66ffd6e495781a206e56d41e1f0/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:25.848543 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9a4d8d-9097-4f77-b893-1ae7140bb71c admin admin] RBAC: Authorizing `identity:create_grant(project_id=98a149d539dc48d3878e3782a44c2eae, user_id=1fbae66ffd6e495781a206e56d41e1f0, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:25.851497 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9a4d8d-9097-4f77-b893-1ae7140bb71c admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:25.868066 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1267/2531] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:15:25 2022] PUT /identity/v3/projects/98a149d539dc48d3878e3782a44c2eae/users/1fbae66ffd6e495781a206e56d41e1f0/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:25.872276 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab883f16-e17d-4ae3-bcab-092a77c01b0c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:25.882559 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab883f16-e17d-4ae3-bcab-092a77c01b0c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:25.943433 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc68a3d-35f0-47ff-b08a-2f0b9f261739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:25.944289 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc68a3d-35f0-47ff-b08a-2f0b9f261739 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:25.944678 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc68a3d-35f0-47ff-b08a-2f0b9f261739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:25.945045 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc68a3d-35f0-47ff-b08a-2f0b9f261739 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:25.945918 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc68a3d-35f0-47ff-b08a-2f0b9f261739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:25.947665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc68a3d-35f0-47ff-b08a-2f0b9f261739 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:25.959257 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1265/2532] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:15:25.963538 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9a4d8d-9097-4f77-b893-1ae7140bb71c admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:25.975624 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9a4d8d-9097-4f77-b893-1ae7140bb71c admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:25.980764 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4082aa7-927f-4646-8a54-3630095f89bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:25.981821 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4082aa7-927f-4646-8a54-3630095f89bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:25.982171 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4082aa7-927f-4646-8a54-3630095f89bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:25.982521 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4082aa7-927f-4646-8a54-3630095f89bc admin admin] PATH_INFO: `/v3/projects/98a149d539dc48d3878e3782a44c2eae/users/1fbae66ffd6e495781a206e56d41e1f0/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:25.984725 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4082aa7-927f-4646-8a54-3630095f89bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=98a149d539dc48d3878e3782a44c2eae, user_id=1fbae66ffd6e495781a206e56d41e1f0, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:25.987775 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4082aa7-927f-4646-8a54-3630095f89bc admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:26.006502 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1268/2533] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:15:25 2022] PUT /identity/v3/projects/98a149d539dc48d3878e3782a44c2eae/users/1fbae66ffd6e495781a206e56d41e1f0/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:26.017883 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2337433-ce3e-472d-86fe-e27e9eff2783 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:26.018442 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2337433-ce3e-472d-86fe-e27e9eff2783 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:26.018930 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2337433-ce3e-472d-86fe-e27e9eff2783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:26.062744 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-e2337433-ce3e-472d-86fe-e27e9eff2783 None None] MFA Rules not processed for user `1fbae66ffd6e495781a206e56d41e1f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:26.063995 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e2337433-ce3e-472d-86fe-e27e9eff2783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:26.139283 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1266/2534] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:26 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:26.150597 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4082aa7-927f-4646-8a54-3630095f89bc admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:26.152509 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-d4082aa7-927f-4646-8a54-3630095f89bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:26.215283 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4082aa7-927f-4646-8a54-3630095f89bc admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:26.219234 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b166e4-56e7-41ba-960f-5e77f5105a1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:26.219889 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b166e4-56e7-41ba-960f-5e77f5105a1b service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:26.220185 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b166e4-56e7-41ba-960f-5e77f5105a1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:26.220487 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b166e4-56e7-41ba-960f-5e77f5105a1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:26.229464 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b166e4-56e7-41ba-960f-5e77f5105a1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:26.230960 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b166e4-56e7-41ba-960f-5e77f5105a1b service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:26.240945 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1269/2535] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:15:26 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:15:26.286760 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2337433-ce3e-472d-86fe-e27e9eff2783 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:26.288241 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e2337433-ce3e-472d-86fe-e27e9eff2783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:26.300492 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2337433-ce3e-472d-86fe-e27e9eff2783 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:26.304711 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90073124-c3a0-4427-807c-d6c4b9785ecd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:26.305497 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90073124-c3a0-4427-807c-d6c4b9785ecd service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:26.305863 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90073124-c3a0-4427-807c-d6c4b9785ecd service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:26.306199 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90073124-c3a0-4427-807c-d6c4b9785ecd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:26.368806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90073124-c3a0-4427-807c-d6c4b9785ecd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:26.370484 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90073124-c3a0-4427-807c-d6c4b9785ecd service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:26.380719 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1267/2536] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:15:26 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:15:27.262817 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b166e4-56e7-41ba-960f-5e77f5105a1b service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:27.264389 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f1b166e4-56e7-41ba-960f-5e77f5105a1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:27.334007 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b166e4-56e7-41ba-960f-5e77f5105a1b service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:27.341007 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba48cced-7c5e-4dcf-acfb-2ea74025065a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:27.342276 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48cced-7c5e-4dcf-acfb-2ea74025065a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:27.342673 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48cced-7c5e-4dcf-acfb-2ea74025065a admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:27.343160 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48cced-7c5e-4dcf-acfb-2ea74025065a admin admin] PATH_INFO: `/v3/users/7d3af11e1ffc4ab1a37669f893d2f3be` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:27.344394 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba48cced-7c5e-4dcf-acfb-2ea74025065a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d3af11e1ffc4ab1a37669f893d2f3be)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:27.346373 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba48cced-7c5e-4dcf-acfb-2ea74025065a admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:27.406394 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ba48cced-7c5e-4dcf-acfb-2ea74025065a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d3af11e1ffc4ab1a37669f893d2f3be'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:27.415515 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ba48cced-7c5e-4dcf-acfb-2ea74025065a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d3af11e1ffc4ab1a37669f893d2f3be'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:27.426027 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ba48cced-7c5e-4dcf-acfb-2ea74025065a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d3af11e1ffc4ab1a37669f893d2f3be'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:27.427002 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ba48cced-7c5e-4dcf-acfb-2ea74025065a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d3af11e1ffc4ab1a37669f893d2f3be'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:27.443788 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ba48cced-7c5e-4dcf-acfb-2ea74025065a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d3af11e1ffc4ab1a37669f893d2f3be'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:27.450210 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1270/2537] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:15:27 2022] DELETE /identity/v3/users/7d3af11e1ffc4ab1a37669f893d2f3be => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:27.627326 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90073124-c3a0-4427-807c-d6c4b9785ecd service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:27.639448 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90073124-c3a0-4427-807c-d6c4b9785ecd service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:27.718458 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aac88d-7c43-40af-a771-d69a95a633df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:27.719362 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aac88d-7c43-40af-a771-d69a95a633df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:27.719645 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aac88d-7c43-40af-a771-d69a95a633df admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:27.720178 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aac88d-7c43-40af-a771-d69a95a633df admin admin] PATH_INFO: `/v3/projects/dd195af6f92c42a18ed7051eae26dbaa` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:27.721500 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aac88d-7c43-40af-a771-d69a95a633df admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd195af6f92c42a18ed7051eae26dbaa)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:27.727760 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aac88d-7c43-40af-a771-d69a95a633df admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:27.782460 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-46aac88d-7c43-40af-a771-d69a95a633df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd195af6f92c42a18ed7051eae26dbaa', 'request_id': 'req-46aac88d-7c43-40af-a771-d69a95a633df'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:27.790099 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-46aac88d-7c43-40af-a771-d69a95a633df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd195af6f92c42a18ed7051eae26dbaa', 'request_id': 'req-46aac88d-7c43-40af-a771-d69a95a633df'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:27.795538 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-46aac88d-7c43-40af-a771-d69a95a633df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd195af6f92c42a18ed7051eae26dbaa', 'request_id': 'req-46aac88d-7c43-40af-a771-d69a95a633df'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:27.806540 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-46aac88d-7c43-40af-a771-d69a95a633df admin admin] The token cache is being invalidate because project dd195af6f92c42a18ed7051eae26dbaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:15:27.806980 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-46aac88d-7c43-40af-a771-d69a95a633df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:27.807606 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-46aac88d-7c43-40af-a771-d69a95a633df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:27.809157 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1268/2538] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:15:27 2022] DELETE /identity/v3/projects/dd195af6f92c42a18ed7051eae26dbaa => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:27.814129 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e75cf2-d17f-4018-9734-77fbebbedaed None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:27.814441 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e75cf2-d17f-4018-9734-77fbebbedaed None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:27.814728 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e75cf2-d17f-4018-9734-77fbebbedaed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:27.832698 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-c1e75cf2-d17f-4018-9734-77fbebbedaed None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:27.833962 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-c1e75cf2-d17f-4018-9734-77fbebbedaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:27.893074 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1271/2539] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:15:27.901010 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf091f6-cd70-4c53-9636-c913c3cc22f2 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:27.901296 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf091f6-cd70-4c53-9636-c913c3cc22f2 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:27.901599 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf091f6-cd70-4c53-9636-c913c3cc22f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:27.920110 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-6cf091f6-cd70-4c53-9636-c913c3cc22f2 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:27.921491 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6cf091f6-cd70-4c53-9636-c913c3cc22f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:27.930772 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1269/2540] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:27.935199 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e75cf2-d17f-4018-9734-77fbebbedaed None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:27.944800 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e75cf2-d17f-4018-9734-77fbebbedaed None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:27.949446 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e83a1b-25fd-4067-8f55-521e4a7e7a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:27.950129 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e83a1b-25fd-4067-8f55-521e4a7e7a44 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:27.950404 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e83a1b-25fd-4067-8f55-521e4a7e7a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:27.950673 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e83a1b-25fd-4067-8f55-521e4a7e7a44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:27.951395 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e83a1b-25fd-4067-8f55-521e4a7e7a44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:15:27.951697 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e83a1b-25fd-4067-8f55-521e4a7e7a44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:27.953348 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e83a1b-25fd-4067-8f55-521e4a7e7a44 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:27.968510 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1272/2541] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:15:27.969459 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf091f6-cd70-4c53-9636-c913c3cc22f2 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:27.979842 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf091f6-cd70-4c53-9636-c913c3cc22f2 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:27.985513 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97784701-5d72-4c29-95eb-2916981ed240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:27.986206 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97784701-5d72-4c29-95eb-2916981ed240 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:27.986481 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97784701-5d72-4c29-95eb-2916981ed240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:27.986747 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97784701-5d72-4c29-95eb-2916981ed240 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:27.987473 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97784701-5d72-4c29-95eb-2916981ed240 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:27.989382 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97784701-5d72-4c29-95eb-2916981ed240 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:28.018237 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1270/2542] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:15:27 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:15:28.022488 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e83a1b-25fd-4067-8f55-521e4a7e7a44 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:28.032667 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e83a1b-25fd-4067-8f55-521e4a7e7a44 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:28.089985 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99ce3d-cf0c-4819-b156-a987dee567c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:28.090602 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99ce3d-cf0c-4819-b156-a987dee567c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:28.090888 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99ce3d-cf0c-4819-b156-a987dee567c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:28.091163 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99ce3d-cf0c-4819-b156-a987dee567c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:28.091856 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d99ce3d-cf0c-4819-b156-a987dee567c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:28.093863 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d99ce3d-cf0c-4819-b156-a987dee567c8 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:28.114917 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1273/2543] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:15:28 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:15:28.123813 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97784701-5d72-4c29-95eb-2916981ed240 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:28.146491 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97784701-5d72-4c29-95eb-2916981ed240 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:28.151852 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9112fb2-67bd-441f-a91c-a992c9d241ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:28.152538 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9112fb2-67bd-441f-a91c-a992c9d241ec admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:28.152820 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9112fb2-67bd-441f-a91c-a992c9d241ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:28.153095 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9112fb2-67bd-441f-a91c-a992c9d241ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:28.153870 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9112fb2-67bd-441f-a91c-a992c9d241ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:28.155649 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9112fb2-67bd-441f-a91c-a992c9d241ec admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:28.169801 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1271/2544] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:15:28.170916 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99ce3d-cf0c-4819-b156-a987dee567c8 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:28.180839 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99ce3d-cf0c-4819-b156-a987dee567c8 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:28.185543 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccfd505-ed3b-4452-a3e4-50b9105bfaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:28.186226 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfd505-ed3b-4452-a3e4-50b9105bfaef admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:28.186509 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfd505-ed3b-4452-a3e4-50b9105bfaef admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:28.186879 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfd505-ed3b-4452-a3e4-50b9105bfaef admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:28.187641 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccfd505-ed3b-4452-a3e4-50b9105bfaef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:28.189260 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccfd505-ed3b-4452-a3e4-50b9105bfaef admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:28.199464 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1274/2545] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:15:28.203431 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9112fb2-67bd-441f-a91c-a992c9d241ec admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:28.213891 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9112fb2-67bd-441f-a91c-a992c9d241ec admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:28.218632 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ed59a-8ceb-46cf-ab94-ed34464ba393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:28.219516 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ed59a-8ceb-46cf-ab94-ed34464ba393 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:28.219795 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ed59a-8ceb-46cf-ab94-ed34464ba393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:28.220069 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ed59a-8ceb-46cf-ab94-ed34464ba393 admin admin] PATH_INFO: `/v3/projects/fdfde41b98ec442882196ab8ee751428/users/3692612adb214ab496caa11ce55b57b1/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:28.234633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551ed59a-8ceb-46cf-ab94-ed34464ba393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdfde41b98ec442882196ab8ee751428, user_id=3692612adb214ab496caa11ce55b57b1, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:28.237724 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551ed59a-8ceb-46cf-ab94-ed34464ba393 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:28.250801 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1272/2546] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:15:28 2022] PUT /identity/v3/projects/fdfde41b98ec442882196ab8ee751428/users/3692612adb214ab496caa11ce55b57b1/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:28.261479 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57d8a4-445f-4d3c-9544-9f8a4ae73b32 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:28.261874 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57d8a4-445f-4d3c-9544-9f8a4ae73b32 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:28.262212 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57d8a4-445f-4d3c-9544-9f8a4ae73b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:28.290916 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-cb57d8a4-445f-4d3c-9544-9f8a4ae73b32 None None] MFA Rules not processed for user `3692612adb214ab496caa11ce55b57b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:28.292129 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-cb57d8a4-445f-4d3c-9544-9f8a4ae73b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:28.364855 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1275/2547] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:15:28.376189 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ed59a-8ceb-46cf-ab94-ed34464ba393 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:28.377976 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-551ed59a-8ceb-46cf-ab94-ed34464ba393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:28.455046 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ed59a-8ceb-46cf-ab94-ed34464ba393 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:28.460707 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff38ef-4537-42ff-9baf-04cd5455d7b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:28.461367 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff38ef-4537-42ff-9baf-04cd5455d7b8 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:28.461678 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff38ef-4537-42ff-9baf-04cd5455d7b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:28.461955 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff38ef-4537-42ff-9baf-04cd5455d7b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:28.470143 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff38ef-4537-42ff-9baf-04cd5455d7b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:28.471857 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff38ef-4537-42ff-9baf-04cd5455d7b8 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:28.481141 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1273/2548] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:15:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:15:29.651650 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57d8a4-445f-4d3c-9544-9f8a4ae73b32 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:29.653304 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-cb57d8a4-445f-4d3c-9544-9f8a4ae73b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:29.716221 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57d8a4-445f-4d3c-9544-9f8a4ae73b32 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:29.722906 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc20b5-3990-4ef3-be2e-4bd322861ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:29.724131 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc20b5-3990-4ef3-be2e-4bd322861ccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:29.724548 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc20b5-3990-4ef3-be2e-4bd322861ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:29.724976 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc20b5-3990-4ef3-be2e-4bd322861ccc admin admin] PATH_INFO: `/v3/users/ef447955878a484eab0151cd1d3b55ec` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:29.727209 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc20b5-3990-4ef3-be2e-4bd322861ccc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef447955878a484eab0151cd1d3b55ec)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:29.730260 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc20b5-3990-4ef3-be2e-4bd322861ccc admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:29.786461 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-9dcc20b5-3990-4ef3-be2e-4bd322861ccc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef447955878a484eab0151cd1d3b55ec'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:29.794483 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-9dcc20b5-3990-4ef3-be2e-4bd322861ccc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef447955878a484eab0151cd1d3b55ec'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:29.801648 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-9dcc20b5-3990-4ef3-be2e-4bd322861ccc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef447955878a484eab0151cd1d3b55ec'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:29.802310 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-9dcc20b5-3990-4ef3-be2e-4bd322861ccc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef447955878a484eab0151cd1d3b55ec'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:29.813848 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-9dcc20b5-3990-4ef3-be2e-4bd322861ccc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef447955878a484eab0151cd1d3b55ec'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:29.819768 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1276/2549] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:15:29 2022] DELETE /identity/v3/users/ef447955878a484eab0151cd1d3b55ec => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:29.824492 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03c63f-3741-4ad8-8754-b5d3ab85c066 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:29.825036 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03c63f-3741-4ad8-8754-b5d3ab85c066 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:29.825036 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03c63f-3741-4ad8-8754-b5d3ab85c066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:29.843111 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-fd03c63f-3741-4ad8-8754-b5d3ab85c066 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:29.844413 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-fd03c63f-3741-4ad8-8754-b5d3ab85c066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:29.905199 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1274/2550] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:15:29.915395 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc20b5-3990-4ef3-be2e-4bd322861ccc admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:29.916838 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-9dcc20b5-3990-4ef3-be2e-4bd322861ccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:29.973225 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc20b5-3990-4ef3-be2e-4bd322861ccc admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:29.976887 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4fb21-2d74-4f3f-a5ae-981914db6fd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:29.977563 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4fb21-2d74-4f3f-a5ae-981914db6fd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:29.977878 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4fb21-2d74-4f3f-a5ae-981914db6fd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:29.978134 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4fb21-2d74-4f3f-a5ae-981914db6fd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:29.988510 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4fb21-2d74-4f3f-a5ae-981914db6fd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:29.990000 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4fb21-2d74-4f3f-a5ae-981914db6fd7 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:29.999991 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1277/2551] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:15:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 19:15:30.272953 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03c63f-3741-4ad8-8754-b5d3ab85c066 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:30.273942 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-fd03c63f-3741-4ad8-8754-b5d3ab85c066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:30.297088 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03c63f-3741-4ad8-8754-b5d3ab85c066 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:30.302040 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ebde08-1d55-4726-b95f-09cb870c32f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:30.303418 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebde08-1d55-4726-b95f-09cb870c32f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:30.303700 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebde08-1d55-4726-b95f-09cb870c32f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:30.304156 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebde08-1d55-4726-b95f-09cb870c32f4 admin admin] PATH_INFO: `/v3/projects/348f4f2298d143c0886cc9e661242e90` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:30.305644 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ebde08-1d55-4726-b95f-09cb870c32f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=348f4f2298d143c0886cc9e661242e90)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:30.307794 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ebde08-1d55-4726-b95f-09cb870c32f4 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:30.356069 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b1ebde08-1d55-4726-b95f-09cb870c32f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '348f4f2298d143c0886cc9e661242e90', 'request_id': 'req-b1ebde08-1d55-4726-b95f-09cb870c32f4'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:30.364472 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b1ebde08-1d55-4726-b95f-09cb870c32f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '348f4f2298d143c0886cc9e661242e90', 'request_id': 'req-b1ebde08-1d55-4726-b95f-09cb870c32f4'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:30.370869 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b1ebde08-1d55-4726-b95f-09cb870c32f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '348f4f2298d143c0886cc9e661242e90', 'request_id': 'req-b1ebde08-1d55-4726-b95f-09cb870c32f4'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:30.382267 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b1ebde08-1d55-4726-b95f-09cb870c32f4 admin admin] The token cache is being invalidate because project 348f4f2298d143c0886cc9e661242e90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:15:30.382685 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b1ebde08-1d55-4726-b95f-09cb870c32f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:30.383496 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b1ebde08-1d55-4726-b95f-09cb870c32f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:30.385097 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1275/2552] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:15:30 2022] DELETE /identity/v3/projects/348f4f2298d143c0886cc9e661242e90 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:30.389324 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4fb21-2d74-4f3f-a5ae-981914db6fd7 service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:30.399693 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4fb21-2d74-4f3f-a5ae-981914db6fd7 service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:30.454522 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ebee8c-0470-41b5-aec6-b057799c72f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:30.455404 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebee8c-0470-41b5-aec6-b057799c72f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:30.455693 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebee8c-0470-41b5-aec6-b057799c72f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:30.455986 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebee8c-0470-41b5-aec6-b057799c72f8 admin admin] PATH_INFO: `/v3/users/1fbae66ffd6e495781a206e56d41e1f0` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:30.457175 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ebee8c-0470-41b5-aec6-b057799c72f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fbae66ffd6e495781a206e56d41e1f0)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:30.459197 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ebee8c-0470-41b5-aec6-b057799c72f8 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:30.507765 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-88ebee8c-0470-41b5-aec6-b057799c72f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fbae66ffd6e495781a206e56d41e1f0'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:30.517616 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-88ebee8c-0470-41b5-aec6-b057799c72f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fbae66ffd6e495781a206e56d41e1f0'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:30.527276 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-88ebee8c-0470-41b5-aec6-b057799c72f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fbae66ffd6e495781a206e56d41e1f0'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:30.528090 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-88ebee8c-0470-41b5-aec6-b057799c72f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fbae66ffd6e495781a206e56d41e1f0'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:30.539963 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-88ebee8c-0470-41b5-aec6-b057799c72f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fbae66ffd6e495781a206e56d41e1f0'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:30.545804 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1278/2553] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:15:30 2022] DELETE /identity/v3/users/1fbae66ffd6e495781a206e56d41e1f0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:30.822846 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ebde08-1d55-4726-b95f-09cb870c32f4 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:30.824733 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b1ebde08-1d55-4726-b95f-09cb870c32f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:30.840338 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ebde08-1d55-4726-b95f-09cb870c32f4 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:30.899833 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3cb5bb-044c-462d-9832-91b2fbd8e92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:30.900684 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3cb5bb-044c-462d-9832-91b2fbd8e92b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:30.900966 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3cb5bb-044c-462d-9832-91b2fbd8e92b admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:30.901235 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3cb5bb-044c-462d-9832-91b2fbd8e92b admin admin] PATH_INFO: `/v3/projects/98a149d539dc48d3878e3782a44c2eae` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:30.902441 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3cb5bb-044c-462d-9832-91b2fbd8e92b admin admin] RBAC: Authorizing `identity:delete_project(project_id=98a149d539dc48d3878e3782a44c2eae)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:30.904370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3cb5bb-044c-462d-9832-91b2fbd8e92b admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:30.956740 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3d3cb5bb-044c-462d-9832-91b2fbd8e92b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98a149d539dc48d3878e3782a44c2eae', 'request_id': 'req-3d3cb5bb-044c-462d-9832-91b2fbd8e92b'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:30.966024 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3d3cb5bb-044c-462d-9832-91b2fbd8e92b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98a149d539dc48d3878e3782a44c2eae', 'request_id': 'req-3d3cb5bb-044c-462d-9832-91b2fbd8e92b'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:30.972114 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3d3cb5bb-044c-462d-9832-91b2fbd8e92b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98a149d539dc48d3878e3782a44c2eae', 'request_id': 'req-3d3cb5bb-044c-462d-9832-91b2fbd8e92b'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:30.983703 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3d3cb5bb-044c-462d-9832-91b2fbd8e92b admin admin] The token cache is being invalidate because project 98a149d539dc48d3878e3782a44c2eae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:15:30.984182 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3d3cb5bb-044c-462d-9832-91b2fbd8e92b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:30.984929 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3d3cb5bb-044c-462d-9832-91b2fbd8e92b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:30.986647 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1276/2554] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:15:30 2022] DELETE /identity/v3/projects/98a149d539dc48d3878e3782a44c2eae => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:30.991758 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd3039-9681-481a-8453-c348b741d06e None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:30.992249 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd3039-9681-481a-8453-c348b741d06e None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:30.992372 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd3039-9681-481a-8453-c348b741d06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:31.012812 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-33fd3039-9681-481a-8453-c348b741d06e None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:31.014069 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-33fd3039-9681-481a-8453-c348b741d06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:31.079146 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1279/2555] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:31.088252 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4d1a5-d71a-4832-85ab-18e3fd929ecb None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:31.088538 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4d1a5-d71a-4832-85ab-18e3fd929ecb None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:31.088812 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4d1a5-d71a-4832-85ab-18e3fd929ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:31.107872 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-3af4d1a5-d71a-4832-85ab-18e3fd929ecb None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:31.109126 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3af4d1a5-d71a-4832-85ab-18e3fd929ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:31.118517 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1277/2556] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:31.122557 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd3039-9681-481a-8453-c348b741d06e None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:31.132489 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd3039-9681-481a-8453-c348b741d06e None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:31.137822 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edf3bd-511b-44ea-b899-ddcd63a13e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:31.138497 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edf3bd-511b-44ea-b899-ddcd63a13e07 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:31.138804 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edf3bd-511b-44ea-b899-ddcd63a13e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:31.139074 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edf3bd-511b-44ea-b899-ddcd63a13e07 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:31.139798 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81edf3bd-511b-44ea-b899-ddcd63a13e07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:15:31.140107 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81edf3bd-511b-44ea-b899-ddcd63a13e07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:31.142216 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81edf3bd-511b-44ea-b899-ddcd63a13e07 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:31.153051 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4d1a5-d71a-4832-85ab-18e3fd929ecb None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:31.154506 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3af4d1a5-d71a-4832-85ab-18e3fd929ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:31.157632 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1280/2557] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:15:31.159095 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edf3bd-511b-44ea-b899-ddcd63a13e07 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:31.166449 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4d1a5-d71a-4832-85ab-18e3fd929ecb None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:31.168837 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edf3bd-511b-44ea-b899-ddcd63a13e07 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:31.171192 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d662a63-cf05-4e06-aa8d-9e053eff9683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:31.172151 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d662a63-cf05-4e06-aa8d-9e053eff9683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:31.172429 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d662a63-cf05-4e06-aa8d-9e053eff9683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:31.172702 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d662a63-cf05-4e06-aa8d-9e053eff9683 admin admin] PATH_INFO: `/v3/users/3692612adb214ab496caa11ce55b57b1` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:31.173732 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32737602-034d-4cd9-b07a-0bd3e2ca3ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:31.173968 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d662a63-cf05-4e06-aa8d-9e053eff9683 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3692612adb214ab496caa11ce55b57b1)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:31.174398 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32737602-034d-4cd9-b07a-0bd3e2ca3ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:31.174632 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32737602-034d-4cd9-b07a-0bd3e2ca3ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:31.174938 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32737602-034d-4cd9-b07a-0bd3e2ca3ab6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:31.175625 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32737602-034d-4cd9-b07a-0bd3e2ca3ab6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:31.175928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d662a63-cf05-4e06-aa8d-9e053eff9683 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:31.177506 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32737602-034d-4cd9-b07a-0bd3e2ca3ab6 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:31.204708 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1281/2558] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:15:31 2022] POST /identity/v3/projects => generated 401 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:15:31.208872 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32737602-034d-4cd9-b07a-0bd3e2ca3ab6 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:31.223971 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-0d662a63-cf05-4e06-aa8d-9e053eff9683 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3692612adb214ab496caa11ce55b57b1'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:31.230436 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-0d662a63-cf05-4e06-aa8d-9e053eff9683 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3692612adb214ab496caa11ce55b57b1'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:31.239284 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-0d662a63-cf05-4e06-aa8d-9e053eff9683 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3692612adb214ab496caa11ce55b57b1'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:31.251139 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-0d662a63-cf05-4e06-aa8d-9e053eff9683 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3692612adb214ab496caa11ce55b57b1'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:31.251800 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-0d662a63-cf05-4e06-aa8d-9e053eff9683 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3692612adb214ab496caa11ce55b57b1'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:31.257728 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1278/2559] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:15:31 2022] DELETE /identity/v3/users/3692612adb214ab496caa11ce55b57b1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:31.262988 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923f755-63cb-45d2-96e7-8c684c81246d None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:31.263280 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923f755-63cb-45d2-96e7-8c684c81246d None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:31.263558 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923f755-63cb-45d2-96e7-8c684c81246d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:31.268499 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32737602-034d-4cd9-b07a-0bd3e2ca3ab6 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:31.281859 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-3923f755-63cb-45d2-96e7-8c684c81246d None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:31.283081 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3923f755-63cb-45d2-96e7-8c684c81246d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:31.321056 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399209bd-130a-4ae6-b41b-6604ab2eeb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:31.321766 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399209bd-130a-4ae6-b41b-6604ab2eeb73 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:31.322052 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399209bd-130a-4ae6-b41b-6604ab2eeb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:31.322319 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399209bd-130a-4ae6-b41b-6604ab2eeb73 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:31.322999 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399209bd-130a-4ae6-b41b-6604ab2eeb73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:31.324920 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399209bd-130a-4ae6-b41b-6604ab2eeb73 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:31.341463 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1279/2560] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:31.345911 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1282/2561] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:15:31 2022] POST /identity/v3/users => generated 301 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:15:31.349489 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923f755-63cb-45d2-96e7-8c684c81246d None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:31.350983 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3923f755-63cb-45d2-96e7-8c684c81246d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:31.354040 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399209bd-130a-4ae6-b41b-6604ab2eeb73 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:31.355705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-399209bd-130a-4ae6-b41b-6604ab2eeb73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:31.362953 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923f755-63cb-45d2-96e7-8c684c81246d None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:31.368803 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb615e-3b71-49b5-b76d-93923efbc9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:31.369558 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb615e-3b71-49b5-b76d-93923efbc9cc admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:31.369835 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb615e-3b71-49b5-b76d-93923efbc9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:31.370113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb615e-3b71-49b5-b76d-93923efbc9cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:31.370837 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb615e-3b71-49b5-b76d-93923efbc9cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:31.372511 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb615e-3b71-49b5-b76d-93923efbc9cc admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:31.382910 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1280/2562] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:15:31.386964 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb615e-3b71-49b5-b76d-93923efbc9cc admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:31.396780 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb615e-3b71-49b5-b76d-93923efbc9cc admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:31.401521 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a259e28-6743-4b22-96ac-5c27a73f0184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:31.402170 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a259e28-6743-4b22-96ac-5c27a73f0184 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:31.402447 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a259e28-6743-4b22-96ac-5c27a73f0184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:31.402716 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a259e28-6743-4b22-96ac-5c27a73f0184 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:31.403420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a259e28-6743-4b22-96ac-5c27a73f0184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:31.404972 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a259e28-6743-4b22-96ac-5c27a73f0184 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:31.412989 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399209bd-130a-4ae6-b41b-6604ab2eeb73 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:31.414982 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1281/2563] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 19:15:31.417044 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a2651-75df-4cce-b879-6879e44e54a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:31.417835 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a2651-75df-4cce-b879-6879e44e54a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:31.418119 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a2651-75df-4cce-b879-6879e44e54a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:31.418387 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a2651-75df-4cce-b879-6879e44e54a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:31.418950 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a259e28-6743-4b22-96ac-5c27a73f0184 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:31.427558 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a2651-75df-4cce-b879-6879e44e54a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:31.428224 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a259e28-6743-4b22-96ac-5c27a73f0184 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:31.428995 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a2651-75df-4cce-b879-6879e44e54a6 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:31.432779 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7d1b9-bf46-4a02-be8e-d55d911b538f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:31.433914 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7d1b9-bf46-4a02-be8e-d55d911b538f admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:31.434198 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7d1b9-bf46-4a02-be8e-d55d911b538f admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:31.434471 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7d1b9-bf46-4a02-be8e-d55d911b538f admin admin] PATH_INFO: `/v3/projects/810fb2b0799c44f7852343ea55d05185/users/63a8da607f004dab9f9c5f299c4fb562/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:31.438368 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1283/2564] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:15:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:15:31.448881 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb7d1b9-bf46-4a02-be8e-d55d911b538f admin admin] RBAC: Authorizing `identity:create_grant(project_id=810fb2b0799c44f7852343ea55d05185, user_id=63a8da607f004dab9f9c5f299c4fb562, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:31.451589 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb7d1b9-bf46-4a02-be8e-d55d911b538f admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:31.465954 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1282/2565] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:15:31 2022] PUT /identity/v3/projects/810fb2b0799c44f7852343ea55d05185/users/63a8da607f004dab9f9c5f299c4fb562/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:15:31.476688 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285566f-db85-412b-88c1-7ae44f96d41f None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:31.476977 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285566f-db85-412b-88c1-7ae44f96d41f None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:31.477277 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285566f-db85-412b-88c1-7ae44f96d41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:31.505037 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-0285566f-db85-412b-88c1-7ae44f96d41f None None] MFA Rules not processed for user `63a8da607f004dab9f9c5f299c4fb562`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:31.506301 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-0285566f-db85-412b-88c1-7ae44f96d41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:31.574831 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1284/2566] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:31 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:31.579795 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7d1b9-bf46-4a02-be8e-d55d911b538f admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:31.650184 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7d1b9-bf46-4a02-be8e-d55d911b538f admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:31.654968 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422106a5-f38e-445d-9a3e-cf489aec120c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:31.655685 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422106a5-f38e-445d-9a3e-cf489aec120c admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:31.655966 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422106a5-f38e-445d-9a3e-cf489aec120c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:31.656238 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422106a5-f38e-445d-9a3e-cf489aec120c admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:31.656956 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422106a5-f38e-445d-9a3e-cf489aec120c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:31.658939 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422106a5-f38e-445d-9a3e-cf489aec120c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:31.688324 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1283/2567] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:15:31 2022] POST /identity/v3/projects => generated 401 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:15:31.692474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285566f-db85-412b-88c1-7ae44f96d41f None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:31.712145 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285566f-db85-412b-88c1-7ae44f96d41f None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:31.734990 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422106a5-f38e-445d-9a3e-cf489aec120c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:31.736785 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-422106a5-f38e-445d-9a3e-cf489aec120c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:31.797003 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276bb19-9340-4732-846a-0bd7fd4d69ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:31.797774 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276bb19-9340-4732-846a-0bd7fd4d69ed admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:31.798077 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276bb19-9340-4732-846a-0bd7fd4d69ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:31.798367 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276bb19-9340-4732-846a-0bd7fd4d69ed admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:31.800976 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276bb19-9340-4732-846a-0bd7fd4d69ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:31.803279 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276bb19-9340-4732-846a-0bd7fd4d69ed admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:31.812276 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422106a5-f38e-445d-9a3e-cf489aec120c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:31.817987 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2575db-3b24-445e-8b91-de1207be6f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:31.818890 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2575db-3b24-445e-8b91-de1207be6f10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:31.819177 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2575db-3b24-445e-8b91-de1207be6f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:31.819463 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2575db-3b24-445e-8b91-de1207be6f10 admin admin] PATH_INFO: `/v3/projects/fdfde41b98ec442882196ab8ee751428` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:31.821071 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2575db-3b24-445e-8b91-de1207be6f10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdfde41b98ec442882196ab8ee751428)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:31.823036 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2575db-3b24-445e-8b91-de1207be6f10 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:31.825459 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1285/2568] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:15:31 2022] POST /identity/v3/users => generated 307 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:15:31.829487 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276bb19-9340-4732-846a-0bd7fd4d69ed admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:31.840279 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276bb19-9340-4732-846a-0bd7fd4d69ed admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:31.844980 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e312e-c3c6-496f-a25a-3518a88a9a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:31.845773 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e312e-c3c6-496f-a25a-3518a88a9a03 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:31.845994 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e312e-c3c6-496f-a25a-3518a88a9a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:31.846173 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e312e-c3c6-496f-a25a-3518a88a9a03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:31.846905 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e312e-c3c6-496f-a25a-3518a88a9a03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:31.848810 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e312e-c3c6-496f-a25a-3518a88a9a03 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:31.860458 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1286/2569] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 19:15:31.865385 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e312e-c3c6-496f-a25a-3518a88a9a03 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:31.875167 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5f2575db-3b24-445e-8b91-de1207be6f10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdfde41b98ec442882196ab8ee751428', 'request_id': 'req-5f2575db-3b24-445e-8b91-de1207be6f10'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:31.876053 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e312e-c3c6-496f-a25a-3518a88a9a03 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:31.883883 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5f2575db-3b24-445e-8b91-de1207be6f10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdfde41b98ec442882196ab8ee751428', 'request_id': 'req-5f2575db-3b24-445e-8b91-de1207be6f10'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:31.891827 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5f2575db-3b24-445e-8b91-de1207be6f10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdfde41b98ec442882196ab8ee751428', 'request_id': 'req-5f2575db-3b24-445e-8b91-de1207be6f10'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:31.912083 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5f2575db-3b24-445e-8b91-de1207be6f10 admin admin] The token cache is being invalidate because project fdfde41b98ec442882196ab8ee751428 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:15:31.912537 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5f2575db-3b24-445e-8b91-de1207be6f10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:31.913294 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5f2575db-3b24-445e-8b91-de1207be6f10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:31.915258 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1284/2570] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:15:31 2022] DELETE /identity/v3/projects/fdfde41b98ec442882196ab8ee751428 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:15:31.920283 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f300c6c-794d-4e5a-9f55-f89df753ef02 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:31.920681 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f300c6c-794d-4e5a-9f55-f89df753ef02 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:31.921036 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f300c6c-794d-4e5a-9f55-f89df753ef02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:31.940265 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-6f300c6c-794d-4e5a-9f55-f89df753ef02 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:31.941467 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6f300c6c-794d-4e5a-9f55-f89df753ef02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:31.948706 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad372972-2041-4ca3-90c5-ee51d1bb4509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:31.949717 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad372972-2041-4ca3-90c5-ee51d1bb4509 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:31.950069 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad372972-2041-4ca3-90c5-ee51d1bb4509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:31.950437 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad372972-2041-4ca3-90c5-ee51d1bb4509 admin admin] PATH_INFO: `/v3/projects/1aef62bfb7b44c6380ac5bbd50f57aea/users/91251b2174b148a2be6a006583831fb0/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:31.972511 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad372972-2041-4ca3-90c5-ee51d1bb4509 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aef62bfb7b44c6380ac5bbd50f57aea, user_id=91251b2174b148a2be6a006583831fb0, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:31.975283 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad372972-2041-4ca3-90c5-ee51d1bb4509 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:31.990630 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1287/2571] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:15:31 2022] PUT /identity/v3/projects/1aef62bfb7b44c6380ac5bbd50f57aea/users/91251b2174b148a2be6a006583831fb0/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:15:31.994669 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad372972-2041-4ca3-90c5-ee51d1bb4509 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:31.996702 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-ad372972-2041-4ca3-90c5-ee51d1bb4509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:32.007029 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1285/2572] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:32.016008 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124fd72-fbbb-4f06-b5a5-53d1a9553704 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:32.016664 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124fd72-fbbb-4f06-b5a5-53d1a9553704 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:32.016987 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124fd72-fbbb-4f06-b5a5-53d1a9553704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:32.036904 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-a124fd72-fbbb-4f06-b5a5-53d1a9553704 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:32.038150 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a124fd72-fbbb-4f06-b5a5-53d1a9553704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:32.063723 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad372972-2041-4ca3-90c5-ee51d1bb4509 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:32.070332 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10877a2b-31a0-4eca-a92e-20317ee447c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:32.071605 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10877a2b-31a0-4eca-a92e-20317ee447c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:32.071851 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10877a2b-31a0-4eca-a92e-20317ee447c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:32.072130 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10877a2b-31a0-4eca-a92e-20317ee447c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:32.072976 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10877a2b-31a0-4eca-a92e-20317ee447c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:32.074849 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10877a2b-31a0-4eca-a92e-20317ee447c8 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:32.087384 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1288/2573] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:15:32.091395 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10877a2b-31a0-4eca-a92e-20317ee447c8 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:32.101143 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10877a2b-31a0-4eca-a92e-20317ee447c8 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:32.101510 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1286/2574] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:32.105561 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a124fd72-fbbb-4f06-b5a5-53d1a9553704 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:32.108853 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb37a2-3527-4fac-802e-be396a0f018c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:32.109757 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb37a2-3527-4fac-802e-be396a0f018c admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:32.110074 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb37a2-3527-4fac-802e-be396a0f018c admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:32.110337 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb37a2-3527-4fac-802e-be396a0f018c admin admin] PATH_INFO: `/v3/projects/1aef62bfb7b44c6380ac5bbd50f57aea/users/91251b2174b148a2be6a006583831fb0/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:32.112247 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb37a2-3527-4fac-802e-be396a0f018c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aef62bfb7b44c6380ac5bbd50f57aea, user_id=91251b2174b148a2be6a006583831fb0, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:32.114020 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a124fd72-fbbb-4f06-b5a5-53d1a9553704 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:32.115035 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb37a2-3527-4fac-802e-be396a0f018c admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:32.119124 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3479e28-673f-4a7b-aa21-a05810897d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:32.119788 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3479e28-673f-4a7b-aa21-a05810897d2a admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:32.120070 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3479e28-673f-4a7b-aa21-a05810897d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:32.120350 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3479e28-673f-4a7b-aa21-a05810897d2a admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:32.121084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3479e28-673f-4a7b-aa21-a05810897d2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:15:32.121391 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3479e28-673f-4a7b-aa21-a05810897d2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:32.123032 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3479e28-673f-4a7b-aa21-a05810897d2a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:32.126382 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1289/2575] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:15:32 2022] PUT /identity/v3/projects/1aef62bfb7b44c6380ac5bbd50f57aea/users/91251b2174b148a2be6a006583831fb0/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:32.135319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1287/2576] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 19:15:32.136535 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f64dd-39a2-4ab6-9422-8c299d27ef34 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:32.136837 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f64dd-39a2-4ab6-9422-8c299d27ef34 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:32.137109 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f64dd-39a2-4ab6-9422-8c299d27ef34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:32.139898 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3479e28-673f-4a7b-aa21-a05810897d2a admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:32.150661 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3479e28-673f-4a7b-aa21-a05810897d2a admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:32.165556 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-6c7f64dd-39a2-4ab6-9422-8c299d27ef34 None None] MFA Rules not processed for user `91251b2174b148a2be6a006583831fb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:32.166840 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-6c7f64dd-39a2-4ab6-9422-8c299d27ef34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:32.206766 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9971e5e-0552-4810-ac53-7aea72745310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:32.207432 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9971e5e-0552-4810-ac53-7aea72745310 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:32.207709 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9971e5e-0552-4810-ac53-7aea72745310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:32.207979 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9971e5e-0552-4810-ac53-7aea72745310 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:32.208665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9971e5e-0552-4810-ac53-7aea72745310 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:32.210632 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9971e5e-0552-4810-ac53-7aea72745310 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:32.235194 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1290/2577] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:32 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:15:32.238000 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1288/2578] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:15:32 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:15:32.241752 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f64dd-39a2-4ab6-9422-8c299d27ef34 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:32.246713 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9971e5e-0552-4810-ac53-7aea72745310 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:32.248328 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e9971e5e-0552-4810-ac53-7aea72745310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:32.252564 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f64dd-39a2-4ab6-9422-8c299d27ef34 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:32.304434 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9971e5e-0552-4810-ac53-7aea72745310 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:32.308009 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08903ca6-05aa-4bf0-aa75-b17e0d6e8b5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:32.308397 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869b337-e907-4418-9da9-880908b06f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:32.308658 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08903ca6-05aa-4bf0-aa75-b17e0d6e8b5b service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:32.308937 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08903ca6-05aa-4bf0-aa75-b17e0d6e8b5b service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:32.309079 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869b337-e907-4418-9da9-880908b06f24 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:32.309191 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08903ca6-05aa-4bf0-aa75-b17e0d6e8b5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:32.309381 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869b337-e907-4418-9da9-880908b06f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:32.309690 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869b337-e907-4418-9da9-880908b06f24 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:32.310400 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869b337-e907-4418-9da9-880908b06f24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:32.312406 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869b337-e907-4418-9da9-880908b06f24 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:32.332444 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1291/2579] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:15:32 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:15:32.336594 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869b337-e907-4418-9da9-880908b06f24 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:32.346388 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869b337-e907-4418-9da9-880908b06f24 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:32.351648 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56fede-6d70-4d8e-8e6f-da152f896ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:32.352240 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56fede-6d70-4d8e-8e6f-da152f896ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:32.352524 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56fede-6d70-4d8e-8e6f-da152f896ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:32.352797 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56fede-6d70-4d8e-8e6f-da152f896ea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:32.353524 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56fede-6d70-4d8e-8e6f-da152f896ea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:32.355322 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56fede-6d70-4d8e-8e6f-da152f896ea7 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:32.365653 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1292/2580] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 19:15:32.368493 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08903ca6-05aa-4bf0-aa75-b17e0d6e8b5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:32.369385 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56fede-6d70-4d8e-8e6f-da152f896ea7 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:32.370012 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08903ca6-05aa-4bf0-aa75-b17e0d6e8b5b service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:32.378757 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56fede-6d70-4d8e-8e6f-da152f896ea7 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:32.379848 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1289/2581] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:15:32 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 19:15:32.383444 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2a7bf-bfa6-4990-aa38-55f851fe7e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:32.384093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2a7bf-bfa6-4990-aa38-55f851fe7e41 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:32.384374 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2a7bf-bfa6-4990-aa38-55f851fe7e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:32.384648 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2a7bf-bfa6-4990-aa38-55f851fe7e41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:32.385398 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b2a7bf-bfa6-4990-aa38-55f851fe7e41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:32.387032 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b2a7bf-bfa6-4990-aa38-55f851fe7e41 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:32.397784 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1293/2582] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:15:32.402265 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08903ca6-05aa-4bf0-aa75-b17e0d6e8b5b service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:32.413106 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08903ca6-05aa-4bf0-aa75-b17e0d6e8b5b service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:32.418293 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd4daa-1ba0-4f3f-9c47-02fde84578bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:32.419217 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd4daa-1ba0-4f3f-9c47-02fde84578bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:32.419520 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd4daa-1ba0-4f3f-9c47-02fde84578bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:32.419777 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd4daa-1ba0-4f3f-9c47-02fde84578bb admin admin] PATH_INFO: `/v3/projects/41bfdcca0558467386d190f246d7f34f/users/1006dbb4a840402985756270c6c2c491/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:32.434793 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd4daa-1ba0-4f3f-9c47-02fde84578bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=41bfdcca0558467386d190f246d7f34f, user_id=1006dbb4a840402985756270c6c2c491, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:32.437706 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd4daa-1ba0-4f3f-9c47-02fde84578bb admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:32.450510 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1290/2583] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:15:32 2022] PUT /identity/v3/projects/41bfdcca0558467386d190f246d7f34f/users/1006dbb4a840402985756270c6c2c491/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:32.460203 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2a7bf-bfa6-4990-aa38-55f851fe7e41 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:32.460849 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3e311-b7d2-4981-bae8-309158051f0a None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:32.461208 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3e311-b7d2-4981-bae8-309158051f0a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:32.461573 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3e311-b7d2-4981-bae8-309158051f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:32.471018 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2a7bf-bfa6-4990-aa38-55f851fe7e41 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:32.487933 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-00b3e311-b7d2-4981-bae8-309158051f0a None None] MFA Rules not processed for user `1006dbb4a840402985756270c6c2c491`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:32.489147 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-00b3e311-b7d2-4981-bae8-309158051f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:32.521319 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5c7bd-e769-49c2-ba98-2f9f35450a9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:32.522011 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5c7bd-e769-49c2-ba98-2f9f35450a9d service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:32.522292 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5c7bd-e769-49c2-ba98-2f9f35450a9d service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:32.522566 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5c7bd-e769-49c2-ba98-2f9f35450a9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:32.524484 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-5da5c7bd-e769-49c2-ba98-2f9f35450a9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:32.551996 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1291/2584] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:32.556638 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3e311-b7d2-4981-bae8-309158051f0a None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:32.580292 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da5c7bd-e769-49c2-ba98-2f9f35450a9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:32.581801 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da5c7bd-e769-49c2-ba98-2f9f35450a9d service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:32.590511 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1294/2585] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:15:32 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:15:32.615843 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3e311-b7d2-4981-bae8-309158051f0a None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:32.620590 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59afe719-3b88-4db8-8ccc-de12c5ea8902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:32.621257 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afe719-3b88-4db8-8ccc-de12c5ea8902 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:32.621567 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afe719-3b88-4db8-8ccc-de12c5ea8902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:32.621838 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afe719-3b88-4db8-8ccc-de12c5ea8902 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:32.624423 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59afe719-3b88-4db8-8ccc-de12c5ea8902 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:32.629007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59afe719-3b88-4db8-8ccc-de12c5ea8902 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:32.657847 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1292/2586] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:15:32 2022] POST /identity/v3/projects => generated 369 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:15:32.659077 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5c7bd-e769-49c2-ba98-2f9f35450a9d service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:32.670262 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5c7bd-e769-49c2-ba98-2f9f35450a9d service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:32.727389 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c392d-6075-4272-91cc-fe86df8c4c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:32.728281 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c392d-6075-4272-91cc-fe86df8c4c43 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:32.728575 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c392d-6075-4272-91cc-fe86df8c4c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:32.728877 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c392d-6075-4272-91cc-fe86df8c4c43 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:32.729667 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c392d-6075-4272-91cc-fe86df8c4c43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:32.731910 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c392d-6075-4272-91cc-fe86df8c4c43 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:32.752212 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1295/2587] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:15:32 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:15:32.756332 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59afe719-3b88-4db8-8ccc-de12c5ea8902 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:32.767519 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59afe719-3b88-4db8-8ccc-de12c5ea8902 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:32.772405 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b948432-1338-4d30-9028-298fa0940878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:32.772915 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b948432-1338-4d30-9028-298fa0940878 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:32.773226 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b948432-1338-4d30-9028-298fa0940878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:32.773500 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b948432-1338-4d30-9028-298fa0940878 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:32.774258 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b948432-1338-4d30-9028-298fa0940878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:32.775860 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b948432-1338-4d30-9028-298fa0940878 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:32.786924 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1293/2588] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:15:32.791339 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c392d-6075-4272-91cc-fe86df8c4c43 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:32.801776 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c392d-6075-4272-91cc-fe86df8c4c43 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:32.806860 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f103f3-690d-49e1-b6ac-dd403366eeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:32.807828 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f103f3-690d-49e1-b6ac-dd403366eeaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:32.808203 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f103f3-690d-49e1-b6ac-dd403366eeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:32.808471 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f103f3-690d-49e1-b6ac-dd403366eeaa admin admin] PATH_INFO: `/v3/projects/aef6e12a665445238ed819bbff13e3e5/users/3215746462984920badf4786d0eff414/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:32.827761 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f103f3-690d-49e1-b6ac-dd403366eeaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=aef6e12a665445238ed819bbff13e3e5, user_id=3215746462984920badf4786d0eff414, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:32.830399 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f103f3-690d-49e1-b6ac-dd403366eeaa admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:32.845271 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1296/2589] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:15:32 2022] PUT /identity/v3/projects/aef6e12a665445238ed819bbff13e3e5/users/3215746462984920badf4786d0eff414/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:32.850108 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b948432-1338-4d30-9028-298fa0940878 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:32.860383 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b948432-1338-4d30-9028-298fa0940878 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:32.919867 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540dbca0-ec4f-4370-9689-2d35bdff155a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:32.920754 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dbca0-ec4f-4370-9689-2d35bdff155a admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:32.921037 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dbca0-ec4f-4370-9689-2d35bdff155a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:32.921335 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dbca0-ec4f-4370-9689-2d35bdff155a admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:32.922104 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540dbca0-ec4f-4370-9689-2d35bdff155a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:32.923709 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540dbca0-ec4f-4370-9689-2d35bdff155a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:32.933838 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1294/2590] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:15:32.938238 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f103f3-690d-49e1-b6ac-dd403366eeaa admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:32.948386 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f103f3-690d-49e1-b6ac-dd403366eeaa admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:32.953117 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889445e-a3d4-4d61-82e0-33d68ff32c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:32.954036 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889445e-a3d4-4d61-82e0-33d68ff32c62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:32.954319 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889445e-a3d4-4d61-82e0-33d68ff32c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:32.954579 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889445e-a3d4-4d61-82e0-33d68ff32c62 admin admin] PATH_INFO: `/v3/projects/aef6e12a665445238ed819bbff13e3e5/users/3215746462984920badf4786d0eff414/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:32.956522 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b889445e-a3d4-4d61-82e0-33d68ff32c62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aef6e12a665445238ed819bbff13e3e5, user_id=3215746462984920badf4786d0eff414, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:32.959225 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b889445e-a3d4-4d61-82e0-33d68ff32c62 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:32.969991 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1297/2591] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:15:32 2022] PUT /identity/v3/projects/aef6e12a665445238ed819bbff13e3e5/users/3215746462984920badf4786d0eff414/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:15:32.980294 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60cad3e-bae6-49ca-970b-8a17aff1de16 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:32.980657 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60cad3e-bae6-49ca-970b-8a17aff1de16 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:32.980966 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60cad3e-bae6-49ca-970b-8a17aff1de16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:33.008747 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-e60cad3e-bae6-49ca-970b-8a17aff1de16 None None] MFA Rules not processed for user `3215746462984920badf4786d0eff414`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:33.009952 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e60cad3e-bae6-49ca-970b-8a17aff1de16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:33.083144 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1295/2592] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:32 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:33.091389 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889445e-a3d4-4d61-82e0-33d68ff32c62 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:33.154068 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889445e-a3d4-4d61-82e0-33d68ff32c62 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:33.158018 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ee9eb-e545-4b5b-947a-747673028f9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:33.158674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ee9eb-e545-4b5b-947a-747673028f9a service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:33.158958 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ee9eb-e545-4b5b-947a-747673028f9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:33.159234 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ee9eb-e545-4b5b-947a-747673028f9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:33.170069 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ee9eb-e545-4b5b-947a-747673028f9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:33.171589 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ee9eb-e545-4b5b-947a-747673028f9a service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:33.183769 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1298/2593] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:15:33 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:15:33.556870 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60cad3e-bae6-49ca-970b-8a17aff1de16 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:33.619697 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60cad3e-bae6-49ca-970b-8a17aff1de16 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:33.624736 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5f642-8b2f-4454-9b09-6e648d6f9f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:33.625646 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5f642-8b2f-4454-9b09-6e648d6f9f53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:33.625927 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5f642-8b2f-4454-9b09-6e648d6f9f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:33.626199 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5f642-8b2f-4454-9b09-6e648d6f9f53 admin admin] PATH_INFO: `/v3/users/1006dbb4a840402985756270c6c2c491` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:33.627391 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5f642-8b2f-4454-9b09-6e648d6f9f53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1006dbb4a840402985756270c6c2c491)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:33.632982 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5f642-8b2f-4454-9b09-6e648d6f9f53 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:33.685905 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6df5f642-8b2f-4454-9b09-6e648d6f9f53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1006dbb4a840402985756270c6c2c491'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:33.692938 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6df5f642-8b2f-4454-9b09-6e648d6f9f53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1006dbb4a840402985756270c6c2c491'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:33.702578 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6df5f642-8b2f-4454-9b09-6e648d6f9f53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1006dbb4a840402985756270c6c2c491'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:33.714801 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6df5f642-8b2f-4454-9b09-6e648d6f9f53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1006dbb4a840402985756270c6c2c491'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:33.715507 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6df5f642-8b2f-4454-9b09-6e648d6f9f53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1006dbb4a840402985756270c6c2c491'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:33.721421 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1296/2594] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:15:33 2022] DELETE /identity/v3/users/1006dbb4a840402985756270c6c2c491 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:33.726196 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f1671-1268-4511-a65b-daf5909c1766 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:33.726469 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f1671-1268-4511-a65b-daf5909c1766 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:33.726756 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f1671-1268-4511-a65b-daf5909c1766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:33.744450 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-bd5f1671-1268-4511-a65b-daf5909c1766 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:33.745672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-bd5f1671-1268-4511-a65b-daf5909c1766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:33.811485 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1299/2595] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:33.821324 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5f642-8b2f-4454-9b09-6e648d6f9f53 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:33.822822 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6df5f642-8b2f-4454-9b09-6e648d6f9f53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:33.878918 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5f642-8b2f-4454-9b09-6e648d6f9f53 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:33.882879 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9fb92-c236-4ca9-957e-f1a991531378 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:33.883536 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9fb92-c236-4ca9-957e-f1a991531378 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:33.883815 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9fb92-c236-4ca9-957e-f1a991531378 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:33.884097 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9fb92-c236-4ca9-957e-f1a991531378 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:33.894166 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9fb92-c236-4ca9-957e-f1a991531378 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:33.895625 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9fb92-c236-4ca9-957e-f1a991531378 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:33.905570 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1297/2596] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:15:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:15:34.178344 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f1671-1268-4511-a65b-daf5909c1766 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:34.180758 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-bd5f1671-1268-4511-a65b-daf5909c1766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:34.210946 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f1671-1268-4511-a65b-daf5909c1766 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:34.215911 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9802e62-5423-4ca8-a2f9-80299597e1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:34.216810 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9802e62-5423-4ca8-a2f9-80299597e1a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:34.217088 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9802e62-5423-4ca8-a2f9-80299597e1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:34.217357 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9802e62-5423-4ca8-a2f9-80299597e1a8 admin admin] PATH_INFO: `/v3/projects/41bfdcca0558467386d190f246d7f34f` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:34.218790 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9802e62-5423-4ca8-a2f9-80299597e1a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41bfdcca0558467386d190f246d7f34f)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:34.220740 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9802e62-5423-4ca8-a2f9-80299597e1a8 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:34.269199 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e9802e62-5423-4ca8-a2f9-80299597e1a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41bfdcca0558467386d190f246d7f34f', 'request_id': 'req-e9802e62-5423-4ca8-a2f9-80299597e1a8'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:34.275229 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e9802e62-5423-4ca8-a2f9-80299597e1a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41bfdcca0558467386d190f246d7f34f', 'request_id': 'req-e9802e62-5423-4ca8-a2f9-80299597e1a8'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:34.282870 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e9802e62-5423-4ca8-a2f9-80299597e1a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41bfdcca0558467386d190f246d7f34f', 'request_id': 'req-e9802e62-5423-4ca8-a2f9-80299597e1a8'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:34.295596 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e9802e62-5423-4ca8-a2f9-80299597e1a8 admin admin] The token cache is being invalidate because project 41bfdcca0558467386d190f246d7f34f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:15:34.295880 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e9802e62-5423-4ca8-a2f9-80299597e1a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:34.296503 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e9802e62-5423-4ca8-a2f9-80299597e1a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:34.298128 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1300/2597] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:15:34 2022] DELETE /identity/v3/projects/41bfdcca0558467386d190f246d7f34f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:34.302193 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9fb92-c236-4ca9-957e-f1a991531378 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:34.311968 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9fb92-c236-4ca9-957e-f1a991531378 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:34.379035 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff71e3-21c9-4094-b146-4ae7c32990f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:34.379915 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff71e3-21c9-4094-b146-4ae7c32990f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:34.380200 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff71e3-21c9-4094-b146-4ae7c32990f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:34.380459 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff71e3-21c9-4094-b146-4ae7c32990f9 admin admin] PATH_INFO: `/v3/users/3215746462984920badf4786d0eff414` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:34.381914 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff71e3-21c9-4094-b146-4ae7c32990f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3215746462984920badf4786d0eff414)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:34.384059 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff71e3-21c9-4094-b146-4ae7c32990f9 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:34.432771 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-41ff71e3-21c9-4094-b146-4ae7c32990f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3215746462984920badf4786d0eff414'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:34.440336 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-41ff71e3-21c9-4094-b146-4ae7c32990f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3215746462984920badf4786d0eff414'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:34.448758 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-41ff71e3-21c9-4094-b146-4ae7c32990f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3215746462984920badf4786d0eff414'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:34.460899 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-41ff71e3-21c9-4094-b146-4ae7c32990f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3215746462984920badf4786d0eff414'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:34.461581 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-41ff71e3-21c9-4094-b146-4ae7c32990f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3215746462984920badf4786d0eff414'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:34.467911 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1298/2598] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:15:34 2022] DELETE /identity/v3/users/3215746462984920badf4786d0eff414 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:34.740348 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9802e62-5423-4ca8-a2f9-80299597e1a8 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:34.742042 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-e9802e62-5423-4ca8-a2f9-80299597e1a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:34.757228 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9802e62-5423-4ca8-a2f9-80299597e1a8 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:34.817478 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a030f-2836-42ea-8cef-7ca898962681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:34.818387 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a030f-2836-42ea-8cef-7ca898962681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:34.818668 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a030f-2836-42ea-8cef-7ca898962681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:34.818936 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a030f-2836-42ea-8cef-7ca898962681 admin admin] PATH_INFO: `/v3/projects/aef6e12a665445238ed819bbff13e3e5` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:34.820158 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a030f-2836-42ea-8cef-7ca898962681 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aef6e12a665445238ed819bbff13e3e5)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:34.822146 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a030f-2836-42ea-8cef-7ca898962681 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:34.872074 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-487a030f-2836-42ea-8cef-7ca898962681 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aef6e12a665445238ed819bbff13e3e5', 'request_id': 'req-487a030f-2836-42ea-8cef-7ca898962681'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:34.877939 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-487a030f-2836-42ea-8cef-7ca898962681 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aef6e12a665445238ed819bbff13e3e5', 'request_id': 'req-487a030f-2836-42ea-8cef-7ca898962681'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:34.884679 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-487a030f-2836-42ea-8cef-7ca898962681 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aef6e12a665445238ed819bbff13e3e5', 'request_id': 'req-487a030f-2836-42ea-8cef-7ca898962681'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:34.902293 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-487a030f-2836-42ea-8cef-7ca898962681 admin admin] The token cache is being invalidate because project aef6e12a665445238ed819bbff13e3e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:15:34.902663 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-487a030f-2836-42ea-8cef-7ca898962681 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:34.903647 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-487a030f-2836-42ea-8cef-7ca898962681 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:34.906091 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1301/2599] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:15:34 2022] DELETE /identity/v3/projects/aef6e12a665445238ed819bbff13e3e5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:34.911063 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa311d37-382c-4827-9af6-ef8af9d9724d None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:34.911355 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa311d37-382c-4827-9af6-ef8af9d9724d None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:34.911633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa311d37-382c-4827-9af6-ef8af9d9724d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:34.929599 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-fa311d37-382c-4827-9af6-ef8af9d9724d None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:34.930805 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-fa311d37-382c-4827-9af6-ef8af9d9724d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:34.992848 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1299/2600] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:35.004789 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd916d-63a5-4ddc-9f48-681ceead3799 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:35.005075 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd916d-63a5-4ddc-9f48-681ceead3799 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:35.005344 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd916d-63a5-4ddc-9f48-681ceead3799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:35.025265 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-04cd916d-63a5-4ddc-9f48-681ceead3799 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:35.026503 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-04cd916d-63a5-4ddc-9f48-681ceead3799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:35.036167 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1302/2601] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:35.040527 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa311d37-382c-4827-9af6-ef8af9d9724d None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:35.050827 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa311d37-382c-4827-9af6-ef8af9d9724d None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:35.056747 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f9e4a-88b5-48ca-9ff9-fce6d59179d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:35.057423 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f9e4a-88b5-48ca-9ff9-fce6d59179d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:35.057718 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f9e4a-88b5-48ca-9ff9-fce6d59179d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:35.057991 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f9e4a-88b5-48ca-9ff9-fce6d59179d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:35.058724 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f9e4a-88b5-48ca-9ff9-fce6d59179d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:15:35.059032 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f9e4a-88b5-48ca-9ff9-fce6d59179d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:35.060649 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f9e4a-88b5-48ca-9ff9-fce6d59179d9 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:35.072829 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1300/2602] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:15:35.077016 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd916d-63a5-4ddc-9f48-681ceead3799 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:35.086473 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd916d-63a5-4ddc-9f48-681ceead3799 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:35.092501 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed6174-17c1-41fe-aa39-7af8292a9d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:35.093145 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed6174-17c1-41fe-aa39-7af8292a9d44 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:35.093375 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed6174-17c1-41fe-aa39-7af8292a9d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:35.093702 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed6174-17c1-41fe-aa39-7af8292a9d44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:35.094384 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed6174-17c1-41fe-aa39-7af8292a9d44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:35.096353 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed6174-17c1-41fe-aa39-7af8292a9d44 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:35.125428 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1303/2603] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:15:35 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:15:35.129691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f9e4a-88b5-48ca-9ff9-fce6d59179d9 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:35.140074 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f9e4a-88b5-48ca-9ff9-fce6d59179d9 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:35.206681 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583f3a8-fee2-4e07-bb54-b8c8b58bc746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:35.207365 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583f3a8-fee2-4e07-bb54-b8c8b58bc746 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:35.207636 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583f3a8-fee2-4e07-bb54-b8c8b58bc746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:35.207928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583f3a8-fee2-4e07-bb54-b8c8b58bc746 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:35.208670 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583f3a8-fee2-4e07-bb54-b8c8b58bc746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:35.210629 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583f3a8-fee2-4e07-bb54-b8c8b58bc746 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:35.234864 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1301/2604] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:15:35 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:15:35.238898 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed6174-17c1-41fe-aa39-7af8292a9d44 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:35.250616 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed6174-17c1-41fe-aa39-7af8292a9d44 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:35.255438 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594e18c-827c-450c-bb1c-fbc202734f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:35.256122 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594e18c-827c-450c-bb1c-fbc202734f1a admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:35.256363 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594e18c-827c-450c-bb1c-fbc202734f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:35.256630 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594e18c-827c-450c-bb1c-fbc202734f1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:35.257671 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7594e18c-827c-450c-bb1c-fbc202734f1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:35.259270 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7594e18c-827c-450c-bb1c-fbc202734f1a admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:35.270411 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1304/2605] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:15:35.274570 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583f3a8-fee2-4e07-bb54-b8c8b58bc746 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:35.284932 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583f3a8-fee2-4e07-bb54-b8c8b58bc746 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:35.289982 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12991d7-5b9e-4a45-bdea-5e266d8642c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:35.290925 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12991d7-5b9e-4a45-bdea-5e266d8642c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:35.291257 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12991d7-5b9e-4a45-bdea-5e266d8642c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:35.291536 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12991d7-5b9e-4a45-bdea-5e266d8642c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:35.292280 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12991d7-5b9e-4a45-bdea-5e266d8642c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:35.293976 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12991d7-5b9e-4a45-bdea-5e266d8642c2 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:35.306130 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1302/2606] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:15:35.310347 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594e18c-827c-450c-bb1c-fbc202734f1a admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:35.320595 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594e18c-827c-450c-bb1c-fbc202734f1a admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:35.325054 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b585ee-c3e6-4366-978f-64e250e2458c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:35.325964 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b585ee-c3e6-4366-978f-64e250e2458c admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:35.326244 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b585ee-c3e6-4366-978f-64e250e2458c admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:35.326524 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b585ee-c3e6-4366-978f-64e250e2458c admin admin] PATH_INFO: `/v3/projects/ca33bc9819cb418a92eaecff48bbc85c/users/13fbfba614bd4779a64616f55671fff2/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:35.340477 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b585ee-c3e6-4366-978f-64e250e2458c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca33bc9819cb418a92eaecff48bbc85c, user_id=13fbfba614bd4779a64616f55671fff2, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:35.343169 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b585ee-c3e6-4366-978f-64e250e2458c admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:35.366088 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1305/2607] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:15:35 2022] PUT /identity/v3/projects/ca33bc9819cb418a92eaecff48bbc85c/users/13fbfba614bd4779a64616f55671fff2/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:15:35.368041 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d08d7-aa49-4f22-adcc-c9c091c3c9c2 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:35.368680 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d08d7-aa49-4f22-adcc-c9c091c3c9c2 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:35.369065 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d08d7-aa49-4f22-adcc-c9c091c3c9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:35.399310 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-1b6d08d7-aa49-4f22-adcc-c9c091c3c9c2 None None] MFA Rules not processed for user `13fbfba614bd4779a64616f55671fff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:35.399934 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1b6d08d7-aa49-4f22-adcc-c9c091c3c9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:35.471433 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1303/2608] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:35.475919 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b585ee-c3e6-4366-978f-64e250e2458c admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:35.540948 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b585ee-c3e6-4366-978f-64e250e2458c admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:35.545958 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc47c6e-a426-4580-a31a-98bd52cb6be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:35.546634 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc47c6e-a426-4580-a31a-98bd52cb6be0 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:35.546917 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc47c6e-a426-4580-a31a-98bd52cb6be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:35.547191 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc47c6e-a426-4580-a31a-98bd52cb6be0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:35.547901 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc47c6e-a426-4580-a31a-98bd52cb6be0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:35.549916 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc47c6e-a426-4580-a31a-98bd52cb6be0 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:35.577661 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1306/2609] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:15:35 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:15:35.582538 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d08d7-aa49-4f22-adcc-c9c091c3c9c2 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:35.598053 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d08d7-aa49-4f22-adcc-c9c091c3c9c2 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:35.658724 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe4f10c-5ef4-4f71-adfd-3b8ed67fba8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:35.659383 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4f10c-5ef4-4f71-adfd-3b8ed67fba8b admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:35.659663 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4f10c-5ef4-4f71-adfd-3b8ed67fba8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:35.659931 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4f10c-5ef4-4f71-adfd-3b8ed67fba8b admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:35.660625 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe4f10c-5ef4-4f71-adfd-3b8ed67fba8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:35.662611 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe4f10c-5ef4-4f71-adfd-3b8ed67fba8b admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:35.685073 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1304/2610] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:15:35 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:15:35.690651 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc47c6e-a426-4580-a31a-98bd52cb6be0 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:35.700933 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc47c6e-a426-4580-a31a-98bd52cb6be0 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:35.706103 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5d132-2bab-491e-80b3-88634042c02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:35.706771 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5d132-2bab-491e-80b3-88634042c02f admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:35.707047 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5d132-2bab-491e-80b3-88634042c02f admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:35.707307 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5d132-2bab-491e-80b3-88634042c02f admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:35.708068 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d5d132-2bab-491e-80b3-88634042c02f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:35.709799 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d5d132-2bab-491e-80b3-88634042c02f admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:35.720392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1307/2611] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:15:35.724434 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe4f10c-5ef4-4f71-adfd-3b8ed67fba8b admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:35.734238 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe4f10c-5ef4-4f71-adfd-3b8ed67fba8b admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:35.739263 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d1d91-2513-44ad-90ff-04e4087c5fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:35.740127 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d1d91-2513-44ad-90ff-04e4087c5fe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:35.740397 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d1d91-2513-44ad-90ff-04e4087c5fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:35.740665 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d1d91-2513-44ad-90ff-04e4087c5fe1 admin admin] PATH_INFO: `/v3/projects/c6fa1a6c868d4495be73112663dc8bed/users/f5dc594b7b8d4d1db7536fc115c23189/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:35.755475 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99d1d91-2513-44ad-90ff-04e4087c5fe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6fa1a6c868d4495be73112663dc8bed, user_id=f5dc594b7b8d4d1db7536fc115c23189, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:35.758143 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99d1d91-2513-44ad-90ff-04e4087c5fe1 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:35.772769 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1305/2612] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:15:35 2022] PUT /identity/v3/projects/c6fa1a6c868d4495be73112663dc8bed/users/f5dc594b7b8d4d1db7536fc115c23189/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:35.776829 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5d132-2bab-491e-80b3-88634042c02f admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:35.787335 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5d132-2bab-491e-80b3-88634042c02f admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:35.847305 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b27f3b-e362-40a7-b558-cddfc1e7ba3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:35.848078 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b27f3b-e362-40a7-b558-cddfc1e7ba3b admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:35.848421 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b27f3b-e362-40a7-b558-cddfc1e7ba3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:35.848739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b27f3b-e362-40a7-b558-cddfc1e7ba3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:35.849909 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b27f3b-e362-40a7-b558-cddfc1e7ba3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:35.852453 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b27f3b-e362-40a7-b558-cddfc1e7ba3b admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:35.867693 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1308/2613] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:15:35.872550 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d1d91-2513-44ad-90ff-04e4087c5fe1 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:35.885826 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d1d91-2513-44ad-90ff-04e4087c5fe1 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:35.893113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8aa0f-02c7-409b-9738-6e1d83ca453d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:35.894358 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8aa0f-02c7-409b-9738-6e1d83ca453d admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:35.894630 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8aa0f-02c7-409b-9738-6e1d83ca453d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:35.894899 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8aa0f-02c7-409b-9738-6e1d83ca453d admin admin] PATH_INFO: `/v3/projects/c6fa1a6c868d4495be73112663dc8bed/users/f5dc594b7b8d4d1db7536fc115c23189/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:35.896955 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b8aa0f-02c7-409b-9738-6e1d83ca453d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6fa1a6c868d4495be73112663dc8bed, user_id=f5dc594b7b8d4d1db7536fc115c23189, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:35.899614 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b8aa0f-02c7-409b-9738-6e1d83ca453d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:35.911143 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1306/2614] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:15:35 2022] PUT /identity/v3/projects/c6fa1a6c868d4495be73112663dc8bed/users/f5dc594b7b8d4d1db7536fc115c23189/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:35.926340 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4fb78-17c2-4ac0-ab11-7ada59721dee None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:35.926340 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4fb78-17c2-4ac0-ab11-7ada59721dee None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:35.926340 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4fb78-17c2-4ac0-ab11-7ada59721dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:35.954214 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-9cb4fb78-17c2-4ac0-ab11-7ada59721dee None None] MFA Rules not processed for user `f5dc594b7b8d4d1db7536fc115c23189`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:35.955481 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-9cb4fb78-17c2-4ac0-ab11-7ada59721dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:36.026248 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1309/2615] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:35 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:36.037240 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8aa0f-02c7-409b-9738-6e1d83ca453d admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:36.039399 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-69b8aa0f-02c7-409b-9738-6e1d83ca453d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:36.099946 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8aa0f-02c7-409b-9738-6e1d83ca453d admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:36.104552 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb50c2-3ff9-428b-9415-7a892e7867d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:36.105268 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb50c2-3ff9-428b-9415-7a892e7867d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:36.105560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb50c2-3ff9-428b-9415-7a892e7867d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:36.105894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb50c2-3ff9-428b-9415-7a892e7867d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:36.163765 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb50c2-3ff9-428b-9415-7a892e7867d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:36.165203 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb50c2-3ff9-428b-9415-7a892e7867d4 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:36.174599 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1307/2616] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:15:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:15:36.640517 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4fb78-17c2-4ac0-ab11-7ada59721dee None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:36.642462 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-9cb4fb78-17c2-4ac0-ab11-7ada59721dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:36.707788 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4fb78-17c2-4ac0-ab11-7ada59721dee None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:36.712741 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a3183-d217-4e9a-b283-adf201669e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:36.713626 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a3183-d217-4e9a-b283-adf201669e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:36.714266 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a3183-d217-4e9a-b283-adf201669e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:36.714552 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a3183-d217-4e9a-b283-adf201669e00 admin admin] PATH_INFO: `/v3/users/63a8da607f004dab9f9c5f299c4fb562` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:36.715822 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a3183-d217-4e9a-b283-adf201669e00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63a8da607f004dab9f9c5f299c4fb562)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:36.717805 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a3183-d217-4e9a-b283-adf201669e00 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:36.766976 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e16a3183-d217-4e9a-b283-adf201669e00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63a8da607f004dab9f9c5f299c4fb562'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:36.773648 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e16a3183-d217-4e9a-b283-adf201669e00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63a8da607f004dab9f9c5f299c4fb562'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:36.780265 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e16a3183-d217-4e9a-b283-adf201669e00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63a8da607f004dab9f9c5f299c4fb562'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:36.780891 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e16a3183-d217-4e9a-b283-adf201669e00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63a8da607f004dab9f9c5f299c4fb562'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:36.792620 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e16a3183-d217-4e9a-b283-adf201669e00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63a8da607f004dab9f9c5f299c4fb562'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:36.799016 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1310/2617] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:15:36 2022] DELETE /identity/v3/users/63a8da607f004dab9f9c5f299c4fb562 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:36.804020 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4e169-09c8-4a71-8162-8b44669a3b91 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:36.804538 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4e169-09c8-4a71-8162-8b44669a3b91 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:36.804538 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4e169-09c8-4a71-8162-8b44669a3b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:36.822506 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-f9a4e169-09c8-4a71-8162-8b44669a3b91 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:36.823764 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f9a4e169-09c8-4a71-8162-8b44669a3b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:36.886735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1308/2618] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:36.898303 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a3183-d217-4e9a-b283-adf201669e00 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:36.899750 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-e16a3183-d217-4e9a-b283-adf201669e00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:36.957023 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a3183-d217-4e9a-b283-adf201669e00 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:36.962116 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059fce9-8789-409f-aaf1-7b5505a4da21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:36.962766 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059fce9-8789-409f-aaf1-7b5505a4da21 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:36.963044 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059fce9-8789-409f-aaf1-7b5505a4da21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:36.963307 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059fce9-8789-409f-aaf1-7b5505a4da21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:36.973275 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059fce9-8789-409f-aaf1-7b5505a4da21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:36.974748 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059fce9-8789-409f-aaf1-7b5505a4da21 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:36.984560 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1311/2619] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:15:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:15:37.265090 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4e169-09c8-4a71-8162-8b44669a3b91 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:37.267105 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f9a4e169-09c8-4a71-8162-8b44669a3b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:37.279894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4e169-09c8-4a71-8162-8b44669a3b91 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:37.285267 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c1b6f-5b62-4724-a210-b9cf9ac73fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:37.286326 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c1b6f-5b62-4724-a210-b9cf9ac73fd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:37.286495 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c1b6f-5b62-4724-a210-b9cf9ac73fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:37.286763 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c1b6f-5b62-4724-a210-b9cf9ac73fd3 admin admin] PATH_INFO: `/v3/projects/810fb2b0799c44f7852343ea55d05185` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:37.288096 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c1b6f-5b62-4724-a210-b9cf9ac73fd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=810fb2b0799c44f7852343ea55d05185)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:37.290101 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c1b6f-5b62-4724-a210-b9cf9ac73fd3 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:37.344274 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a01c1b6f-5b62-4724-a210-b9cf9ac73fd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '810fb2b0799c44f7852343ea55d05185', 'request_id': 'req-a01c1b6f-5b62-4724-a210-b9cf9ac73fd3'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:37.353347 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a01c1b6f-5b62-4724-a210-b9cf9ac73fd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '810fb2b0799c44f7852343ea55d05185', 'request_id': 'req-a01c1b6f-5b62-4724-a210-b9cf9ac73fd3'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:37.358948 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a01c1b6f-5b62-4724-a210-b9cf9ac73fd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '810fb2b0799c44f7852343ea55d05185', 'request_id': 'req-a01c1b6f-5b62-4724-a210-b9cf9ac73fd3'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:37.369655 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a01c1b6f-5b62-4724-a210-b9cf9ac73fd3 admin admin] The token cache is being invalidate because project 810fb2b0799c44f7852343ea55d05185 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:15:37.369941 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a01c1b6f-5b62-4724-a210-b9cf9ac73fd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:37.370602 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a01c1b6f-5b62-4724-a210-b9cf9ac73fd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:37.372400 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1309/2620] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:15:37 2022] DELETE /identity/v3/projects/810fb2b0799c44f7852343ea55d05185 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:37.376877 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059fce9-8789-409f-aaf1-7b5505a4da21 service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:37.386327 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059fce9-8789-409f-aaf1-7b5505a4da21 service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:37.454670 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853735a-cbdc-4cd0-bf6c-057241031272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:37.455576 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853735a-cbdc-4cd0-bf6c-057241031272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:37.455850 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853735a-cbdc-4cd0-bf6c-057241031272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:37.456134 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853735a-cbdc-4cd0-bf6c-057241031272 admin admin] PATH_INFO: `/v3/users/91251b2174b148a2be6a006583831fb0` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:37.457437 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853735a-cbdc-4cd0-bf6c-057241031272 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91251b2174b148a2be6a006583831fb0)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:37.459416 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853735a-cbdc-4cd0-bf6c-057241031272 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:37.508953 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-2853735a-cbdc-4cd0-bf6c-057241031272 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91251b2174b148a2be6a006583831fb0'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:37.517300 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-2853735a-cbdc-4cd0-bf6c-057241031272 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91251b2174b148a2be6a006583831fb0'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:37.525663 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-2853735a-cbdc-4cd0-bf6c-057241031272 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91251b2174b148a2be6a006583831fb0'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:37.526272 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-2853735a-cbdc-4cd0-bf6c-057241031272 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91251b2174b148a2be6a006583831fb0'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:37.539352 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-2853735a-cbdc-4cd0-bf6c-057241031272 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91251b2174b148a2be6a006583831fb0'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:37.546772 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1312/2621] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:15:37 2022] DELETE /identity/v3/users/91251b2174b148a2be6a006583831fb0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:37.824774 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c1b6f-5b62-4724-a210-b9cf9ac73fd3 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:37.826277 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a01c1b6f-5b62-4724-a210-b9cf9ac73fd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:37.840280 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c1b6f-5b62-4724-a210-b9cf9ac73fd3 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:37.902247 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22916222-8069-43c7-9891-bd9a8315c5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:37.903692 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22916222-8069-43c7-9891-bd9a8315c5fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:37.904201 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22916222-8069-43c7-9891-bd9a8315c5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:37.904690 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22916222-8069-43c7-9891-bd9a8315c5fb admin admin] PATH_INFO: `/v3/projects/1aef62bfb7b44c6380ac5bbd50f57aea` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:37.906839 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22916222-8069-43c7-9891-bd9a8315c5fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1aef62bfb7b44c6380ac5bbd50f57aea)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:37.910039 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22916222-8069-43c7-9891-bd9a8315c5fb admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:37.976210 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-22916222-8069-43c7-9891-bd9a8315c5fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1aef62bfb7b44c6380ac5bbd50f57aea', 'request_id': 'req-22916222-8069-43c7-9891-bd9a8315c5fb'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:37.984644 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-22916222-8069-43c7-9891-bd9a8315c5fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1aef62bfb7b44c6380ac5bbd50f57aea', 'request_id': 'req-22916222-8069-43c7-9891-bd9a8315c5fb'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:37.990424 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-22916222-8069-43c7-9891-bd9a8315c5fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1aef62bfb7b44c6380ac5bbd50f57aea', 'request_id': 'req-22916222-8069-43c7-9891-bd9a8315c5fb'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:38.001419 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-22916222-8069-43c7-9891-bd9a8315c5fb admin admin] The token cache is being invalidate because project 1aef62bfb7b44c6380ac5bbd50f57aea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:15:38.001743 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-22916222-8069-43c7-9891-bd9a8315c5fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:38.002401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-22916222-8069-43c7-9891-bd9a8315c5fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:38.003985 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1310/2622] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:15:37 2022] DELETE /identity/v3/projects/1aef62bfb7b44c6380ac5bbd50f57aea => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:38.009034 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99574ce3-b13f-4b4f-a652-f75f87c9d700 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:38.009517 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99574ce3-b13f-4b4f-a652-f75f87c9d700 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:38.009635 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99574ce3-b13f-4b4f-a652-f75f87c9d700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:38.028214 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-99574ce3-b13f-4b4f-a652-f75f87c9d700 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:38.029510 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-99574ce3-b13f-4b4f-a652-f75f87c9d700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:38.089669 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1313/2623] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:38.097750 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a768be2-1ce4-41b9-9293-bfade2348bce None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:38.098043 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a768be2-1ce4-41b9-9293-bfade2348bce None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:38.098316 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a768be2-1ce4-41b9-9293-bfade2348bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:38.116769 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-6a768be2-1ce4-41b9-9293-bfade2348bce None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:38.117997 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6a768be2-1ce4-41b9-9293-bfade2348bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:38.126902 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1311/2624] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:38.131083 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99574ce3-b13f-4b4f-a652-f75f87c9d700 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:38.141222 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99574ce3-b13f-4b4f-a652-f75f87c9d700 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:38.146299 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b1ec6a-2217-4438-ae73-a319de321ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:38.146969 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1ec6a-2217-4438-ae73-a319de321ebf admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:38.147253 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1ec6a-2217-4438-ae73-a319de321ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:38.147530 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1ec6a-2217-4438-ae73-a319de321ebf admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:38.148263 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b1ec6a-2217-4438-ae73-a319de321ebf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:15:38.148571 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b1ec6a-2217-4438-ae73-a319de321ebf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:38.150242 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b1ec6a-2217-4438-ae73-a319de321ebf admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:38.162052 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1314/2625] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:15:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:15:38.166566 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a768be2-1ce4-41b9-9293-bfade2348bce None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:38.176347 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a768be2-1ce4-41b9-9293-bfade2348bce None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:38.182408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45eaccd-cf38-4e93-853f-888d9d6dbfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:38.183093 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45eaccd-cf38-4e93-853f-888d9d6dbfaa admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:38.183394 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45eaccd-cf38-4e93-853f-888d9d6dbfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:38.183664 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45eaccd-cf38-4e93-853f-888d9d6dbfaa admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:38.184362 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45eaccd-cf38-4e93-853f-888d9d6dbfaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:38.186352 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45eaccd-cf38-4e93-853f-888d9d6dbfaa admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:38.218340 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1312/2626] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:15:38 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:15:38.222726 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b1ec6a-2217-4438-ae73-a319de321ebf admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:38.233184 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b1ec6a-2217-4438-ae73-a319de321ebf admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:38.293481 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af913b1-c0f2-432e-8e77-ed42e3ffc184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:38.294200 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af913b1-c0f2-432e-8e77-ed42e3ffc184 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:38.294477 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af913b1-c0f2-432e-8e77-ed42e3ffc184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:38.294782 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af913b1-c0f2-432e-8e77-ed42e3ffc184 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:38.295473 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af913b1-c0f2-432e-8e77-ed42e3ffc184 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:38.297440 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af913b1-c0f2-432e-8e77-ed42e3ffc184 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:38.318862 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1315/2627] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:15:38 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:15:38.323090 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45eaccd-cf38-4e93-853f-888d9d6dbfaa admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:38.333790 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45eaccd-cf38-4e93-853f-888d9d6dbfaa admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:38.339650 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b45b85-ef8a-4a5f-8062-c4da783b1640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:38.340309 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b45b85-ef8a-4a5f-8062-c4da783b1640 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:38.340581 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b45b85-ef8a-4a5f-8062-c4da783b1640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:38.340830 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b45b85-ef8a-4a5f-8062-c4da783b1640 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:38.341586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b45b85-ef8a-4a5f-8062-c4da783b1640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:38.343194 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b45b85-ef8a-4a5f-8062-c4da783b1640 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:38.355235 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1313/2628] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:15:38.360372 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af913b1-c0f2-432e-8e77-ed42e3ffc184 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:38.370937 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af913b1-c0f2-432e-8e77-ed42e3ffc184 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:38.376613 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86495c61-f962-46e9-8d41-95f031d2b4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:38.377445 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86495c61-f962-46e9-8d41-95f031d2b4a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:38.377762 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86495c61-f962-46e9-8d41-95f031d2b4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:38.378032 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86495c61-f962-46e9-8d41-95f031d2b4a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:38.378765 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86495c61-f962-46e9-8d41-95f031d2b4a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:38.380380 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86495c61-f962-46e9-8d41-95f031d2b4a2 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:38.390632 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1316/2629] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:15:38.396037 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b45b85-ef8a-4a5f-8062-c4da783b1640 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:38.406473 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b45b85-ef8a-4a5f-8062-c4da783b1640 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:38.412156 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7746a-103a-44b7-a585-67911dc5123b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:38.413039 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7746a-103a-44b7-a585-67911dc5123b admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:38.413312 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7746a-103a-44b7-a585-67911dc5123b admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:38.413609 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7746a-103a-44b7-a585-67911dc5123b admin admin] PATH_INFO: `/v3/projects/af8ad6591e7347fdb3f6e83f15b329d9/users/167e51d9765a4bd88b4d84d0a959ac98/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:38.429370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de7746a-103a-44b7-a585-67911dc5123b admin admin] RBAC: Authorizing `identity:create_grant(project_id=af8ad6591e7347fdb3f6e83f15b329d9, user_id=167e51d9765a4bd88b4d84d0a959ac98, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:38.432139 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de7746a-103a-44b7-a585-67911dc5123b admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:38.447225 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1314/2630] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:15:38 2022] PUT /identity/v3/projects/af8ad6591e7347fdb3f6e83f15b329d9/users/167e51d9765a4bd88b4d84d0a959ac98/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:38.457771 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fabe3-2e62-43e8-b068-e5e0ebf82fac None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:38.458067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fabe3-2e62-43e8-b068-e5e0ebf82fac None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:38.458376 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fabe3-2e62-43e8-b068-e5e0ebf82fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:38.484368 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-683fabe3-2e62-43e8-b068-e5e0ebf82fac None None] MFA Rules not processed for user `167e51d9765a4bd88b4d84d0a959ac98`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:38.485585 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-683fabe3-2e62-43e8-b068-e5e0ebf82fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:38.549737 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1317/2631] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:38.555021 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7746a-103a-44b7-a585-67911dc5123b admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:38.621735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7746a-103a-44b7-a585-67911dc5123b admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:38.627266 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9dab1c-5ebb-40c5-82fc-73d2d4b44b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:38.627934 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9dab1c-5ebb-40c5-82fc-73d2d4b44b86 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:38.628213 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9dab1c-5ebb-40c5-82fc-73d2d4b44b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:38.628482 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9dab1c-5ebb-40c5-82fc-73d2d4b44b86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:38.629221 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9dab1c-5ebb-40c5-82fc-73d2d4b44b86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:38.631168 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9dab1c-5ebb-40c5-82fc-73d2d4b44b86 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:38.661646 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1315/2632] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:15:38 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:15:38.662859 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683fabe3-2e62-43e8-b068-e5e0ebf82fac None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:38.674557 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683fabe3-2e62-43e8-b068-e5e0ebf82fac None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:38.736137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7fcb5-655a-416e-8c38-9903c97a3eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:38.736137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7fcb5-655a-416e-8c38-9903c97a3eef admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:38.736137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7fcb5-655a-416e-8c38-9903c97a3eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:38.736137 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7fcb5-655a-416e-8c38-9903c97a3eef admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:38.736516 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7fcb5-655a-416e-8c38-9903c97a3eef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:38.737415 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7fcb5-655a-416e-8c38-9903c97a3eef admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:38.757226 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1318/2633] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:15:38 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:15:38.761379 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9dab1c-5ebb-40c5-82fc-73d2d4b44b86 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:38.772205 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9dab1c-5ebb-40c5-82fc-73d2d4b44b86 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:38.777194 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01a879-5df5-4cb1-8c94-e2ffca6b7301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:38.777918 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01a879-5df5-4cb1-8c94-e2ffca6b7301 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:38.778253 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01a879-5df5-4cb1-8c94-e2ffca6b7301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:38.778526 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01a879-5df5-4cb1-8c94-e2ffca6b7301 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:38.779276 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01a879-5df5-4cb1-8c94-e2ffca6b7301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:38.780878 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01a879-5df5-4cb1-8c94-e2ffca6b7301 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:38.791408 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1316/2634] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:15:38.795762 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7fcb5-655a-416e-8c38-9903c97a3eef admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:38.805454 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7fcb5-655a-416e-8c38-9903c97a3eef admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:38.810441 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de894efc-af71-47bf-ad76-91be9f5ba041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:38.811334 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de894efc-af71-47bf-ad76-91be9f5ba041 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:38.811615 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de894efc-af71-47bf-ad76-91be9f5ba041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:38.811886 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de894efc-af71-47bf-ad76-91be9f5ba041 admin admin] PATH_INFO: `/v3/projects/6e86c4f198b04f9196a26bae8eb3989c/users/df7d74ad2d1b45db9c59efbabecf77aa/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:38.827996 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de894efc-af71-47bf-ad76-91be9f5ba041 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e86c4f198b04f9196a26bae8eb3989c, user_id=df7d74ad2d1b45db9c59efbabecf77aa, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:38.832284 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de894efc-af71-47bf-ad76-91be9f5ba041 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:38.846736 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1319/2635] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:15:38 2022] PUT /identity/v3/projects/6e86c4f198b04f9196a26bae8eb3989c/users/df7d74ad2d1b45db9c59efbabecf77aa/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:38.850703 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01a879-5df5-4cb1-8c94-e2ffca6b7301 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:38.861019 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01a879-5df5-4cb1-8c94-e2ffca6b7301 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:38.925782 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1937787-8d72-4cf2-97a1-a818d7eb6591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:38.926454 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1937787-8d72-4cf2-97a1-a818d7eb6591 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:38.926736 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1937787-8d72-4cf2-97a1-a818d7eb6591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:38.927003 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1937787-8d72-4cf2-97a1-a818d7eb6591 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:38.927724 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1937787-8d72-4cf2-97a1-a818d7eb6591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:38.929330 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1937787-8d72-4cf2-97a1-a818d7eb6591 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:38.939210 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1317/2636] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:15:38.943495 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de894efc-af71-47bf-ad76-91be9f5ba041 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:38.954106 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de894efc-af71-47bf-ad76-91be9f5ba041 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:38.959060 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d4b8c-c350-4fbc-baf4-1147450308b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:38.959939 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d4b8c-c350-4fbc-baf4-1147450308b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:38.960214 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d4b8c-c350-4fbc-baf4-1147450308b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:38.960485 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d4b8c-c350-4fbc-baf4-1147450308b8 admin admin] PATH_INFO: `/v3/projects/6e86c4f198b04f9196a26bae8eb3989c/users/df7d74ad2d1b45db9c59efbabecf77aa/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:38.962572 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d4b8c-c350-4fbc-baf4-1147450308b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e86c4f198b04f9196a26bae8eb3989c, user_id=df7d74ad2d1b45db9c59efbabecf77aa, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:38.965243 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d4b8c-c350-4fbc-baf4-1147450308b8 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:38.975544 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1320/2637] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:15:38 2022] PUT /identity/v3/projects/6e86c4f198b04f9196a26bae8eb3989c/users/df7d74ad2d1b45db9c59efbabecf77aa/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:38.986602 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc1872-1734-41fd-8a1c-e0d98a5a821e None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:38.986867 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc1872-1734-41fd-8a1c-e0d98a5a821e None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:38.987191 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc1872-1734-41fd-8a1c-e0d98a5a821e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:39.013180 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-9dbc1872-1734-41fd-8a1c-e0d98a5a821e None None] MFA Rules not processed for user `df7d74ad2d1b45db9c59efbabecf77aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:39.014402 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9dbc1872-1734-41fd-8a1c-e0d98a5a821e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:39.081771 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1318/2638] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:38 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:39.092784 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d4b8c-c350-4fbc-baf4-1147450308b8 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:39.094926 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-4d5d4b8c-c350-4fbc-baf4-1147450308b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:39.159352 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d4b8c-c350-4fbc-baf4-1147450308b8 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:39.163530 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53342c1-40ed-4419-9b02-d420164ac74a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:39.164235 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53342c1-40ed-4419-9b02-d420164ac74a service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:39.164511 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53342c1-40ed-4419-9b02-d420164ac74a service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:39.164777 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53342c1-40ed-4419-9b02-d420164ac74a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:39.175171 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53342c1-40ed-4419-9b02-d420164ac74a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:39.176612 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53342c1-40ed-4419-9b02-d420164ac74a service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:39.186368 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1321/2639] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:15:39 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:15:39.286819 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc1872-1734-41fd-8a1c-e0d98a5a821e None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:39.297306 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc1872-1734-41fd-8a1c-e0d98a5a821e None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:39.301963 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e34d2f-1416-4c94-877f-69a38e925609 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:39.302640 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e34d2f-1416-4c94-877f-69a38e925609 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:39.302917 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e34d2f-1416-4c94-877f-69a38e925609 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:39.303161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e34d2f-1416-4c94-877f-69a38e925609 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:39.361856 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e34d2f-1416-4c94-877f-69a38e925609 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:39.363336 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e34d2f-1416-4c94-877f-69a38e925609 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:39.372344 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1319/2640] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:15:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:15:40.797187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53342c1-40ed-4419-9b02-d420164ac74a service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:40.805842 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53342c1-40ed-4419-9b02-d420164ac74a service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:40.812608 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee548f81-d37b-4c7a-a8f5-e3311704e8d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:40.813458 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee548f81-d37b-4c7a-a8f5-e3311704e8d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:40.813823 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee548f81-d37b-4c7a-a8f5-e3311704e8d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:40.814140 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee548f81-d37b-4c7a-a8f5-e3311704e8d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:40.815942 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-ee548f81-d37b-4c7a-a8f5-e3311704e8d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:40.880979 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee548f81-d37b-4c7a-a8f5-e3311704e8d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:40.882531 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee548f81-d37b-4c7a-a8f5-e3311704e8d4 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:40.892689 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1322/2641] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:15:40 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:15:42.003176 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e34d2f-1416-4c94-877f-69a38e925609 service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:42.005137 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a4e34d2f-1416-4c94-877f-69a38e925609 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:42.029516 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee548f81-d37b-4c7a-a8f5-e3311704e8d4 service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:42.082565 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e34d2f-1416-4c94-877f-69a38e925609 service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:42.088256 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3621d97-8c4c-4179-8db9-0efecaf129d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:42.089154 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3621d97-8c4c-4179-8db9-0efecaf129d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:42.089433 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3621d97-8c4c-4179-8db9-0efecaf129d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:42.089738 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3621d97-8c4c-4179-8db9-0efecaf129d1 admin admin] PATH_INFO: `/v3/users/a8296c4f36cd4df8b93bc2b673811e5e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:42.091070 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3621d97-8c4c-4179-8db9-0efecaf129d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8296c4f36cd4df8b93bc2b673811e5e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:42.093678 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3621d97-8c4c-4179-8db9-0efecaf129d1 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:42.096157 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee548f81-d37b-4c7a-a8f5-e3311704e8d4 service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:42.100708 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a8fa6-42c8-4d12-bc35-2b1e1a5c5220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:42.101613 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a8fa6-42c8-4d12-bc35-2b1e1a5c5220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:42.101897 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a8fa6-42c8-4d12-bc35-2b1e1a5c5220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:42.102165 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a8fa6-42c8-4d12-bc35-2b1e1a5c5220 admin admin] PATH_INFO: `/v3/users/167e51d9765a4bd88b4d84d0a959ac98` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:42.103353 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a8fa6-42c8-4d12-bc35-2b1e1a5c5220 admin admin] RBAC: Authorizing `identity:delete_user(user_id=167e51d9765a4bd88b4d84d0a959ac98)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:42.105379 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a8fa6-42c8-4d12-bc35-2b1e1a5c5220 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:42.142886 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-c3621d97-8c4c-4179-8db9-0efecaf129d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8296c4f36cd4df8b93bc2b673811e5e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:42.150362 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-c3621d97-8c4c-4179-8db9-0efecaf129d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8296c4f36cd4df8b93bc2b673811e5e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:42.151020 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-3d6a8fa6-42c8-4d12-bc35-2b1e1a5c5220 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '167e51d9765a4bd88b4d84d0a959ac98'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:42.158373 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-c3621d97-8c4c-4179-8db9-0efecaf129d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8296c4f36cd4df8b93bc2b673811e5e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:42.166543 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-3d6a8fa6-42c8-4d12-bc35-2b1e1a5c5220 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '167e51d9765a4bd88b4d84d0a959ac98'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:42.170644 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-c3621d97-8c4c-4179-8db9-0efecaf129d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8296c4f36cd4df8b93bc2b673811e5e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:42.171311 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-c3621d97-8c4c-4179-8db9-0efecaf129d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8296c4f36cd4df8b93bc2b673811e5e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:42.173594 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-3d6a8fa6-42c8-4d12-bc35-2b1e1a5c5220 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '167e51d9765a4bd88b4d84d0a959ac98'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:42.174252 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-3d6a8fa6-42c8-4d12-bc35-2b1e1a5c5220 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '167e51d9765a4bd88b4d84d0a959ac98'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:42.177696 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1320/2642] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:15:42 2022] DELETE /identity/v3/users/a8296c4f36cd4df8b93bc2b673811e5e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:42.182762 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5186669-3b26-4feb-901a-ed161389c888 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:42.183053 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5186669-3b26-4feb-901a-ed161389c888 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:42.183324 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5186669-3b26-4feb-901a-ed161389c888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:42.188277 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-3d6a8fa6-42c8-4d12-bc35-2b1e1a5c5220 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '167e51d9765a4bd88b4d84d0a959ac98'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:42.194235 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1323/2643] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:15:42 2022] DELETE /identity/v3/users/167e51d9765a4bd88b4d84d0a959ac98 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:42.198646 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b366bd-88d0-4f1e-b54c-41ebef982534 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:42.198931 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b366bd-88d0-4f1e-b54c-41ebef982534 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:42.199206 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b366bd-88d0-4f1e-b54c-41ebef982534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:42.201016 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-f5186669-3b26-4feb-901a-ed161389c888 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:42.202937 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f5186669-3b26-4feb-901a-ed161389c888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:42.217021 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-77b366bd-88d0-4f1e-b54c-41ebef982534 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:42.218259 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-77b366bd-88d0-4f1e-b54c-41ebef982534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:42.262141 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1321/2644] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:15:42.273423 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5186669-3b26-4feb-901a-ed161389c888 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:42.275117 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f5186669-3b26-4feb-901a-ed161389c888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:42.283800 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1324/2645] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:15:42.293628 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b366bd-88d0-4f1e-b54c-41ebef982534 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:42.295124 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-77b366bd-88d0-4f1e-b54c-41ebef982534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:42.333249 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5186669-3b26-4feb-901a-ed161389c888 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:42.337579 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94f69f-1ae6-43af-af9e-ef5cdc471d38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:42.338237 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94f69f-1ae6-43af-af9e-ef5cdc471d38 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:42.338513 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94f69f-1ae6-43af-af9e-ef5cdc471d38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:42.338781 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94f69f-1ae6-43af-af9e-ef5cdc471d38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:42.349273 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94f69f-1ae6-43af-af9e-ef5cdc471d38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:42.350822 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94f69f-1ae6-43af-af9e-ef5cdc471d38 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:42.354404 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b366bd-88d0-4f1e-b54c-41ebef982534 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:42.358438 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3f2dd-e35f-4df4-9861-89c6cc736250 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:42.359092 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3f2dd-e35f-4df4-9861-89c6cc736250 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:42.359373 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3f2dd-e35f-4df4-9861-89c6cc736250 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:42.359647 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3f2dd-e35f-4df4-9861-89c6cc736250 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:42.360601 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1322/2646] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:15:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 19:15:42.369046 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f3f2dd-e35f-4df4-9861-89c6cc736250 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:42.370504 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f3f2dd-e35f-4df4-9861-89c6cc736250 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:42.379918 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1325/2647] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:15:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 19:15:42.705438 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94f69f-1ae6-43af-af9e-ef5cdc471d38 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:42.706976 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-cb94f69f-1ae6-43af-af9e-ef5cdc471d38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:42.733750 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94f69f-1ae6-43af-af9e-ef5cdc471d38 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:42.733890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3f2dd-e35f-4df4-9861-89c6cc736250 service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:42.735572 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a3f3f2dd-e35f-4df4-9861-89c6cc736250 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:42.739276 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a3f93-1b46-41d5-a042-cc52f9a67497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:42.740477 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a3f93-1b46-41d5-a042-cc52f9a67497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:42.740760 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a3f93-1b46-41d5-a042-cc52f9a67497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:42.741037 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a3f93-1b46-41d5-a042-cc52f9a67497 admin admin] PATH_INFO: `/v3/projects/b54df7954cc542dca20105a0f56e2e0b` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:42.742270 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a3f93-1b46-41d5-a042-cc52f9a67497 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b54df7954cc542dca20105a0f56e2e0b)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:42.744422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a3f93-1b46-41d5-a042-cc52f9a67497 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:42.750540 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3f2dd-e35f-4df4-9861-89c6cc736250 service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:42.756611 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a96a3b-c30f-47b3-87a4-941ecbe73a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:42.757616 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a96a3b-c30f-47b3-87a4-941ecbe73a5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:42.758058 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a96a3b-c30f-47b3-87a4-941ecbe73a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:42.758298 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a96a3b-c30f-47b3-87a4-941ecbe73a5d admin admin] PATH_INFO: `/v3/projects/af8ad6591e7347fdb3f6e83f15b329d9` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:42.759534 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a96a3b-c30f-47b3-87a4-941ecbe73a5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=af8ad6591e7347fdb3f6e83f15b329d9)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:42.761732 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a96a3b-c30f-47b3-87a4-941ecbe73a5d admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:42.798480 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b37a3f93-1b46-41d5-a042-cc52f9a67497 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b54df7954cc542dca20105a0f56e2e0b', 'request_id': 'req-b37a3f93-1b46-41d5-a042-cc52f9a67497'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:42.806008 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b37a3f93-1b46-41d5-a042-cc52f9a67497 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b54df7954cc542dca20105a0f56e2e0b', 'request_id': 'req-b37a3f93-1b46-41d5-a042-cc52f9a67497'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:42.809766 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-50a96a3b-c30f-47b3-87a4-941ecbe73a5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af8ad6591e7347fdb3f6e83f15b329d9', 'request_id': 'req-50a96a3b-c30f-47b3-87a4-941ecbe73a5d'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:42.811977 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b37a3f93-1b46-41d5-a042-cc52f9a67497 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b54df7954cc542dca20105a0f56e2e0b', 'request_id': 'req-b37a3f93-1b46-41d5-a042-cc52f9a67497'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:42.815234 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-50a96a3b-c30f-47b3-87a4-941ecbe73a5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af8ad6591e7347fdb3f6e83f15b329d9', 'request_id': 'req-50a96a3b-c30f-47b3-87a4-941ecbe73a5d'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:42.821219 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-50a96a3b-c30f-47b3-87a4-941ecbe73a5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af8ad6591e7347fdb3f6e83f15b329d9', 'request_id': 'req-50a96a3b-c30f-47b3-87a4-941ecbe73a5d'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:42.823085 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b37a3f93-1b46-41d5-a042-cc52f9a67497 admin admin] The token cache is being invalidate because project b54df7954cc542dca20105a0f56e2e0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:15:42.823396 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b37a3f93-1b46-41d5-a042-cc52f9a67497 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:42.824155 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b37a3f93-1b46-41d5-a042-cc52f9a67497 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:42.825875 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1323/2648] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:15:42 2022] DELETE /identity/v3/projects/b54df7954cc542dca20105a0f56e2e0b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:42.834800 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-50a96a3b-c30f-47b3-87a4-941ecbe73a5d admin admin] The token cache is being invalidate because project af8ad6591e7347fdb3f6e83f15b329d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:15:42.835095 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-50a96a3b-c30f-47b3-87a4-941ecbe73a5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:42.835766 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-50a96a3b-c30f-47b3-87a4-941ecbe73a5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:42.837402 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1326/2649] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:15:42 2022] DELETE /identity/v3/projects/af8ad6591e7347fdb3f6e83f15b329d9 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:42.841851 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a3f93-1b46-41d5-a042-cc52f9a67497 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:42.843283 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b37a3f93-1b46-41d5-a042-cc52f9a67497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:42.913814 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a3f93-1b46-41d5-a042-cc52f9a67497 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:42.976127 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b02f4-88cc-47cd-a1cd-6187024060ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:42.977063 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b02f4-88cc-47cd-a1cd-6187024060ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:42.977333 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b02f4-88cc-47cd-a1cd-6187024060ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:42.977637 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b02f4-88cc-47cd-a1cd-6187024060ff admin admin] PATH_INFO: `/v3/users/df7d74ad2d1b45db9c59efbabecf77aa` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:42.978998 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8b02f4-88cc-47cd-a1cd-6187024060ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=df7d74ad2d1b45db9c59efbabecf77aa)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:42.981129 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8b02f4-88cc-47cd-a1cd-6187024060ff admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:43.032598 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4b8b02f4-88cc-47cd-a1cd-6187024060ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df7d74ad2d1b45db9c59efbabecf77aa'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:43.039927 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4b8b02f4-88cc-47cd-a1cd-6187024060ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df7d74ad2d1b45db9c59efbabecf77aa'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:43.048709 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4b8b02f4-88cc-47cd-a1cd-6187024060ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df7d74ad2d1b45db9c59efbabecf77aa'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:43.061313 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4b8b02f4-88cc-47cd-a1cd-6187024060ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df7d74ad2d1b45db9c59efbabecf77aa'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:43.062114 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4b8b02f4-88cc-47cd-a1cd-6187024060ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df7d74ad2d1b45db9c59efbabecf77aa'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:43.070615 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1324/2650] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:15:42 2022] DELETE /identity/v3/users/df7d74ad2d1b45db9c59efbabecf77aa => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:43.344042 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a96a3b-c30f-47b3-87a4-941ecbe73a5d admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:43.345641 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-50a96a3b-c30f-47b3-87a4-941ecbe73a5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:43.358408 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a96a3b-c30f-47b3-87a4-941ecbe73a5d admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:43.416471 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86411272-93b1-42b3-81a4-277eb7803e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:43.417353 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86411272-93b1-42b3-81a4-277eb7803e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:43.417676 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86411272-93b1-42b3-81a4-277eb7803e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:43.417936 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86411272-93b1-42b3-81a4-277eb7803e42 admin admin] PATH_INFO: `/v3/projects/6e86c4f198b04f9196a26bae8eb3989c` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:43.419156 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86411272-93b1-42b3-81a4-277eb7803e42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e86c4f198b04f9196a26bae8eb3989c)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:43.421068 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86411272-93b1-42b3-81a4-277eb7803e42 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:43.466364 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-86411272-93b1-42b3-81a4-277eb7803e42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e86c4f198b04f9196a26bae8eb3989c', 'request_id': 'req-86411272-93b1-42b3-81a4-277eb7803e42'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:43.471895 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-86411272-93b1-42b3-81a4-277eb7803e42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e86c4f198b04f9196a26bae8eb3989c', 'request_id': 'req-86411272-93b1-42b3-81a4-277eb7803e42'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:43.478336 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-86411272-93b1-42b3-81a4-277eb7803e42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e86c4f198b04f9196a26bae8eb3989c', 'request_id': 'req-86411272-93b1-42b3-81a4-277eb7803e42'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:43.493857 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-86411272-93b1-42b3-81a4-277eb7803e42 admin admin] The token cache is being invalidate because project 6e86c4f198b04f9196a26bae8eb3989c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:15:43.494141 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-86411272-93b1-42b3-81a4-277eb7803e42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:43.494857 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-86411272-93b1-42b3-81a4-277eb7803e42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:43.496484 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1327/2651] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:15:43 2022] DELETE /identity/v3/projects/6e86c4f198b04f9196a26bae8eb3989c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:43.501812 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a409c72-c832-452b-a8ed-c177f2dfbcbb None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:43.502105 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a409c72-c832-452b-a8ed-c177f2dfbcbb None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:43.502385 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a409c72-c832-452b-a8ed-c177f2dfbcbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:43.521726 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-2a409c72-c832-452b-a8ed-c177f2dfbcbb None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:43.522944 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2a409c72-c832-452b-a8ed-c177f2dfbcbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:43.587508 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1325/2652] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:43.595424 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e3cff-8505-48f4-a57c-9b991a09c924 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:43.595713 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e3cff-8505-48f4-a57c-9b991a09c924 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:43.595990 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e3cff-8505-48f4-a57c-9b991a09c924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:43.615180 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-fd3e3cff-8505-48f4-a57c-9b991a09c924 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:43.616378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-fd3e3cff-8505-48f4-a57c-9b991a09c924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:43.625678 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1328/2653] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:43.631206 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a409c72-c832-452b-a8ed-c177f2dfbcbb None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:43.641330 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a409c72-c832-452b-a8ed-c177f2dfbcbb None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:43.647559 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2917770-36ae-4215-b16d-c5fcc7ba80d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:43.648223 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2917770-36ae-4215-b16d-c5fcc7ba80d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:43.648506 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2917770-36ae-4215-b16d-c5fcc7ba80d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:43.648773 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2917770-36ae-4215-b16d-c5fcc7ba80d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:43.649505 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2917770-36ae-4215-b16d-c5fcc7ba80d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:15:43.649858 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2917770-36ae-4215-b16d-c5fcc7ba80d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:43.651471 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2917770-36ae-4215-b16d-c5fcc7ba80d2 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:43.663396 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1326/2654] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:15:43.667535 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e3cff-8505-48f4-a57c-9b991a09c924 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:43.677148 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e3cff-8505-48f4-a57c-9b991a09c924 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:43.682833 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bbf3e2-ef6d-421f-9edd-85f68c2c21e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:43.683501 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbf3e2-ef6d-421f-9edd-85f68c2c21e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:43.683781 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbf3e2-ef6d-421f-9edd-85f68c2c21e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:43.684055 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbf3e2-ef6d-421f-9edd-85f68c2c21e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:43.684762 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bbf3e2-ef6d-421f-9edd-85f68c2c21e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:43.686758 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bbf3e2-ef6d-421f-9edd-85f68c2c21e7 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:43.716813 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1329/2655] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:15:43 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:15:43.721290 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2917770-36ae-4215-b16d-c5fcc7ba80d2 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:43.732218 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2917770-36ae-4215-b16d-c5fcc7ba80d2 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:43.796287 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae03a1-c521-4104-b7d0-aad393734619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:43.796970 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae03a1-c521-4104-b7d0-aad393734619 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:43.797251 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae03a1-c521-4104-b7d0-aad393734619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:43.797498 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae03a1-c521-4104-b7d0-aad393734619 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:43.798285 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae03a1-c521-4104-b7d0-aad393734619 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:43.800205 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae03a1-c521-4104-b7d0-aad393734619 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:43.820909 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1327/2656] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:15:43 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:15:43.825219 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bbf3e2-ef6d-421f-9edd-85f68c2c21e7 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:43.835654 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bbf3e2-ef6d-421f-9edd-85f68c2c21e7 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:43.840924 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2fb96-0722-42f5-a71a-8064e9d3ac96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:43.841561 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2fb96-0722-42f5-a71a-8064e9d3ac96 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:43.841859 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2fb96-0722-42f5-a71a-8064e9d3ac96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:43.842135 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2fb96-0722-42f5-a71a-8064e9d3ac96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:43.842861 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b2fb96-0722-42f5-a71a-8064e9d3ac96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:43.844495 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b2fb96-0722-42f5-a71a-8064e9d3ac96 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:43.856741 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1330/2657] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:15:43.861909 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae03a1-c521-4104-b7d0-aad393734619 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:43.872082 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae03a1-c521-4104-b7d0-aad393734619 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:43.877366 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5b269-c9d0-498e-89ea-ee19599d30df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:43.878053 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5b269-c9d0-498e-89ea-ee19599d30df admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:43.878321 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5b269-c9d0-498e-89ea-ee19599d30df admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:43.878608 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5b269-c9d0-498e-89ea-ee19599d30df admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:43.879342 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da5b269-c9d0-498e-89ea-ee19599d30df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:43.880978 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da5b269-c9d0-498e-89ea-ee19599d30df admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:43.891308 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1328/2658] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:15:43.895810 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2fb96-0722-42f5-a71a-8064e9d3ac96 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:43.906100 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2fb96-0722-42f5-a71a-8064e9d3ac96 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:43.911607 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b93d57-52a3-434d-8b00-d230e1ce9c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:43.912542 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b93d57-52a3-434d-8b00-d230e1ce9c2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:43.912815 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b93d57-52a3-434d-8b00-d230e1ce9c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:43.913084 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b93d57-52a3-434d-8b00-d230e1ce9c2a admin admin] PATH_INFO: `/v3/projects/417d174f504944c791a4ab26f8cab29c/users/864db151e1af4a178a28c29b8a60159d/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:43.928870 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b93d57-52a3-434d-8b00-d230e1ce9c2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=417d174f504944c791a4ab26f8cab29c, user_id=864db151e1af4a178a28c29b8a60159d, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:43.931573 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b93d57-52a3-434d-8b00-d230e1ce9c2a admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:43.945860 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1331/2659] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:15:43 2022] PUT /identity/v3/projects/417d174f504944c791a4ab26f8cab29c/users/864db151e1af4a178a28c29b8a60159d/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:43.957106 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e439ec0-8b71-452b-8198-988d6fc19f20 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:43.957462 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e439ec0-8b71-452b-8198-988d6fc19f20 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:43.957863 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e439ec0-8b71-452b-8198-988d6fc19f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:43.989310 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-9e439ec0-8b71-452b-8198-988d6fc19f20 None None] MFA Rules not processed for user `864db151e1af4a178a28c29b8a60159d`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:43.990582 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9e439ec0-8b71-452b-8198-988d6fc19f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:44.054485 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1329/2660] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:15:44.061781 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b93d57-52a3-434d-8b00-d230e1ce9c2a admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:44.130045 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b93d57-52a3-434d-8b00-d230e1ce9c2a admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:44.138568 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714b33f-a383-42b5-8d55-07129ed27778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:44.139600 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714b33f-a383-42b5-8d55-07129ed27778 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:44.139936 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714b33f-a383-42b5-8d55-07129ed27778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:44.140286 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714b33f-a383-42b5-8d55-07129ed27778 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:44.141674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5714b33f-a383-42b5-8d55-07129ed27778 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:44.143907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5714b33f-a383-42b5-8d55-07129ed27778 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:44.171435 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1332/2661] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:15:44 2022] POST /identity/v3/projects => generated 389 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:15:44.175760 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e439ec0-8b71-452b-8198-988d6fc19f20 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:44.187108 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e439ec0-8b71-452b-8198-988d6fc19f20 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:44.248590 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4203f7-3303-41f3-815f-6ee71e4e005f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:44.250097 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4203f7-3303-41f3-815f-6ee71e4e005f admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:44.250691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4203f7-3303-41f3-815f-6ee71e4e005f admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:44.250971 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4203f7-3303-41f3-815f-6ee71e4e005f admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:44.252713 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4203f7-3303-41f3-815f-6ee71e4e005f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:44.254590 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4203f7-3303-41f3-815f-6ee71e4e005f admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:44.277684 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1330/2662] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:15:44 2022] POST /identity/v3/users => generated 301 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:15:44.281744 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714b33f-a383-42b5-8d55-07129ed27778 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:44.291926 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714b33f-a383-42b5-8d55-07129ed27778 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:44.296604 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c59a0f3-cd8c-4d8e-967e-054fe78246d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:44.297214 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59a0f3-cd8c-4d8e-967e-054fe78246d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:44.297489 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59a0f3-cd8c-4d8e-967e-054fe78246d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:44.297834 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59a0f3-cd8c-4d8e-967e-054fe78246d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:44.298599 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c59a0f3-cd8c-4d8e-967e-054fe78246d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:44.300234 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c59a0f3-cd8c-4d8e-967e-054fe78246d9 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:44.311062 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1333/2663] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:15:44.315354 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4203f7-3303-41f3-815f-6ee71e4e005f admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:44.325305 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4203f7-3303-41f3-815f-6ee71e4e005f admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:44.330672 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989d479-995c-4860-a12f-9228f5f60712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:44.331398 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989d479-995c-4860-a12f-9228f5f60712 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:44.331659 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989d479-995c-4860-a12f-9228f5f60712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:44.331932 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989d479-995c-4860-a12f-9228f5f60712 admin admin] PATH_INFO: `/v3/projects/bd15ecb4a6194ee9b72b31f5ecd8bff2/users/90c3d855b4cd4113906708840671d790/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:44.346843 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2989d479-995c-4860-a12f-9228f5f60712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd15ecb4a6194ee9b72b31f5ecd8bff2, user_id=90c3d855b4cd4113906708840671d790, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:44.349581 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2989d479-995c-4860-a12f-9228f5f60712 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:44.365082 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1331/2664] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:15:44 2022] PUT /identity/v3/projects/bd15ecb4a6194ee9b72b31f5ecd8bff2/users/90c3d855b4cd4113906708840671d790/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:44.369156 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c59a0f3-cd8c-4d8e-967e-054fe78246d9 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:44.379118 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c59a0f3-cd8c-4d8e-967e-054fe78246d9 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:44.435263 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e7f0c-29c2-4851-8282-67f881c17b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:44.435938 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e7f0c-29c2-4851-8282-67f881c17b9a admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:44.436219 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e7f0c-29c2-4851-8282-67f881c17b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:44.436512 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e7f0c-29c2-4851-8282-67f881c17b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:44.437208 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9e7f0c-29c2-4851-8282-67f881c17b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:44.439024 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9e7f0c-29c2-4851-8282-67f881c17b9a admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:44.449478 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1334/2665] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:15:44.453723 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989d479-995c-4860-a12f-9228f5f60712 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:44.466477 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989d479-995c-4860-a12f-9228f5f60712 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:44.471082 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1635fc-4614-4a9b-8425-92978a7b8e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:44.471971 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1635fc-4614-4a9b-8425-92978a7b8e34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:44.472272 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1635fc-4614-4a9b-8425-92978a7b8e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:44.472543 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1635fc-4614-4a9b-8425-92978a7b8e34 admin admin] PATH_INFO: `/v3/projects/bd15ecb4a6194ee9b72b31f5ecd8bff2/users/90c3d855b4cd4113906708840671d790/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:44.474648 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1635fc-4614-4a9b-8425-92978a7b8e34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd15ecb4a6194ee9b72b31f5ecd8bff2, user_id=90c3d855b4cd4113906708840671d790, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:44.477272 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1635fc-4614-4a9b-8425-92978a7b8e34 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:44.488070 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1332/2666] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:15:44 2022] PUT /identity/v3/projects/bd15ecb4a6194ee9b72b31f5ecd8bff2/users/90c3d855b4cd4113906708840671d790/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:44.499091 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ab419-aa11-4a44-8b32-8afaaffe8345 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:44.499373 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ab419-aa11-4a44-8b32-8afaaffe8345 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:44.499661 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ab419-aa11-4a44-8b32-8afaaffe8345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:44.527556 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-c40ab419-aa11-4a44-8b32-8afaaffe8345 None None] MFA Rules not processed for user `90c3d855b4cd4113906708840671d790`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:44.528766 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-c40ab419-aa11-4a44-8b32-8afaaffe8345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:44.607323 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1335/2667] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:44 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:44.618869 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1635fc-4614-4a9b-8425-92978a7b8e34 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:44.621042 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6a1635fc-4614-4a9b-8425-92978a7b8e34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:44.680924 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1635fc-4614-4a9b-8425-92978a7b8e34 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:44.685195 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4489b42a-d4f8-40ad-8bbc-44076da943b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:44.685878 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489b42a-d4f8-40ad-8bbc-44076da943b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:44.686157 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489b42a-d4f8-40ad-8bbc-44076da943b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:44.686414 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489b42a-d4f8-40ad-8bbc-44076da943b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:44.696521 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4489b42a-d4f8-40ad-8bbc-44076da943b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:44.697998 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4489b42a-d4f8-40ad-8bbc-44076da943b7 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:44.707437 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1333/2668] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:15:44 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:15:44.836297 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ab419-aa11-4a44-8b32-8afaaffe8345 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:44.902642 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ab419-aa11-4a44-8b32-8afaaffe8345 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:44.908460 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7efb7-ad07-41bb-8de2-a8c23d330024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:44.909336 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7efb7-ad07-41bb-8de2-a8c23d330024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:44.909652 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7efb7-ad07-41bb-8de2-a8c23d330024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:44.909923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7efb7-ad07-41bb-8de2-a8c23d330024 admin admin] PATH_INFO: `/v3/users/864db151e1af4a178a28c29b8a60159d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:44.911238 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd7efb7-ad07-41bb-8de2-a8c23d330024 admin admin] RBAC: Authorizing `identity:delete_user(user_id=864db151e1af4a178a28c29b8a60159d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:44.913183 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd7efb7-ad07-41bb-8de2-a8c23d330024 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:44.968215 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-2cd7efb7-ad07-41bb-8de2-a8c23d330024 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '864db151e1af4a178a28c29b8a60159d'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:44.975410 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-2cd7efb7-ad07-41bb-8de2-a8c23d330024 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '864db151e1af4a178a28c29b8a60159d'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:44.982041 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-2cd7efb7-ad07-41bb-8de2-a8c23d330024 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '864db151e1af4a178a28c29b8a60159d'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:44.982648 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-2cd7efb7-ad07-41bb-8de2-a8c23d330024 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '864db151e1af4a178a28c29b8a60159d'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:44.995022 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-2cd7efb7-ad07-41bb-8de2-a8c23d330024 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '864db151e1af4a178a28c29b8a60159d'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:45.001213 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1336/2669] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:15:44 2022] DELETE /identity/v3/users/864db151e1af4a178a28c29b8a60159d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:45.006123 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1de2fa-5032-4901-bbf9-58b90cc0fcb3 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:45.006415 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1de2fa-5032-4901-bbf9-58b90cc0fcb3 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:45.006702 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1de2fa-5032-4901-bbf9-58b90cc0fcb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:45.025567 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-2b1de2fa-5032-4901-bbf9-58b90cc0fcb3 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:45.026766 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2b1de2fa-5032-4901-bbf9-58b90cc0fcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:45.087882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1334/2670] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:45.098186 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7efb7-ad07-41bb-8de2-a8c23d330024 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:45.100187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-2cd7efb7-ad07-41bb-8de2-a8c23d330024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:45.163480 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7efb7-ad07-41bb-8de2-a8c23d330024 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:45.169270 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e2d17-17a7-4e30-897a-63cf33929276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:45.170301 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e2d17-17a7-4e30-897a-63cf33929276 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:45.170641 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e2d17-17a7-4e30-897a-63cf33929276 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:45.170976 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e2d17-17a7-4e30-897a-63cf33929276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:45.182256 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e2d17-17a7-4e30-897a-63cf33929276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:45.183710 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e2d17-17a7-4e30-897a-63cf33929276 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:45.193840 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1337/2671] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:15:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:15:45.479487 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1de2fa-5032-4901-bbf9-58b90cc0fcb3 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:45.481217 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2b1de2fa-5032-4901-bbf9-58b90cc0fcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:45.497459 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1de2fa-5032-4901-bbf9-58b90cc0fcb3 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:45.503448 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c43d43-3936-42e2-a173-e2d1ab5b878f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:45.504305 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c43d43-3936-42e2-a173-e2d1ab5b878f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:45.504598 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c43d43-3936-42e2-a173-e2d1ab5b878f admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:45.504764 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c43d43-3936-42e2-a173-e2d1ab5b878f admin admin] PATH_INFO: `/v3/projects/417d174f504944c791a4ab26f8cab29c` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:45.506000 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c43d43-3936-42e2-a173-e2d1ab5b878f admin admin] RBAC: Authorizing `identity:delete_project(project_id=417d174f504944c791a4ab26f8cab29c)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:45.508507 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c43d43-3936-42e2-a173-e2d1ab5b878f admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:45.555780 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-52c43d43-3936-42e2-a173-e2d1ab5b878f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '417d174f504944c791a4ab26f8cab29c', 'request_id': 'req-52c43d43-3936-42e2-a173-e2d1ab5b878f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:45.563617 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-52c43d43-3936-42e2-a173-e2d1ab5b878f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '417d174f504944c791a4ab26f8cab29c', 'request_id': 'req-52c43d43-3936-42e2-a173-e2d1ab5b878f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:45.569347 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-52c43d43-3936-42e2-a173-e2d1ab5b878f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '417d174f504944c791a4ab26f8cab29c', 'request_id': 'req-52c43d43-3936-42e2-a173-e2d1ab5b878f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:45.581545 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-52c43d43-3936-42e2-a173-e2d1ab5b878f admin admin] The token cache is being invalidate because project 417d174f504944c791a4ab26f8cab29c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:15:45.581545 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-52c43d43-3936-42e2-a173-e2d1ab5b878f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:45.582115 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-52c43d43-3936-42e2-a173-e2d1ab5b878f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:45.583735 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1335/2672] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:15:45 2022] DELETE /identity/v3/projects/417d174f504944c791a4ab26f8cab29c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:45.587930 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e2d17-17a7-4e30-897a-63cf33929276 service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:45.597436 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e2d17-17a7-4e30-897a-63cf33929276 service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:45.656612 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50958142-a928-48b2-b180-800fbca913d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:45.657739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50958142-a928-48b2-b180-800fbca913d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:45.658091 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50958142-a928-48b2-b180-800fbca913d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:45.658442 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50958142-a928-48b2-b180-800fbca913d8 admin admin] PATH_INFO: `/v3/users/90c3d855b4cd4113906708840671d790` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:45.659905 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50958142-a928-48b2-b180-800fbca913d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90c3d855b4cd4113906708840671d790)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:45.662154 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50958142-a928-48b2-b180-800fbca913d8 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:45.709216 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-50958142-a928-48b2-b180-800fbca913d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90c3d855b4cd4113906708840671d790'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:45.718065 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-50958142-a928-48b2-b180-800fbca913d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90c3d855b4cd4113906708840671d790'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:45.725916 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-50958142-a928-48b2-b180-800fbca913d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90c3d855b4cd4113906708840671d790'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:45.726823 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-50958142-a928-48b2-b180-800fbca913d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90c3d855b4cd4113906708840671d790'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:45.740260 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-50958142-a928-48b2-b180-800fbca913d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90c3d855b4cd4113906708840671d790'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:45.746229 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1338/2673] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:15:45 2022] DELETE /identity/v3/users/90c3d855b4cd4113906708840671d790 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:46.015435 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c43d43-3936-42e2-a173-e2d1ab5b878f admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:46.017401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-52c43d43-3936-42e2-a173-e2d1ab5b878f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:46.035851 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c43d43-3936-42e2-a173-e2d1ab5b878f admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:46.095020 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c965b6-9c94-4931-96bd-78e0444ef024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:46.095935 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c965b6-9c94-4931-96bd-78e0444ef024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:46.096225 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c965b6-9c94-4931-96bd-78e0444ef024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:46.096490 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c965b6-9c94-4931-96bd-78e0444ef024 admin admin] PATH_INFO: `/v3/projects/bd15ecb4a6194ee9b72b31f5ecd8bff2` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:46.097816 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c965b6-9c94-4931-96bd-78e0444ef024 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd15ecb4a6194ee9b72b31f5ecd8bff2)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:46.099758 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c965b6-9c94-4931-96bd-78e0444ef024 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:46.146804 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e4c965b6-9c94-4931-96bd-78e0444ef024 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd15ecb4a6194ee9b72b31f5ecd8bff2', 'request_id': 'req-e4c965b6-9c94-4931-96bd-78e0444ef024'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:46.154743 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e4c965b6-9c94-4931-96bd-78e0444ef024 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd15ecb4a6194ee9b72b31f5ecd8bff2', 'request_id': 'req-e4c965b6-9c94-4931-96bd-78e0444ef024'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:46.160495 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e4c965b6-9c94-4931-96bd-78e0444ef024 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd15ecb4a6194ee9b72b31f5ecd8bff2', 'request_id': 'req-e4c965b6-9c94-4931-96bd-78e0444ef024'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:46.172258 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e4c965b6-9c94-4931-96bd-78e0444ef024 admin admin] The token cache is being invalidate because project bd15ecb4a6194ee9b72b31f5ecd8bff2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:15:46.172552 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e4c965b6-9c94-4931-96bd-78e0444ef024 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:46.173281 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e4c965b6-9c94-4931-96bd-78e0444ef024 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:15:46.174964 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1336/2674] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:15:46 2022] DELETE /identity/v3/projects/bd15ecb4a6194ee9b72b31f5ecd8bff2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:46.180103 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f9d5f-2f18-490d-bc79-55e858ec6efb None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:46.180399 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f9d5f-2f18-490d-bc79-55e858ec6efb None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:46.180705 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f9d5f-2f18-490d-bc79-55e858ec6efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:46.199871 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-833f9d5f-2f18-490d-bc79-55e858ec6efb None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:46.201085 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-833f9d5f-2f18-490d-bc79-55e858ec6efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:46.269357 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1339/2675] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:46.280824 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb5d30-3091-42dd-9578-f86208b8dcf0 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:46.281122 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb5d30-3091-42dd-9578-f86208b8dcf0 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:46.281398 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb5d30-3091-42dd-9578-f86208b8dcf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:46.300806 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-84bb5d30-3091-42dd-9578-f86208b8dcf0 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:46.302050 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-84bb5d30-3091-42dd-9578-f86208b8dcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:46.311522 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1337/2676] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:46.315889 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f9d5f-2f18-490d-bc79-55e858ec6efb None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:46.326101 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f9d5f-2f18-490d-bc79-55e858ec6efb None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:46.332082 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569831e-6caa-460c-bd72-b034a41a6649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:46.332794 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569831e-6caa-460c-bd72-b034a41a6649 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:46.333067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569831e-6caa-460c-bd72-b034a41a6649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:46.333365 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569831e-6caa-460c-bd72-b034a41a6649 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:46.334132 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569831e-6caa-460c-bd72-b034a41a6649 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:15:46.334443 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569831e-6caa-460c-bd72-b034a41a6649 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:46.336072 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569831e-6caa-460c-bd72-b034a41a6649 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:46.348372 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1340/2677] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:15:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:15:46.352811 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb5d30-3091-42dd-9578-f86208b8dcf0 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:46.362512 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb5d30-3091-42dd-9578-f86208b8dcf0 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:46.368919 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c106b9a-96ae-47ee-8d7b-106a2de8ddc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:46.369643 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c106b9a-96ae-47ee-8d7b-106a2de8ddc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:46.369920 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c106b9a-96ae-47ee-8d7b-106a2de8ddc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:46.370196 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c106b9a-96ae-47ee-8d7b-106a2de8ddc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:46.370879 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c106b9a-96ae-47ee-8d7b-106a2de8ddc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:46.372815 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c106b9a-96ae-47ee-8d7b-106a2de8ddc9 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:46.402044 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1338/2678] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:15:46 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:15:46.406242 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569831e-6caa-460c-bd72-b034a41a6649 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:46.417821 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569831e-6caa-460c-bd72-b034a41a6649 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:46.477553 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16f6d8-b7eb-47d7-a920-73d74a94526e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:46.478261 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16f6d8-b7eb-47d7-a920-73d74a94526e admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:46.478545 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16f6d8-b7eb-47d7-a920-73d74a94526e admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:46.478821 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16f6d8-b7eb-47d7-a920-73d74a94526e admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:46.479503 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16f6d8-b7eb-47d7-a920-73d74a94526e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:46.481480 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16f6d8-b7eb-47d7-a920-73d74a94526e admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:46.502330 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1341/2679] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:15:46 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:15:46.506407 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c106b9a-96ae-47ee-8d7b-106a2de8ddc9 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:46.517466 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c106b9a-96ae-47ee-8d7b-106a2de8ddc9 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:46.523150 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3110d-d669-42bc-8c5c-44328327b719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:46.523933 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3110d-d669-42bc-8c5c-44328327b719 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:46.524203 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3110d-d669-42bc-8c5c-44328327b719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:46.524472 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3110d-d669-42bc-8c5c-44328327b719 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:46.525208 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c3110d-d669-42bc-8c5c-44328327b719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:46.526923 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c3110d-d669-42bc-8c5c-44328327b719 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:46.537683 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1339/2680] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:15:46.541602 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16f6d8-b7eb-47d7-a920-73d74a94526e admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:46.551945 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16f6d8-b7eb-47d7-a920-73d74a94526e admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:46.557646 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b599a-59fe-4dec-95d7-6fa62f30a6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:46.558311 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b599a-59fe-4dec-95d7-6fa62f30a6a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:46.558585 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b599a-59fe-4dec-95d7-6fa62f30a6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:46.558855 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b599a-59fe-4dec-95d7-6fa62f30a6a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:46.559572 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b599a-59fe-4dec-95d7-6fa62f30a6a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:46.561182 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b599a-59fe-4dec-95d7-6fa62f30a6a1 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:46.571269 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1342/2681] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:15:46.575365 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3110d-d669-42bc-8c5c-44328327b719 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:46.585883 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3110d-d669-42bc-8c5c-44328327b719 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:46.591801 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974aa1b-d222-4bbe-9c3d-d57f85eb2432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:46.592688 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974aa1b-d222-4bbe-9c3d-d57f85eb2432 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:46.592971 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974aa1b-d222-4bbe-9c3d-d57f85eb2432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:46.593245 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974aa1b-d222-4bbe-9c3d-d57f85eb2432 admin admin] PATH_INFO: `/v3/projects/92edc6236ec34f369cd0ed8a395e8d86/users/6922c32ea1d44dd2a3d80d0f17e363c4/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:46.608536 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974aa1b-d222-4bbe-9c3d-d57f85eb2432 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92edc6236ec34f369cd0ed8a395e8d86, user_id=6922c32ea1d44dd2a3d80d0f17e363c4, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:46.611320 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974aa1b-d222-4bbe-9c3d-d57f85eb2432 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:46.625465 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1340/2682] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:15:46 2022] PUT /identity/v3/projects/92edc6236ec34f369cd0ed8a395e8d86/users/6922c32ea1d44dd2a3d80d0f17e363c4/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:15:46.641064 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152c206-0b5b-40a4-87fb-71f35571b876 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:46.641602 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152c206-0b5b-40a4-87fb-71f35571b876 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:46.641724 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152c206-0b5b-40a4-87fb-71f35571b876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:46.667986 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-3152c206-0b5b-40a4-87fb-71f35571b876 None None] MFA Rules not processed for user `6922c32ea1d44dd2a3d80d0f17e363c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:15:46.669208 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-3152c206-0b5b-40a4-87fb-71f35571b876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:46.737396 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1343/2683] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:15:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:15:46.748895 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974aa1b-d222-4bbe-9c3d-d57f85eb2432 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:15:46.750997 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9974aa1b-d222-4bbe-9c3d-d57f85eb2432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:15:46.808150 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974aa1b-d222-4bbe-9c3d-d57f85eb2432 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:15:46.812248 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c342a5-0e4f-48a7-8292-3b1909f1ef5f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dfa8e8908804c0e8908e2a8c6b377e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:15:46.812897 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c342a5-0e4f-48a7-8292-3b1909f1ef5f service glance] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:15:46.813180 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c342a5-0e4f-48a7-8292-3b1909f1ef5f service glance] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:15:46.813449 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c342a5-0e4f-48a7-8292-3b1909f1ef5f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:15:46.821953 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c342a5-0e4f-48a7-8292-3b1909f1ef5f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:15:46.823422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c342a5-0e4f-48a7-8292-3b1909f1ef5f service glance] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:15:46.832341 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1341/2684] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:15:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:16:03.691405 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152c206-0b5b-40a4-87fb-71f35571b876 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:03.693078 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-3152c206-0b5b-40a4-87fb-71f35571b876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:03.762340 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152c206-0b5b-40a4-87fb-71f35571b876 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:03.768637 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d2dce-273f-4859-ae7b-a90cdb72d260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:03.769641 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d2dce-273f-4859-ae7b-a90cdb72d260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:03.769924 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d2dce-273f-4859-ae7b-a90cdb72d260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:03.770214 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d2dce-273f-4859-ae7b-a90cdb72d260 admin admin] PATH_INFO: `/v3/users/13fbfba614bd4779a64616f55671fff2` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:03.771542 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d2dce-273f-4859-ae7b-a90cdb72d260 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13fbfba614bd4779a64616f55671fff2)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:03.773510 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d2dce-273f-4859-ae7b-a90cdb72d260 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:03.818488 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-351d2dce-273f-4859-ae7b-a90cdb72d260 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13fbfba614bd4779a64616f55671fff2'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:03.826086 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-351d2dce-273f-4859-ae7b-a90cdb72d260 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13fbfba614bd4779a64616f55671fff2'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:03.833013 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-351d2dce-273f-4859-ae7b-a90cdb72d260 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13fbfba614bd4779a64616f55671fff2'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:03.833689 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-351d2dce-273f-4859-ae7b-a90cdb72d260 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13fbfba614bd4779a64616f55671fff2'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:03.845346 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-351d2dce-273f-4859-ae7b-a90cdb72d260 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13fbfba614bd4779a64616f55671fff2'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:03.851466 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1344/2685] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:16:03 2022] DELETE /identity/v3/users/13fbfba614bd4779a64616f55671fff2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:16:03.856736 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef94b1-2d6e-4fe0-b44e-d3bbb6df0ff1 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:03.857262 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef94b1-2d6e-4fe0-b44e-d3bbb6df0ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:03.857384 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef94b1-2d6e-4fe0-b44e-d3bbb6df0ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:03.876233 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-c7ef94b1-2d6e-4fe0-b44e-d3bbb6df0ff1 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:03.877517 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c7ef94b1-2d6e-4fe0-b44e-d3bbb6df0ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:03.945969 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1342/2686] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:16:03.956564 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d2dce-273f-4859-ae7b-a90cdb72d260 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:03.958952 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-351d2dce-273f-4859-ae7b-a90cdb72d260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:04.019953 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d2dce-273f-4859-ae7b-a90cdb72d260 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:04.024502 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51064ea6-d9c6-45c8-bb17-05746b4695bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:04.025387 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51064ea6-d9c6-45c8-bb17-05746b4695bb service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:04.025680 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51064ea6-d9c6-45c8-bb17-05746b4695bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:04.025957 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51064ea6-d9c6-45c8-bb17-05746b4695bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:04.035973 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51064ea6-d9c6-45c8-bb17-05746b4695bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:04.037418 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51064ea6-d9c6-45c8-bb17-05746b4695bb service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:04.047046 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1345/2687] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:16:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:16:04.497090 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef94b1-2d6e-4fe0-b44e-d3bbb6df0ff1 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:04.499219 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c7ef94b1-2d6e-4fe0-b44e-d3bbb6df0ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:04.514644 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef94b1-2d6e-4fe0-b44e-d3bbb6df0ff1 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:04.520510 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b0585-1357-4cfa-bde3-21baabbb37e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:04.522314 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b0585-1357-4cfa-bde3-21baabbb37e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:04.522680 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b0585-1357-4cfa-bde3-21baabbb37e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:04.522994 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b0585-1357-4cfa-bde3-21baabbb37e1 admin admin] PATH_INFO: `/v3/projects/ca33bc9819cb418a92eaecff48bbc85c` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:04.524544 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90b0585-1357-4cfa-bde3-21baabbb37e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca33bc9819cb418a92eaecff48bbc85c)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:04.526602 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90b0585-1357-4cfa-bde3-21baabbb37e1 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:04.574686 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a90b0585-1357-4cfa-bde3-21baabbb37e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca33bc9819cb418a92eaecff48bbc85c', 'request_id': 'req-a90b0585-1357-4cfa-bde3-21baabbb37e1'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:04.583075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a90b0585-1357-4cfa-bde3-21baabbb37e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca33bc9819cb418a92eaecff48bbc85c', 'request_id': 'req-a90b0585-1357-4cfa-bde3-21baabbb37e1'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:04.589878 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a90b0585-1357-4cfa-bde3-21baabbb37e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca33bc9819cb418a92eaecff48bbc85c', 'request_id': 'req-a90b0585-1357-4cfa-bde3-21baabbb37e1'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:04.601636 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a90b0585-1357-4cfa-bde3-21baabbb37e1 admin admin] The token cache is being invalidate because project ca33bc9819cb418a92eaecff48bbc85c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:16:04.602002 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a90b0585-1357-4cfa-bde3-21baabbb37e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:04.602780 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a90b0585-1357-4cfa-bde3-21baabbb37e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:04.604645 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1343/2688] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:16:04 2022] DELETE /identity/v3/projects/ca33bc9819cb418a92eaecff48bbc85c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:16:04.609141 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51064ea6-d9c6-45c8-bb17-05746b4695bb service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:04.619318 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51064ea6-d9c6-45c8-bb17-05746b4695bb service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:04.683229 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180b1ef-a01a-465f-95f8-de3cf714cdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:04.684812 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180b1ef-a01a-465f-95f8-de3cf714cdd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:04.685249 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180b1ef-a01a-465f-95f8-de3cf714cdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:04.685712 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180b1ef-a01a-465f-95f8-de3cf714cdd6 admin admin] PATH_INFO: `/v3/users/f5dc594b7b8d4d1db7536fc115c23189` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:04.687214 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5180b1ef-a01a-465f-95f8-de3cf714cdd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5dc594b7b8d4d1db7536fc115c23189)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:04.689806 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5180b1ef-a01a-465f-95f8-de3cf714cdd6 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:04.738142 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-5180b1ef-a01a-465f-95f8-de3cf714cdd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5dc594b7b8d4d1db7536fc115c23189'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:04.745650 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-5180b1ef-a01a-465f-95f8-de3cf714cdd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5dc594b7b8d4d1db7536fc115c23189'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:04.752592 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-5180b1ef-a01a-465f-95f8-de3cf714cdd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5dc594b7b8d4d1db7536fc115c23189'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:04.753225 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-5180b1ef-a01a-465f-95f8-de3cf714cdd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5dc594b7b8d4d1db7536fc115c23189'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:04.764907 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-5180b1ef-a01a-465f-95f8-de3cf714cdd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5dc594b7b8d4d1db7536fc115c23189'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:04.771418 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1346/2689] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:16:04 2022] DELETE /identity/v3/users/f5dc594b7b8d4d1db7536fc115c23189 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:16:05.090746 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b0585-1357-4cfa-bde3-21baabbb37e1 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:05.096950 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a90b0585-1357-4cfa-bde3-21baabbb37e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:05.131096 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b0585-1357-4cfa-bde3-21baabbb37e1 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:05.214808 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e8017-38d9-40bd-8479-1728ec46cbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:05.215992 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e8017-38d9-40bd-8479-1728ec46cbbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:05.216398 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e8017-38d9-40bd-8479-1728ec46cbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:05.216794 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e8017-38d9-40bd-8479-1728ec46cbbc admin admin] PATH_INFO: `/v3/projects/c6fa1a6c868d4495be73112663dc8bed` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:05.218265 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e8017-38d9-40bd-8479-1728ec46cbbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6fa1a6c868d4495be73112663dc8bed)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:05.220484 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e8017-38d9-40bd-8479-1728ec46cbbc admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:05.279963 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fc5e8017-38d9-40bd-8479-1728ec46cbbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6fa1a6c868d4495be73112663dc8bed', 'request_id': 'req-fc5e8017-38d9-40bd-8479-1728ec46cbbc'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:05.289077 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fc5e8017-38d9-40bd-8479-1728ec46cbbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6fa1a6c868d4495be73112663dc8bed', 'request_id': 'req-fc5e8017-38d9-40bd-8479-1728ec46cbbc'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:05.294894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fc5e8017-38d9-40bd-8479-1728ec46cbbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6fa1a6c868d4495be73112663dc8bed', 'request_id': 'req-fc5e8017-38d9-40bd-8479-1728ec46cbbc'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:05.305751 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fc5e8017-38d9-40bd-8479-1728ec46cbbc admin admin] The token cache is being invalidate because project c6fa1a6c868d4495be73112663dc8bed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:16:05.306038 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fc5e8017-38d9-40bd-8479-1728ec46cbbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:05.306662 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fc5e8017-38d9-40bd-8479-1728ec46cbbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:05.308193 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1344/2690] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:16:05 2022] DELETE /identity/v3/projects/c6fa1a6c868d4495be73112663dc8bed => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:16:05.314175 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e8a48-05d6-4163-b434-4bf876b7a8ea None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:05.314467 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e8a48-05d6-4163-b434-4bf876b7a8ea None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:05.314749 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e8a48-05d6-4163-b434-4bf876b7a8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:05.332730 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-fd5e8a48-05d6-4163-b434-4bf876b7a8ea None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:05.333955 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-fd5e8a48-05d6-4163-b434-4bf876b7a8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:05.391043 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1347/2691] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:16:05.399230 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee3c91-34fd-4bd2-80a9-02e4a69b575f None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:05.399521 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee3c91-34fd-4bd2-80a9-02e4a69b575f None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:05.399805 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee3c91-34fd-4bd2-80a9-02e4a69b575f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:05.418076 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-aeee3c91-34fd-4bd2-80a9-02e4a69b575f None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:05.419340 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-aeee3c91-34fd-4bd2-80a9-02e4a69b575f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:05.427482 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1345/2692] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:16:05.431712 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e8a48-05d6-4163-b434-4bf876b7a8ea None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:05.441122 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e8a48-05d6-4163-b434-4bf876b7a8ea None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:05.448383 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789390b-d38f-481b-b1c3-9c06389b370a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:05.449613 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789390b-d38f-481b-b1c3-9c06389b370a admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:05.449613 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789390b-d38f-481b-b1c3-9c06389b370a admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:05.449862 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789390b-d38f-481b-b1c3-9c06389b370a admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:05.450509 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d789390b-d38f-481b-b1c3-9c06389b370a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:16:05.450820 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d789390b-d38f-481b-b1c3-9c06389b370a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:05.452458 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d789390b-d38f-481b-b1c3-9c06389b370a admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:05.468592 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1348/2693] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:16:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:16:05.469993 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee3c91-34fd-4bd2-80a9-02e4a69b575f None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:05.479637 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee3c91-34fd-4bd2-80a9-02e4a69b575f None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:05.485076 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859bc5a4-b836-4773-b3b5-df25ea3c4c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:05.485859 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859bc5a4-b836-4773-b3b5-df25ea3c4c95 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:05.486244 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859bc5a4-b836-4773-b3b5-df25ea3c4c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:05.486609 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859bc5a4-b836-4773-b3b5-df25ea3c4c95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:05.487378 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859bc5a4-b836-4773-b3b5-df25ea3c4c95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:05.489368 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859bc5a4-b836-4773-b3b5-df25ea3c4c95 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:05.527229 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789390b-d38f-481b-b1c3-9c06389b370a admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:05.528880 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1346/2694] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:16:05 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:16:05.533071 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859bc5a4-b836-4773-b3b5-df25ea3c4c95 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:05.534531 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-d789390b-d38f-481b-b1c3-9c06389b370a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:05.553858 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789390b-d38f-481b-b1c3-9c06389b370a admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:05.615777 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859bc5a4-b836-4773-b3b5-df25ea3c4c95 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:05.619504 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2a8c2-40fa-4006-803d-fc0416c236a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:05.620569 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2a8c2-40fa-4006-803d-fc0416c236a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:05.620851 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2a8c2-40fa-4006-803d-fc0416c236a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:05.621204 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2a8c2-40fa-4006-803d-fc0416c236a6 admin admin] PATH_INFO: `/v3/users/6922c32ea1d44dd2a3d80d0f17e363c4` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:05.622017 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92eee22-d613-47b8-bb21-8519cb75d9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:05.622570 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2a8c2-40fa-4006-803d-fc0416c236a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6922c32ea1d44dd2a3d80d0f17e363c4)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:05.622883 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92eee22-d613-47b8-bb21-8519cb75d9c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:05.624183 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92eee22-d613-47b8-bb21-8519cb75d9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:05.624568 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92eee22-d613-47b8-bb21-8519cb75d9c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:05.624690 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2a8c2-40fa-4006-803d-fc0416c236a6 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:05.625434 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92eee22-d613-47b8-bb21-8519cb75d9c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:05.627621 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92eee22-d613-47b8-bb21-8519cb75d9c9 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:05.657581 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1347/2695] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:16:05 2022] POST /identity/v3/users => generated 289 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:16:05.659975 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92eee22-d613-47b8-bb21-8519cb75d9c9 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:05.672051 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92eee22-d613-47b8-bb21-8519cb75d9c9 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:05.677631 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05cf16-3114-4b19-9af2-7815dd24f02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:05.678354 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05cf16-3114-4b19-9af2-7815dd24f02a admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:05.678760 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05cf16-3114-4b19-9af2-7815dd24f02a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:05.679126 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05cf16-3114-4b19-9af2-7815dd24f02a admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:05.679954 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa05cf16-3114-4b19-9af2-7815dd24f02a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:05.681682 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa05cf16-3114-4b19-9af2-7815dd24f02a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:05.681915 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-25a2a8c2-40fa-4006-803d-fc0416c236a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6922c32ea1d44dd2a3d80d0f17e363c4'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:05.690896 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-25a2a8c2-40fa-4006-803d-fc0416c236a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6922c32ea1d44dd2a3d80d0f17e363c4'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:05.693679 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1348/2696] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 19:16:05.697587 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05cf16-3114-4b19-9af2-7815dd24f02a admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:05.702412 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-25a2a8c2-40fa-4006-803d-fc0416c236a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6922c32ea1d44dd2a3d80d0f17e363c4'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:05.703371 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-25a2a8c2-40fa-4006-803d-fc0416c236a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6922c32ea1d44dd2a3d80d0f17e363c4'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:05.707927 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05cf16-3114-4b19-9af2-7815dd24f02a admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:05.712657 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19f417-3495-45d7-ae6e-c2bb15ae0dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:05.713741 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19f417-3495-45d7-ae6e-c2bb15ae0dcc admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:05.714122 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19f417-3495-45d7-ae6e-c2bb15ae0dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:05.714484 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19f417-3495-45d7-ae6e-c2bb15ae0dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:05.715847 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc19f417-3495-45d7-ae6e-c2bb15ae0dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:05.716783 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-25a2a8c2-40fa-4006-803d-fc0416c236a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6922c32ea1d44dd2a3d80d0f17e363c4'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:05.718071 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc19f417-3495-45d7-ae6e-c2bb15ae0dcc admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:05.723226 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1349/2697] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:16:05 2022] DELETE /identity/v3/users/6922c32ea1d44dd2a3d80d0f17e363c4 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:16:05.727998 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d01dd-69dd-41f3-ae7c-cd73684c193a None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:05.728318 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d01dd-69dd-41f3-ae7c-cd73684c193a None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:05.728596 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d01dd-69dd-41f3-ae7c-cd73684c193a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:05.735141 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1349/2698] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:16:05.738131 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19f417-3495-45d7-ae6e-c2bb15ae0dcc admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:05.739804 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-dc19f417-3495-45d7-ae6e-c2bb15ae0dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:05.747614 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-766d01dd-69dd-41f3-ae7c-cd73684c193a None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:05.748824 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-766d01dd-69dd-41f3-ae7c-cd73684c193a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:05.752983 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19f417-3495-45d7-ae6e-c2bb15ae0dcc admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:05.808827 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1350/2699] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:16:05.809767 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a0590-7d73-40a6-9fd2-f08d843aa5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:05.810682 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a0590-7d73-40a6-9fd2-f08d843aa5fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:05.810957 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a0590-7d73-40a6-9fd2-f08d843aa5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:05.811287 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a0590-7d73-40a6-9fd2-f08d843aa5fa admin admin] PATH_INFO: `/v3/projects/36cdc130dc46497d90aa41122162faa3/users/8a4e05c8cbc34cd8851cbb87fdef9756/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:05.820496 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d01dd-69dd-41f3-ae7c-cd73684c193a None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:05.821959 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-766d01dd-69dd-41f3-ae7c-cd73684c193a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:05.828639 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a0590-7d73-40a6-9fd2-f08d843aa5fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=36cdc130dc46497d90aa41122162faa3, user_id=8a4e05c8cbc34cd8851cbb87fdef9756, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:05.831636 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a0590-7d73-40a6-9fd2-f08d843aa5fa admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:05.856112 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1350/2700] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:16:05 2022] PUT /identity/v3/projects/36cdc130dc46497d90aa41122162faa3/users/8a4e05c8cbc34cd8851cbb87fdef9756/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:16:05.858072 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462edfd8-92af-44d8-8ba5-bb53ed42d1f3 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:05.858490 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462edfd8-92af-44d8-8ba5-bb53ed42d1f3 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:05.858866 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462edfd8-92af-44d8-8ba5-bb53ed42d1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:05.885154 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d01dd-69dd-41f3-ae7c-cd73684c193a None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:05.893596 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-462edfd8-92af-44d8-8ba5-bb53ed42d1f3 None None] MFA Rules not processed for user `8a4e05c8cbc34cd8851cbb87fdef9756`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:05.894834 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-462edfd8-92af-44d8-8ba5-bb53ed42d1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:05.941254 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6df7ad-f211-414e-970c-5e9080153a99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:05.941254 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6df7ad-f211-414e-970c-5e9080153a99 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:05.941254 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6df7ad-f211-414e-970c-5e9080153a99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:05.941254 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6df7ad-f211-414e-970c-5e9080153a99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:05.994152 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1351/2701] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:16:05.998682 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462edfd8-92af-44d8-8ba5-bb53ed42d1f3 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:06.016101 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6df7ad-f211-414e-970c-5e9080153a99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:06.017792 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6df7ad-f211-414e-970c-5e9080153a99 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:06.036321 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1351/2702] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:16:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 19:16:06.074451 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462edfd8-92af-44d8-8ba5-bb53ed42d1f3 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:06.088429 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7a6f2-d208-4dde-b963-53a31504df8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:06.089399 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7a6f2-d208-4dde-b963-53a31504df8a admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:06.089782 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7a6f2-d208-4dde-b963-53a31504df8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:06.090165 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7a6f2-d208-4dde-b963-53a31504df8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:06.090947 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7a6f2-d208-4dde-b963-53a31504df8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:06.092996 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7a6f2-d208-4dde-b963-53a31504df8a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:06.122787 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1352/2703] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:16:05 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:16:06.127090 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6df7ad-f211-414e-970c-5e9080153a99 service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:06.138272 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6df7ad-f211-414e-970c-5e9080153a99 service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:06.214272 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f111fd3-a9a5-4ee4-bc54-db37ee0cbc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:06.215127 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f111fd3-a9a5-4ee4-bc54-db37ee0cbc2f admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:06.215550 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f111fd3-a9a5-4ee4-bc54-db37ee0cbc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:06.215974 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f111fd3-a9a5-4ee4-bc54-db37ee0cbc2f admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:06.216772 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f111fd3-a9a5-4ee4-bc54-db37ee0cbc2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:06.218875 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f111fd3-a9a5-4ee4-bc54-db37ee0cbc2f admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:06.242421 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1352/2704] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:16:06 2022] POST /identity/v3/users => generated 289 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:16:06.247744 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7a6f2-d208-4dde-b963-53a31504df8a admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:06.260202 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7a6f2-d208-4dde-b963-53a31504df8a admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:06.265623 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ada89-2526-4acf-947e-7ba3e50b32dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:06.266122 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ada89-2526-4acf-947e-7ba3e50b32dd admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:06.266416 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ada89-2526-4acf-947e-7ba3e50b32dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:06.266696 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ada89-2526-4acf-947e-7ba3e50b32dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:06.267691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ada89-2526-4acf-947e-7ba3e50b32dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:06.269038 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ada89-2526-4acf-947e-7ba3e50b32dd admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:06.282273 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1353/2705] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:16:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:16:06.286381 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f111fd3-a9a5-4ee4-bc54-db37ee0cbc2f admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:06.298603 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f111fd3-a9a5-4ee4-bc54-db37ee0cbc2f admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:06.304180 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35098b8-78d7-48c6-bc1f-d07eaab40b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:06.304870 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35098b8-78d7-48c6-bc1f-d07eaab40b3a admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:06.305363 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35098b8-78d7-48c6-bc1f-d07eaab40b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:06.305588 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35098b8-78d7-48c6-bc1f-d07eaab40b3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:06.306339 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35098b8-78d7-48c6-bc1f-d07eaab40b3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:06.307989 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35098b8-78d7-48c6-bc1f-d07eaab40b3a admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:06.326615 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1353/2706] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:16:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:16:06.332762 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ada89-2526-4acf-947e-7ba3e50b32dd admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:06.345878 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ada89-2526-4acf-947e-7ba3e50b32dd admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:06.352993 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe8987-61f2-4972-b63f-d981a83858f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:06.355147 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe8987-61f2-4972-b63f-d981a83858f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:06.355426 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe8987-61f2-4972-b63f-d981a83858f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:06.355896 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe8987-61f2-4972-b63f-d981a83858f3 admin admin] PATH_INFO: `/v3/projects/64608d93f53a4699a77243367640c54e/users/695675a9edb943b9b09feba1f248ad9f/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:06.374714 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe8987-61f2-4972-b63f-d981a83858f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64608d93f53a4699a77243367640c54e, user_id=695675a9edb943b9b09feba1f248ad9f, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:06.377959 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe8987-61f2-4972-b63f-d981a83858f3 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:06.393626 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1354/2707] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:16:06 2022] PUT /identity/v3/projects/64608d93f53a4699a77243367640c54e/users/695675a9edb943b9b09feba1f248ad9f/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:16:06.404064 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986dfc8f-3a54-4948-b474-c4ac6eb17854 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:06.404495 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986dfc8f-3a54-4948-b474-c4ac6eb17854 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:06.405155 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986dfc8f-3a54-4948-b474-c4ac6eb17854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:06.437201 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-986dfc8f-3a54-4948-b474-c4ac6eb17854 None None] MFA Rules not processed for user `695675a9edb943b9b09feba1f248ad9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:06.438932 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-986dfc8f-3a54-4948-b474-c4ac6eb17854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:06.509258 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1354/2708] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:16:06.513780 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe8987-61f2-4972-b63f-d981a83858f3 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:06.591699 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe8987-61f2-4972-b63f-d981a83858f3 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:06.596862 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee868b-a3ea-484c-b049-1ddf39dd1387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:06.597565 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee868b-a3ea-484c-b049-1ddf39dd1387 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:06.597865 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee868b-a3ea-484c-b049-1ddf39dd1387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:06.598137 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee868b-a3ea-484c-b049-1ddf39dd1387 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:06.598851 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ee868b-a3ea-484c-b049-1ddf39dd1387 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:06.600789 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ee868b-a3ea-484c-b049-1ddf39dd1387 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:06.632532 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1355/2709] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:16:06 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:16:06.634403 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986dfc8f-3a54-4948-b474-c4ac6eb17854 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:06.649006 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986dfc8f-3a54-4948-b474-c4ac6eb17854 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:06.715170 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee868b-a3ea-484c-b049-1ddf39dd1387 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:06.716860 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d0ee868b-a3ea-484c-b049-1ddf39dd1387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:06.718410 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df6ab5-c9b8-4f18-84ec-6c80eed9f544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:06.719420 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df6ab5-c9b8-4f18-84ec-6c80eed9f544 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:06.719862 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df6ab5-c9b8-4f18-84ec-6c80eed9f544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:06.720442 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df6ab5-c9b8-4f18-84ec-6c80eed9f544 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:06.721415 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7df6ab5-c9b8-4f18-84ec-6c80eed9f544 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:06.723941 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7df6ab5-c9b8-4f18-84ec-6c80eed9f544 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:06.730905 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee868b-a3ea-484c-b049-1ddf39dd1387 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:06.748261 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d49827-6f19-4170-b286-5f06d30d4520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:06.750049 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d49827-6f19-4170-b286-5f06d30d4520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:06.750436 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d49827-6f19-4170-b286-5f06d30d4520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:06.750898 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d49827-6f19-4170-b286-5f06d30d4520 admin admin] PATH_INFO: `/v3/projects/92edc6236ec34f369cd0ed8a395e8d86` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:06.752635 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d49827-6f19-4170-b286-5f06d30d4520 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92edc6236ec34f369cd0ed8a395e8d86)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:06.755199 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d49827-6f19-4170-b286-5f06d30d4520 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:06.758524 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1355/2710] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:16:06 2022] POST /identity/v3/users => generated 296 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:16:06.759514 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df6ab5-c9b8-4f18-84ec-6c80eed9f544 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:06.770589 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df6ab5-c9b8-4f18-84ec-6c80eed9f544 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:06.775388 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9433aa-8695-4004-b22d-90b2298cb160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:06.776071 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9433aa-8695-4004-b22d-90b2298cb160 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:06.776352 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9433aa-8695-4004-b22d-90b2298cb160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:06.776670 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9433aa-8695-4004-b22d-90b2298cb160 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:06.777806 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9433aa-8695-4004-b22d-90b2298cb160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:06.779319 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9433aa-8695-4004-b22d-90b2298cb160 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:06.796047 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1356/2711] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:16:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 19:16:06.797970 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9433aa-8695-4004-b22d-90b2298cb160 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:06.808252 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9433aa-8695-4004-b22d-90b2298cb160 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:06.813275 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1afa7-7866-4b74-bb08-e5733c44e8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:06.814200 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1afa7-7866-4b74-bb08-e5733c44e8f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:06.814519 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1afa7-7866-4b74-bb08-e5733c44e8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:06.814910 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1afa7-7866-4b74-bb08-e5733c44e8f6 admin admin] PATH_INFO: `/v3/projects/25ce698baac94c95acc31de2737189b6/users/7447513ef6514b0aa15bff96d6cae1a5/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:06.830194 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc1afa7-7866-4b74-bb08-e5733c44e8f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25ce698baac94c95acc31de2737189b6, user_id=7447513ef6514b0aa15bff96d6cae1a5, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:06.832883 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc1afa7-7866-4b74-bb08-e5733c44e8f6 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:06.839943 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f5d49827-6f19-4170-b286-5f06d30d4520 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92edc6236ec34f369cd0ed8a395e8d86', 'request_id': 'req-f5d49827-6f19-4170-b286-5f06d30d4520'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:06.848025 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f5d49827-6f19-4170-b286-5f06d30d4520 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92edc6236ec34f369cd0ed8a395e8d86', 'request_id': 'req-f5d49827-6f19-4170-b286-5f06d30d4520'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:06.848444 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1357/2712] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:16:06 2022] PUT /identity/v3/projects/25ce698baac94c95acc31de2737189b6/users/7447513ef6514b0aa15bff96d6cae1a5/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:16:06.852831 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1afa7-7866-4b74-bb08-e5733c44e8f6 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:06.854828 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f5d49827-6f19-4170-b286-5f06d30d4520 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92edc6236ec34f369cd0ed8a395e8d86', 'request_id': 'req-f5d49827-6f19-4170-b286-5f06d30d4520'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:06.866489 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f5d49827-6f19-4170-b286-5f06d30d4520 admin admin] The token cache is being invalidate because project 92edc6236ec34f369cd0ed8a395e8d86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:16:06.866777 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f5d49827-6f19-4170-b286-5f06d30d4520 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:06.867452 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f5d49827-6f19-4170-b286-5f06d30d4520 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:06.869041 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1356/2713] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:16:06 2022] DELETE /identity/v3/projects/92edc6236ec34f369cd0ed8a395e8d86 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:16:06.934357 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1afa7-7866-4b74-bb08-e5733c44e8f6 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:06.939363 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eefaeda-3b4e-44ad-9477-fbdedbfb1e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:06.940069 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefaeda-3b4e-44ad-9477-fbdedbfb1e3f admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:06.940347 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefaeda-3b4e-44ad-9477-fbdedbfb1e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:06.940618 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefaeda-3b4e-44ad-9477-fbdedbfb1e3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:06.941416 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eefaeda-3b4e-44ad-9477-fbdedbfb1e3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:06.943449 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eefaeda-3b4e-44ad-9477-fbdedbfb1e3f admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:06.955221 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1358/2714] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:16:06 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:16:06.960207 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d49827-6f19-4170-b286-5f06d30d4520 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:06.961780 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f5d49827-6f19-4170-b286-5f06d30d4520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:07.040133 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d49827-6f19-4170-b286-5f06d30d4520 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:07.046797 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968238c-7a14-41d3-a258-0db6467f73ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:07.047719 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968238c-7a14-41d3-a258-0db6467f73ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:07.048332 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968238c-7a14-41d3-a258-0db6467f73ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:07.048332 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968238c-7a14-41d3-a258-0db6467f73ab admin admin] PATH_INFO: `/v3/projects/25ce698baac94c95acc31de2737189b6/users/7447513ef6514b0aa15bff96d6cae1a5/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:07.050302 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968238c-7a14-41d3-a258-0db6467f73ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=25ce698baac94c95acc31de2737189b6, user_id=7447513ef6514b0aa15bff96d6cae1a5, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:07.053023 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968238c-7a14-41d3-a258-0db6467f73ab admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:07.065203 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1357/2715] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:16:06 2022] PUT /identity/v3/projects/25ce698baac94c95acc31de2737189b6/users/7447513ef6514b0aa15bff96d6cae1a5/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:16:07.076427 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c6c3b-0c98-4d80-bb3d-6b3689a02caa None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:07.076858 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c6c3b-0c98-4d80-bb3d-6b3689a02caa None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:07.077218 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c6c3b-0c98-4d80-bb3d-6b3689a02caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:07.107444 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-2b7c6c3b-0c98-4d80-bb3d-6b3689a02caa None None] MFA Rules not processed for user `7447513ef6514b0aa15bff96d6cae1a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:07.109318 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-2b7c6c3b-0c98-4d80-bb3d-6b3689a02caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:07.185394 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1359/2716] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:07 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:16:07.197171 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968238c-7a14-41d3-a258-0db6467f73ab admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:07.199470 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3968238c-7a14-41d3-a258-0db6467f73ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:07.259355 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968238c-7a14-41d3-a258-0db6467f73ab admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:07.263232 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861f1bd-263c-47d8-8f0d-2fc58b98cd1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:07.263899 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861f1bd-263c-47d8-8f0d-2fc58b98cd1c service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:07.264162 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861f1bd-263c-47d8-8f0d-2fc58b98cd1c service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:07.264434 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861f1bd-263c-47d8-8f0d-2fc58b98cd1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:07.274841 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861f1bd-263c-47d8-8f0d-2fc58b98cd1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:07.276359 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861f1bd-263c-47d8-8f0d-2fc58b98cd1c service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:07.286471 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1358/2717] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:16:07 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:16:07.328596 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c6c3b-0c98-4d80-bb3d-6b3689a02caa None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:07.330226 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-2b7c6c3b-0c98-4d80-bb3d-6b3689a02caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:07.342570 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c6c3b-0c98-4d80-bb3d-6b3689a02caa None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:07.346800 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb648330-aac1-4f3c-b665-cc189e121c20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:07.347433 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb648330-aac1-4f3c-b665-cc189e121c20 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:07.347710 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb648330-aac1-4f3c-b665-cc189e121c20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:07.347974 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb648330-aac1-4f3c-b665-cc189e121c20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:07.349995 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-bb648330-aac1-4f3c-b665-cc189e121c20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:07.409381 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb648330-aac1-4f3c-b665-cc189e121c20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:07.410869 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb648330-aac1-4f3c-b665-cc189e121c20 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:07.420126 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1360/2718] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:16:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:16:09.391976 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861f1bd-263c-47d8-8f0d-2fc58b98cd1c service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:09.393626 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9861f1bd-263c-47d8-8f0d-2fc58b98cd1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:09.452087 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861f1bd-263c-47d8-8f0d-2fc58b98cd1c service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:09.456116 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd1a5d-7731-4ed1-b239-d6c900205d8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:09.456791 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd1a5d-7731-4ed1-b239-d6c900205d8a service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:09.457100 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd1a5d-7731-4ed1-b239-d6c900205d8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:09.457374 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd1a5d-7731-4ed1-b239-d6c900205d8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:09.459402 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-24cd1a5d-7731-4ed1-b239-d6c900205d8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:09.521244 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd1a5d-7731-4ed1-b239-d6c900205d8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:09.522721 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd1a5d-7731-4ed1-b239-d6c900205d8a service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:09.532607 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1359/2719] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:16:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:16:10.327608 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb648330-aac1-4f3c-b665-cc189e121c20 service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:10.339967 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb648330-aac1-4f3c-b665-cc189e121c20 service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:10.345110 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e3d23-52a8-474f-b651-95de01fef913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:10.346008 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e3d23-52a8-474f-b651-95de01fef913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:10.346292 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e3d23-52a8-474f-b651-95de01fef913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:10.346564 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e3d23-52a8-474f-b651-95de01fef913 admin admin] PATH_INFO: `/v3/users/8a4e05c8cbc34cd8851cbb87fdef9756` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:10.347785 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e3d23-52a8-474f-b651-95de01fef913 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a4e05c8cbc34cd8851cbb87fdef9756)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:10.349775 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e3d23-52a8-474f-b651-95de01fef913 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:10.397563 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-2c2e3d23-52a8-474f-b651-95de01fef913 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a4e05c8cbc34cd8851cbb87fdef9756'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:10.405938 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-2c2e3d23-52a8-474f-b651-95de01fef913 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a4e05c8cbc34cd8851cbb87fdef9756'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:10.412885 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-2c2e3d23-52a8-474f-b651-95de01fef913 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a4e05c8cbc34cd8851cbb87fdef9756'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:10.413659 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-2c2e3d23-52a8-474f-b651-95de01fef913 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a4e05c8cbc34cd8851cbb87fdef9756'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:10.426665 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-2c2e3d23-52a8-474f-b651-95de01fef913 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a4e05c8cbc34cd8851cbb87fdef9756'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:10.433497 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1361/2720] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:16:10 2022] DELETE /identity/v3/users/8a4e05c8cbc34cd8851cbb87fdef9756 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:16:10.438219 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27769960-cd8f-4fca-840c-f2d6531e9764 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:10.438720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27769960-cd8f-4fca-840c-f2d6531e9764 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:10.438837 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27769960-cd8f-4fca-840c-f2d6531e9764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:10.456576 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-27769960-cd8f-4fca-840c-f2d6531e9764 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:10.461250 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-27769960-cd8f-4fca-840c-f2d6531e9764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:10.527545 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1360/2721] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:16:10.537749 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e3d23-52a8-474f-b651-95de01fef913 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:10.539188 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-2c2e3d23-52a8-474f-b651-95de01fef913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:10.600013 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e3d23-52a8-474f-b651-95de01fef913 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:10.603590 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25d79f-ba8a-456c-b78f-a375e0f7165e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:10.604260 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25d79f-ba8a-456c-b78f-a375e0f7165e service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:10.604542 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25d79f-ba8a-456c-b78f-a375e0f7165e service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:10.604817 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25d79f-ba8a-456c-b78f-a375e0f7165e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:10.614819 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25d79f-ba8a-456c-b78f-a375e0f7165e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:10.616291 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25d79f-ba8a-456c-b78f-a375e0f7165e service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:10.627001 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1362/2722] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:16:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:16:10.896100 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27769960-cd8f-4fca-840c-f2d6531e9764 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:10.897898 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-27769960-cd8f-4fca-840c-f2d6531e9764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:10.911577 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27769960-cd8f-4fca-840c-f2d6531e9764 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:10.917237 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b185f9-967d-42db-8b95-d0204dda3ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:10.918159 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b185f9-967d-42db-8b95-d0204dda3ed1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:10.918451 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b185f9-967d-42db-8b95-d0204dda3ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:10.918706 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b185f9-967d-42db-8b95-d0204dda3ed1 admin admin] PATH_INFO: `/v3/projects/36cdc130dc46497d90aa41122162faa3` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:10.920217 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b185f9-967d-42db-8b95-d0204dda3ed1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36cdc130dc46497d90aa41122162faa3)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:10.922285 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b185f9-967d-42db-8b95-d0204dda3ed1 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:10.969112 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a3b185f9-967d-42db-8b95-d0204dda3ed1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36cdc130dc46497d90aa41122162faa3', 'request_id': 'req-a3b185f9-967d-42db-8b95-d0204dda3ed1'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:10.980713 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a3b185f9-967d-42db-8b95-d0204dda3ed1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36cdc130dc46497d90aa41122162faa3', 'request_id': 'req-a3b185f9-967d-42db-8b95-d0204dda3ed1'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:10.988008 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a3b185f9-967d-42db-8b95-d0204dda3ed1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36cdc130dc46497d90aa41122162faa3', 'request_id': 'req-a3b185f9-967d-42db-8b95-d0204dda3ed1'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:11.000422 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a3b185f9-967d-42db-8b95-d0204dda3ed1 admin admin] The token cache is being invalidate because project 36cdc130dc46497d90aa41122162faa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:16:11.001164 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a3b185f9-967d-42db-8b95-d0204dda3ed1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:11.002076 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a3b185f9-967d-42db-8b95-d0204dda3ed1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:11.004163 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1361/2723] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:16:10 2022] DELETE /identity/v3/projects/36cdc130dc46497d90aa41122162faa3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:16:11.008276 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25d79f-ba8a-456c-b78f-a375e0f7165e service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:11.020791 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25d79f-ba8a-456c-b78f-a375e0f7165e service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:11.081733 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2e990-02c3-4f88-86e7-29497ce2df69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:11.084392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2e990-02c3-4f88-86e7-29497ce2df69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:11.084759 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2e990-02c3-4f88-86e7-29497ce2df69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:11.085110 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2e990-02c3-4f88-86e7-29497ce2df69 admin admin] PATH_INFO: `/v3/users/695675a9edb943b9b09feba1f248ad9f` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:11.086538 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b2e990-02c3-4f88-86e7-29497ce2df69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=695675a9edb943b9b09feba1f248ad9f)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:11.088597 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b2e990-02c3-4f88-86e7-29497ce2df69 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:11.140637 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a8b2e990-02c3-4f88-86e7-29497ce2df69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '695675a9edb943b9b09feba1f248ad9f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:11.150410 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a8b2e990-02c3-4f88-86e7-29497ce2df69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '695675a9edb943b9b09feba1f248ad9f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:11.162320 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a8b2e990-02c3-4f88-86e7-29497ce2df69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '695675a9edb943b9b09feba1f248ad9f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:11.162320 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a8b2e990-02c3-4f88-86e7-29497ce2df69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '695675a9edb943b9b09feba1f248ad9f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:11.174311 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a8b2e990-02c3-4f88-86e7-29497ce2df69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '695675a9edb943b9b09feba1f248ad9f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:11.182108 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1363/2724] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:16:11 2022] DELETE /identity/v3/users/695675a9edb943b9b09feba1f248ad9f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:16:11.468673 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b185f9-967d-42db-8b95-d0204dda3ed1 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:11.470996 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a3b185f9-967d-42db-8b95-d0204dda3ed1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:11.512884 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b185f9-967d-42db-8b95-d0204dda3ed1 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:11.588652 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455f0b3-5dc5-4bb4-94c9-0549ce2c10f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:11.589556 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455f0b3-5dc5-4bb4-94c9-0549ce2c10f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:11.589848 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455f0b3-5dc5-4bb4-94c9-0549ce2c10f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:11.590119 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455f0b3-5dc5-4bb4-94c9-0549ce2c10f2 admin admin] PATH_INFO: `/v3/projects/64608d93f53a4699a77243367640c54e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:11.591275 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455f0b3-5dc5-4bb4-94c9-0549ce2c10f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64608d93f53a4699a77243367640c54e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:11.593330 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455f0b3-5dc5-4bb4-94c9-0549ce2c10f2 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:11.639361 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f455f0b3-5dc5-4bb4-94c9-0549ce2c10f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64608d93f53a4699a77243367640c54e', 'request_id': 'req-f455f0b3-5dc5-4bb4-94c9-0549ce2c10f2'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:11.648007 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f455f0b3-5dc5-4bb4-94c9-0549ce2c10f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64608d93f53a4699a77243367640c54e', 'request_id': 'req-f455f0b3-5dc5-4bb4-94c9-0549ce2c10f2'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:11.653287 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f455f0b3-5dc5-4bb4-94c9-0549ce2c10f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64608d93f53a4699a77243367640c54e', 'request_id': 'req-f455f0b3-5dc5-4bb4-94c9-0549ce2c10f2'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:11.663988 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f455f0b3-5dc5-4bb4-94c9-0549ce2c10f2 admin admin] The token cache is being invalidate because project 64608d93f53a4699a77243367640c54e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:16:11.664238 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f455f0b3-5dc5-4bb4-94c9-0549ce2c10f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:11.664853 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f455f0b3-5dc5-4bb4-94c9-0549ce2c10f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:11.666464 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1362/2725] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:16:11 2022] DELETE /identity/v3/projects/64608d93f53a4699a77243367640c54e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:16:11.670592 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2e990-02c3-4f88-86e7-29497ce2df69 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:11.672031 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a8b2e990-02c3-4f88-86e7-29497ce2df69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:11.684305 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2e990-02c3-4f88-86e7-29497ce2df69 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:11.744275 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7ab72-0eca-4705-842d-2fc4159f8744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:11.745554 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7ab72-0eca-4705-842d-2fc4159f8744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:11.746063 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7ab72-0eca-4705-842d-2fc4159f8744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:11.746552 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7ab72-0eca-4705-842d-2fc4159f8744 admin admin] PATH_INFO: `/v3/users/7447513ef6514b0aa15bff96d6cae1a5` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:11.748026 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7ab72-0eca-4705-842d-2fc4159f8744 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7447513ef6514b0aa15bff96d6cae1a5)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:11.750235 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7ab72-0eca-4705-842d-2fc4159f8744 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:11.803477 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-6ab7ab72-0eca-4705-842d-2fc4159f8744 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7447513ef6514b0aa15bff96d6cae1a5'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:11.811516 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-6ab7ab72-0eca-4705-842d-2fc4159f8744 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7447513ef6514b0aa15bff96d6cae1a5'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:11.819187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-6ab7ab72-0eca-4705-842d-2fc4159f8744 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7447513ef6514b0aa15bff96d6cae1a5'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:11.819999 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-6ab7ab72-0eca-4705-842d-2fc4159f8744 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7447513ef6514b0aa15bff96d6cae1a5'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:11.833627 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-6ab7ab72-0eca-4705-842d-2fc4159f8744 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7447513ef6514b0aa15bff96d6cae1a5'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:11.852485 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1364/2726] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:16:11 2022] DELETE /identity/v3/users/7447513ef6514b0aa15bff96d6cae1a5 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:16:12.330458 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455f0b3-5dc5-4bb4-94c9-0549ce2c10f2 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:12.331878 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f455f0b3-5dc5-4bb4-94c9-0549ce2c10f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:12.346535 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455f0b3-5dc5-4bb4-94c9-0549ce2c10f2 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:12.420987 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39a85c-5084-4f90-beb5-17f49be79432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:12.421928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39a85c-5084-4f90-beb5-17f49be79432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:12.422224 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39a85c-5084-4f90-beb5-17f49be79432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:12.422504 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39a85c-5084-4f90-beb5-17f49be79432 admin admin] PATH_INFO: `/v3/projects/25ce698baac94c95acc31de2737189b6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:12.423888 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39a85c-5084-4f90-beb5-17f49be79432 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25ce698baac94c95acc31de2737189b6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:12.425985 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39a85c-5084-4f90-beb5-17f49be79432 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:12.483585 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1a39a85c-5084-4f90-beb5-17f49be79432 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25ce698baac94c95acc31de2737189b6', 'request_id': 'req-1a39a85c-5084-4f90-beb5-17f49be79432'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:12.492983 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1a39a85c-5084-4f90-beb5-17f49be79432 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25ce698baac94c95acc31de2737189b6', 'request_id': 'req-1a39a85c-5084-4f90-beb5-17f49be79432'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:12.504348 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1a39a85c-5084-4f90-beb5-17f49be79432 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25ce698baac94c95acc31de2737189b6', 'request_id': 'req-1a39a85c-5084-4f90-beb5-17f49be79432'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:12.523027 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1a39a85c-5084-4f90-beb5-17f49be79432 admin admin] The token cache is being invalidate because project 25ce698baac94c95acc31de2737189b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:16:12.523295 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1a39a85c-5084-4f90-beb5-17f49be79432 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:12.523999 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1a39a85c-5084-4f90-beb5-17f49be79432 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:12.525663 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1363/2727] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:16:12 2022] DELETE /identity/v3/projects/25ce698baac94c95acc31de2737189b6 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:16:12.531850 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b2a77-c2c4-4b51-bb9e-d4f0e3ffa15f None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:12.532241 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b2a77-c2c4-4b51-bb9e-d4f0e3ffa15f None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:12.532554 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b2a77-c2c4-4b51-bb9e-d4f0e3ffa15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:12.560490 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-be9b2a77-c2c4-4b51-bb9e-d4f0e3ffa15f None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:12.561879 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-be9b2a77-c2c4-4b51-bb9e-d4f0e3ffa15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:12.646146 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1365/2728] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:16:12.655215 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceee3ba-5216-40b9-bd84-6f7d7429546d None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:12.655488 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceee3ba-5216-40b9-bd84-6f7d7429546d None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:12.655757 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceee3ba-5216-40b9-bd84-6f7d7429546d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:12.675889 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-3ceee3ba-5216-40b9-bd84-6f7d7429546d None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:12.677466 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3ceee3ba-5216-40b9-bd84-6f7d7429546d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:12.686174 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1364/2729] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:16:12.690786 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b2a77-c2c4-4b51-bb9e-d4f0e3ffa15f None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:12.701302 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b2a77-c2c4-4b51-bb9e-d4f0e3ffa15f None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:12.706337 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d5d02-4e0f-4708-b954-33fc19286871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:12.707149 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d5d02-4e0f-4708-b954-33fc19286871 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:12.707517 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d5d02-4e0f-4708-b954-33fc19286871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:12.708114 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d5d02-4e0f-4708-b954-33fc19286871 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:12.708984 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d5d02-4e0f-4708-b954-33fc19286871 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:16:12.709302 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d5d02-4e0f-4708-b954-33fc19286871 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:12.711153 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d5d02-4e0f-4708-b954-33fc19286871 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:12.725120 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1366/2730] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:16:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:16:12.730334 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceee3ba-5216-40b9-bd84-6f7d7429546d None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:12.739968 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceee3ba-5216-40b9-bd84-6f7d7429546d None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:12.744783 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2154e2e-deda-4bb5-aa3f-126d1c26c47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:12.745464 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2154e2e-deda-4bb5-aa3f-126d1c26c47f admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:12.745778 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2154e2e-deda-4bb5-aa3f-126d1c26c47f admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:12.746057 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2154e2e-deda-4bb5-aa3f-126d1c26c47f admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:12.746763 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2154e2e-deda-4bb5-aa3f-126d1c26c47f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:12.748744 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2154e2e-deda-4bb5-aa3f-126d1c26c47f admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:12.779328 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1365/2731] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:16:12 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:16:12.783672 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d5d02-4e0f-4708-b954-33fc19286871 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:12.793935 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d5d02-4e0f-4708-b954-33fc19286871 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:12.865302 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93593043-2ae3-44f2-b7a0-4cf0470809a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:12.865833 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93593043-2ae3-44f2-b7a0-4cf0470809a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:12.866134 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93593043-2ae3-44f2-b7a0-4cf0470809a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:12.866414 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93593043-2ae3-44f2-b7a0-4cf0470809a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:12.867127 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93593043-2ae3-44f2-b7a0-4cf0470809a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:12.869081 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93593043-2ae3-44f2-b7a0-4cf0470809a3 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:12.889184 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1367/2732] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:16:12 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:16:12.894184 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2154e2e-deda-4bb5-aa3f-126d1c26c47f admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:12.905415 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2154e2e-deda-4bb5-aa3f-126d1c26c47f admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:12.914234 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959dca0-26c5-4dd2-805c-3ac746c2f205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:12.915030 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959dca0-26c5-4dd2-805c-3ac746c2f205 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:12.915489 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959dca0-26c5-4dd2-805c-3ac746c2f205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:12.915766 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959dca0-26c5-4dd2-805c-3ac746c2f205 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:12.916501 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959dca0-26c5-4dd2-805c-3ac746c2f205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:12.918146 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959dca0-26c5-4dd2-805c-3ac746c2f205 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:12.928934 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1366/2733] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 19:16:12.933053 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93593043-2ae3-44f2-b7a0-4cf0470809a3 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:12.943481 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93593043-2ae3-44f2-b7a0-4cf0470809a3 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:12.948174 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72b9e0-6c70-4182-a152-089400b2bb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:12.948845 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72b9e0-6c70-4182-a152-089400b2bb31 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:12.949126 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72b9e0-6c70-4182-a152-089400b2bb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:12.949403 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72b9e0-6c70-4182-a152-089400b2bb31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:12.950257 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e72b9e0-6c70-4182-a152-089400b2bb31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:12.951967 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e72b9e0-6c70-4182-a152-089400b2bb31 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:12.964125 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1368/2734] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:16:12.969152 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959dca0-26c5-4dd2-805c-3ac746c2f205 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:12.979105 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959dca0-26c5-4dd2-805c-3ac746c2f205 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:12.984406 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab6a9e-f674-426c-bc7d-cba7ffb2c6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:12.985302 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab6a9e-f674-426c-bc7d-cba7ffb2c6aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:12.985612 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab6a9e-f674-426c-bc7d-cba7ffb2c6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:12.985886 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab6a9e-f674-426c-bc7d-cba7ffb2c6aa admin admin] PATH_INFO: `/v3/projects/69aeb06d65c84d5bb3a75abeb91681b6/users/7ab77340ecef4a609dede2b1a479c8bf/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:13.000496 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab6a9e-f674-426c-bc7d-cba7ffb2c6aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=69aeb06d65c84d5bb3a75abeb91681b6, user_id=7ab77340ecef4a609dede2b1a479c8bf, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:13.003208 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab6a9e-f674-426c-bc7d-cba7ffb2c6aa admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:13.019749 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1367/2735] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:16:12 2022] PUT /identity/v3/projects/69aeb06d65c84d5bb3a75abeb91681b6/users/7ab77340ecef4a609dede2b1a479c8bf/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:16:13.034581 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486537a7-cc70-4dee-9fbd-350c8886276c None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:13.035018 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486537a7-cc70-4dee-9fbd-350c8886276c None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:13.035739 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486537a7-cc70-4dee-9fbd-350c8886276c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:13.042141 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab6a9e-f674-426c-bc7d-cba7ffb2c6aa admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:13.044859 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-dbab6a9e-f674-426c-bc7d-cba7ffb2c6aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:13.067542 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-486537a7-cc70-4dee-9fbd-350c8886276c None None] MFA Rules not processed for user `7ab77340ecef4a609dede2b1a479c8bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:13.068758 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-486537a7-cc70-4dee-9fbd-350c8886276c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:13.109511 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab6a9e-f674-426c-bc7d-cba7ffb2c6aa admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:13.114630 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed56922f-44df-4a1e-bafd-72f8372d0b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:13.115531 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56922f-44df-4a1e-bafd-72f8372d0b2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:13.115815 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56922f-44df-4a1e-bafd-72f8372d0b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:13.116084 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56922f-44df-4a1e-bafd-72f8372d0b2f admin admin] PATH_INFO: `/v3/users/661228875e4d4c60a558656b46ea650b` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:13.117272 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed56922f-44df-4a1e-bafd-72f8372d0b2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=661228875e4d4c60a558656b46ea650b)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:13.119240 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed56922f-44df-4a1e-bafd-72f8372d0b2f admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:13.136829 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1369/2736] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:16:13.141591 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486537a7-cc70-4dee-9fbd-350c8886276c None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:13.154438 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486537a7-cc70-4dee-9fbd-350c8886276c None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:13.166296 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a36ee9-ab39-4b69-970d-9dc460f79a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:13.167277 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a36ee9-ab39-4b69-970d-9dc460f79a5a admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:13.167923 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a36ee9-ab39-4b69-970d-9dc460f79a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:13.168328 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a36ee9-ab39-4b69-970d-9dc460f79a5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:13.170073 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a36ee9-ab39-4b69-970d-9dc460f79a5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:13.172628 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a36ee9-ab39-4b69-970d-9dc460f79a5a admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:13.178444 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ed56922f-44df-4a1e-bafd-72f8372d0b2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '661228875e4d4c60a558656b46ea650b'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:13.189054 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ed56922f-44df-4a1e-bafd-72f8372d0b2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '661228875e4d4c60a558656b46ea650b'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:13.196300 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ed56922f-44df-4a1e-bafd-72f8372d0b2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '661228875e4d4c60a558656b46ea650b'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:13.199740 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1370/2737] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:16:13 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:16:13.204439 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a36ee9-ab39-4b69-970d-9dc460f79a5a admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:13.211116 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ed56922f-44df-4a1e-bafd-72f8372d0b2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '661228875e4d4c60a558656b46ea650b'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:13.212271 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ed56922f-44df-4a1e-bafd-72f8372d0b2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '661228875e4d4c60a558656b46ea650b'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:13.219438 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1368/2738] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:16:13 2022] DELETE /identity/v3/users/661228875e4d4c60a558656b46ea650b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:16:13.267129 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a36ee9-ab39-4b69-970d-9dc460f79a5a admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:13.323945 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f2876-dc67-4504-a7cf-a5bbe829cf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:13.324684 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f2876-dc67-4504-a7cf-a5bbe829cf54 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:13.324967 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f2876-dc67-4504-a7cf-a5bbe829cf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:13.325240 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f2876-dc67-4504-a7cf-a5bbe829cf54 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:13.326039 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f2876-dc67-4504-a7cf-a5bbe829cf54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:13.328001 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f2876-dc67-4504-a7cf-a5bbe829cf54 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:13.349309 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1371/2739] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:16:13 2022] POST /identity/v3/users => generated 289 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:16:13.353569 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed56922f-44df-4a1e-bafd-72f8372d0b2f admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:13.355276 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ed56922f-44df-4a1e-bafd-72f8372d0b2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:13.368815 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed56922f-44df-4a1e-bafd-72f8372d0b2f admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:13.376687 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaaa9bd-56bb-459b-a7c6-7c2089481e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:13.377387 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaaa9bd-56bb-459b-a7c6-7c2089481e4a admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:13.377710 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaaa9bd-56bb-459b-a7c6-7c2089481e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:13.378003 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaaa9bd-56bb-459b-a7c6-7c2089481e4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:13.378874 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaaa9bd-56bb-459b-a7c6-7c2089481e4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:13.380576 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaaa9bd-56bb-459b-a7c6-7c2089481e4a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:13.392013 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f2876-dc67-4504-a7cf-a5bbe829cf54 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:13.392907 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1369/2740] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 19:16:13.396639 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaaa9bd-56bb-459b-a7c6-7c2089481e4a admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:13.396781 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-849f2876-dc67-4504-a7cf-a5bbe829cf54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:13.409024 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f2876-dc67-4504-a7cf-a5bbe829cf54 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:13.413891 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f2b986-558e-486e-9b17-c79278aecb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:13.414774 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2b986-558e-486e-9b17-c79278aecb47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:13.415075 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2b986-558e-486e-9b17-c79278aecb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:13.415328 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2b986-558e-486e-9b17-c79278aecb47 admin admin] PATH_INFO: `/v3/projects/70432660a05b4b169939f7048c545bfc` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:13.416736 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f2b986-558e-486e-9b17-c79278aecb47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70432660a05b4b169939f7048c545bfc)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:13.418378 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaaa9bd-56bb-459b-a7c6-7c2089481e4a admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:13.418613 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f2b986-558e-486e-9b17-c79278aecb47 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:13.423539 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025b6ce-e717-49ab-9eaa-a32abeb9c9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:13.424206 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025b6ce-e717-49ab-9eaa-a32abeb9c9ed admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:13.424690 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025b6ce-e717-49ab-9eaa-a32abeb9c9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:13.424942 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025b6ce-e717-49ab-9eaa-a32abeb9c9ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:13.425759 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025b6ce-e717-49ab-9eaa-a32abeb9c9ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:13.427345 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025b6ce-e717-49ab-9eaa-a32abeb9c9ed admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:13.437865 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1370/2741] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:16:13.441931 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025b6ce-e717-49ab-9eaa-a32abeb9c9ed admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:13.452333 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025b6ce-e717-49ab-9eaa-a32abeb9c9ed admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:13.457006 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672260f-c8e5-4f86-8cc6-c233797c06f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:13.457926 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672260f-c8e5-4f86-8cc6-c233797c06f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:13.458204 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672260f-c8e5-4f86-8cc6-c233797c06f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:13.458470 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672260f-c8e5-4f86-8cc6-c233797c06f1 admin admin] PATH_INFO: `/v3/projects/b9692869c62845efb9427e5b2ab722e6/users/a2e19616bd474bb49cb5a62932ebd9ad/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:13.467597 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-08f2b986-558e-486e-9b17-c79278aecb47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70432660a05b4b169939f7048c545bfc', 'request_id': 'req-08f2b986-558e-486e-9b17-c79278aecb47'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:13.472887 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672260f-c8e5-4f86-8cc6-c233797c06f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9692869c62845efb9427e5b2ab722e6, user_id=a2e19616bd474bb49cb5a62932ebd9ad, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:13.473019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-08f2b986-558e-486e-9b17-c79278aecb47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70432660a05b4b169939f7048c545bfc', 'request_id': 'req-08f2b986-558e-486e-9b17-c79278aecb47'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:13.475535 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672260f-c8e5-4f86-8cc6-c233797c06f1 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:13.480766 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-08f2b986-558e-486e-9b17-c79278aecb47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70432660a05b4b169939f7048c545bfc', 'request_id': 'req-08f2b986-558e-486e-9b17-c79278aecb47'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:13.489891 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1371/2742] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:16:13 2022] PUT /identity/v3/projects/b9692869c62845efb9427e5b2ab722e6/users/a2e19616bd474bb49cb5a62932ebd9ad/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:16:13.492734 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-08f2b986-558e-486e-9b17-c79278aecb47 admin admin] The token cache is being invalidate because project 70432660a05b4b169939f7048c545bfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:16:13.493022 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-08f2b986-558e-486e-9b17-c79278aecb47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:13.493681 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-08f2b986-558e-486e-9b17-c79278aecb47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:13.495242 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1372/2743] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:16:13 2022] DELETE /identity/v3/projects/70432660a05b4b169939f7048c545bfc => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:16:13.500096 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724e1f2-39e9-4957-b065-2ede07c353a0 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:13.500385 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724e1f2-39e9-4957-b065-2ede07c353a0 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:13.500751 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724e1f2-39e9-4957-b065-2ede07c353a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:13.500986 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc827e3-fe34-40fd-95ad-202f3cd3e0b1 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:13.501121 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc827e3-fe34-40fd-95ad-202f3cd3e0b1 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:13.501393 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc827e3-fe34-40fd-95ad-202f3cd3e0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:13.519468 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-3dc827e3-fe34-40fd-95ad-202f3cd3e0b1 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:13.520670 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-3dc827e3-fe34-40fd-95ad-202f3cd3e0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:13.526749 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-a724e1f2-39e9-4957-b065-2ede07c353a0 None None] MFA Rules not processed for user `a2e19616bd474bb49cb5a62932ebd9ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:13.527903 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a724e1f2-39e9-4957-b065-2ede07c353a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:13.579133 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1373/2744] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:16:13.586787 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e48ec5-0f5a-40dc-bcb4-81a02e40d4f5 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:13.587075 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e48ec5-0f5a-40dc-bcb4-81a02e40d4f5 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:13.587339 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e48ec5-0f5a-40dc-bcb4-81a02e40d4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:13.590741 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1372/2745] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:16:13.595191 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724e1f2-39e9-4957-b065-2ede07c353a0 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:13.596489 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a724e1f2-39e9-4957-b065-2ede07c353a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:13.605108 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-a3e48ec5-0f5a-40dc-bcb4-81a02e40d4f5 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:13.606300 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a3e48ec5-0f5a-40dc-bcb4-81a02e40d4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:13.609241 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724e1f2-39e9-4957-b065-2ede07c353a0 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:13.613954 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d907db-2464-405d-9cb7-ec60b6152bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:13.614332 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1374/2746] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:16:13.614584 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d907db-2464-405d-9cb7-ec60b6152bb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:13.614883 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d907db-2464-405d-9cb7-ec60b6152bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:13.615151 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d907db-2464-405d-9cb7-ec60b6152bb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:13.615834 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d907db-2464-405d-9cb7-ec60b6152bb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:13.617983 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d907db-2464-405d-9cb7-ec60b6152bb4 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:13.618387 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e48ec5-0f5a-40dc-bcb4-81a02e40d4f5 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:13.627005 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e48ec5-0f5a-40dc-bcb4-81a02e40d4f5 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:13.631759 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49dfe5-f960-4c48-a76a-2bb15debf510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:13.632404 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49dfe5-f960-4c48-a76a-2bb15debf510 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:13.632808 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49dfe5-f960-4c48-a76a-2bb15debf510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:13.633029 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49dfe5-f960-4c48-a76a-2bb15debf510 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:13.633791 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49dfe5-f960-4c48-a76a-2bb15debf510 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:16:13.634096 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49dfe5-f960-4c48-a76a-2bb15debf510 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:13.635700 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49dfe5-f960-4c48-a76a-2bb15debf510 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:13.645285 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1373/2747] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:16:13 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:16:13.652559 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1375/2748] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:16:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 19:16:13.652949 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d907db-2464-405d-9cb7-ec60b6152bb4 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:13.654386 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49dfe5-f960-4c48-a76a-2bb15debf510 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:13.666191 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49dfe5-f960-4c48-a76a-2bb15debf510 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:13.715041 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d907db-2464-405d-9cb7-ec60b6152bb4 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:13.719144 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba2eb9-62ea-49a9-8408-a69635029740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:13.719905 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba2eb9-62ea-49a9-8408-a69635029740 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:13.720342 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba2eb9-62ea-49a9-8408-a69635029740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:13.720626 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba2eb9-62ea-49a9-8408-a69635029740 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:13.721330 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba2eb9-62ea-49a9-8408-a69635029740 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:13.723348 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba2eb9-62ea-49a9-8408-a69635029740 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:13.727285 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5277bd-e309-4a3f-bc99-4b99e42a4123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:13.728026 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5277bd-e309-4a3f-bc99-4b99e42a4123 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:13.728371 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5277bd-e309-4a3f-bc99-4b99e42a4123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:13.728727 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5277bd-e309-4a3f-bc99-4b99e42a4123 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:13.729520 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5277bd-e309-4a3f-bc99-4b99e42a4123 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:13.731520 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5277bd-e309-4a3f-bc99-4b99e42a4123 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:13.745353 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1374/2749] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:16:13 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:16:13.749407 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba2eb9-62ea-49a9-8408-a69635029740 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:13.760517 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba2eb9-62ea-49a9-8408-a69635029740 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:13.761619 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1376/2750] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:16:13 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:16:13.766096 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5277bd-e309-4a3f-bc99-4b99e42a4123 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:13.818427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd427e-ef55-46da-a2ba-8f3c5e051dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:13.819451 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd427e-ef55-46da-a2ba-8f3c5e051dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:13.819730 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd427e-ef55-46da-a2ba-8f3c5e051dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:13.820002 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd427e-ef55-46da-a2ba-8f3c5e051dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:13.820727 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd427e-ef55-46da-a2ba-8f3c5e051dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:13.822358 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd427e-ef55-46da-a2ba-8f3c5e051dd0 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:13.826558 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5277bd-e309-4a3f-bc99-4b99e42a4123 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:13.831352 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d99010-be10-4f09-ae1c-9e853282091e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:13.832016 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d99010-be10-4f09-ae1c-9e853282091e admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:13.832239 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1375/2751] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:16:13.832360 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d99010-be10-4f09-ae1c-9e853282091e admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:13.832552 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d99010-be10-4f09-ae1c-9e853282091e admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:13.833243 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d99010-be10-4f09-ae1c-9e853282091e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:13.835180 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d99010-be10-4f09-ae1c-9e853282091e admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:13.836432 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd427e-ef55-46da-a2ba-8f3c5e051dd0 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:13.846108 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd427e-ef55-46da-a2ba-8f3c5e051dd0 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:13.850833 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f345bf76-58a8-496e-bdd0-f4b57eb58de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:13.851709 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f345bf76-58a8-496e-bdd0-f4b57eb58de9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:13.851991 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f345bf76-58a8-496e-bdd0-f4b57eb58de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:13.852252 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f345bf76-58a8-496e-bdd0-f4b57eb58de9 admin admin] PATH_INFO: `/v3/projects/fa41c7d0b3de45cda07b7522855e7987/users/ff65dc2147874de0b898d49e2d0c36da/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:13.857606 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1377/2752] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:16:13 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:16:13.859501 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d99010-be10-4f09-ae1c-9e853282091e admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:13.866972 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f345bf76-58a8-496e-bdd0-f4b57eb58de9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa41c7d0b3de45cda07b7522855e7987, user_id=ff65dc2147874de0b898d49e2d0c36da, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:13.869155 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d99010-be10-4f09-ae1c-9e853282091e admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:13.869715 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f345bf76-58a8-496e-bdd0-f4b57eb58de9 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:13.874654 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829657c1-9cc7-4bcc-97cf-97a1f25805ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:13.875339 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829657c1-9cc7-4bcc-97cf-97a1f25805ec admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:13.875595 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829657c1-9cc7-4bcc-97cf-97a1f25805ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:13.875906 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829657c1-9cc7-4bcc-97cf-97a1f25805ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:13.876751 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829657c1-9cc7-4bcc-97cf-97a1f25805ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:13.878353 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829657c1-9cc7-4bcc-97cf-97a1f25805ec admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:13.882653 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1376/2753] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:16:13 2022] PUT /identity/v3/projects/fa41c7d0b3de45cda07b7522855e7987/users/ff65dc2147874de0b898d49e2d0c36da/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:16:13.886503 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f345bf76-58a8-496e-bdd0-f4b57eb58de9 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:13.889155 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1378/2754] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 19:16:13.894313 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829657c1-9cc7-4bcc-97cf-97a1f25805ec admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:13.903543 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829657c1-9cc7-4bcc-97cf-97a1f25805ec admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:13.947712 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f345bf76-58a8-496e-bdd0-f4b57eb58de9 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:13.952426 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f4ad1-c247-4df9-a760-885b9677ef91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:13.953093 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f4ad1-c247-4df9-a760-885b9677ef91 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:13.953366 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f4ad1-c247-4df9-a760-885b9677ef91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:13.953669 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f4ad1-c247-4df9-a760-885b9677ef91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:13.954391 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f4ad1-c247-4df9-a760-885b9677ef91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:13.955989 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f4ad1-c247-4df9-a760-885b9677ef91 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:13.960086 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08155a69-2761-4f0a-a5c7-09b785d048fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:13.960769 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08155a69-2761-4f0a-a5c7-09b785d048fa admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:13.961055 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08155a69-2761-4f0a-a5c7-09b785d048fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:13.961327 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08155a69-2761-4f0a-a5c7-09b785d048fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:13.962086 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08155a69-2761-4f0a-a5c7-09b785d048fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:13.963695 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08155a69-2761-4f0a-a5c7-09b785d048fa admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:13.965393 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1377/2755] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 19:16:13.969961 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f4ad1-c247-4df9-a760-885b9677ef91 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:13.973752 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1379/2756] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:16:13.977761 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08155a69-2761-4f0a-a5c7-09b785d048fa admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:13.980009 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f4ad1-c247-4df9-a760-885b9677ef91 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:13.984986 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b4c05-8129-4f93-bb11-616d08d2f90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:13.985887 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b4c05-8129-4f93-bb11-616d08d2f90b admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:13.986147 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b4c05-8129-4f93-bb11-616d08d2f90b admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:13.986417 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b4c05-8129-4f93-bb11-616d08d2f90b admin admin] PATH_INFO: `/v3/projects/fa41c7d0b3de45cda07b7522855e7987/users/ff65dc2147874de0b898d49e2d0c36da/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:13.987772 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08155a69-2761-4f0a-a5c7-09b785d048fa admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:13.988316 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b4c05-8129-4f93-bb11-616d08d2f90b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa41c7d0b3de45cda07b7522855e7987, user_id=ff65dc2147874de0b898d49e2d0c36da, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:13.990963 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b4c05-8129-4f93-bb11-616d08d2f90b admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:13.992892 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b1dbc5-e170-4c63-9239-18220a289a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:13.993811 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1dbc5-e170-4c63-9239-18220a289a73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:13.994092 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1dbc5-e170-4c63-9239-18220a289a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:13.994344 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1dbc5-e170-4c63-9239-18220a289a73 admin admin] PATH_INFO: `/v3/projects/3e697bfab5ea482583276af140f451c2/users/5e317eec8c124eeaa373cdc1c4da1718/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:14.007596 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1378/2757] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:16:13 2022] PUT /identity/v3/projects/fa41c7d0b3de45cda07b7522855e7987/users/ff65dc2147874de0b898d49e2d0c36da/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:16:14.010035 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b1dbc5-e170-4c63-9239-18220a289a73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e697bfab5ea482583276af140f451c2, user_id=5e317eec8c124eeaa373cdc1c4da1718, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:14.012807 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b1dbc5-e170-4c63-9239-18220a289a73 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:14.019739 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15205112-a31e-4cfc-b06b-90f9b3a9a9c9 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:14.020021 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15205112-a31e-4cfc-b06b-90f9b3a9a9c9 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:14.020326 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15205112-a31e-4cfc-b06b-90f9b3a9a9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:14.028704 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1380/2758] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:16:13 2022] PUT /identity/v3/projects/3e697bfab5ea482583276af140f451c2/users/5e317eec8c124eeaa373cdc1c4da1718/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:16:14.038939 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405188b-2822-4a65-b8b2-283156df2a4d None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:14.039218 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405188b-2822-4a65-b8b2-283156df2a4d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:14.039489 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405188b-2822-4a65-b8b2-283156df2a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:14.046877 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-15205112-a31e-4cfc-b06b-90f9b3a9a9c9 None None] MFA Rules not processed for user `ff65dc2147874de0b898d49e2d0c36da`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:14.048072 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-15205112-a31e-4cfc-b06b-90f9b3a9a9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:14.064185 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-6405188b-2822-4a65-b8b2-283156df2a4d None None] MFA Rules not processed for user `5e317eec8c124eeaa373cdc1c4da1718`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:14.065410 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-6405188b-2822-4a65-b8b2-283156df2a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:14.112892 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1379/2759] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:16:14.127380 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1381/2760] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:16:14.128724 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15205112-a31e-4cfc-b06b-90f9b3a9a9c9 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:14.130223 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-15205112-a31e-4cfc-b06b-90f9b3a9a9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:14.138290 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405188b-2822-4a65-b8b2-283156df2a4d None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:14.140043 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-6405188b-2822-4a65-b8b2-283156df2a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:14.189010 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15205112-a31e-4cfc-b06b-90f9b3a9a9c9 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:14.192698 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4be2b-2eca-4d2b-98c5-db0ef16d094d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:14.193344 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4be2b-2eca-4d2b-98c5-db0ef16d094d service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:14.193657 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4be2b-2eca-4d2b-98c5-db0ef16d094d service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:14.193928 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4be2b-2eca-4d2b-98c5-db0ef16d094d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:14.195754 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-68b4be2b-2eca-4d2b-98c5-db0ef16d094d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:14.221476 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405188b-2822-4a65-b8b2-283156df2a4d None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:14.227260 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b644ffa-1624-42b3-88ab-ae620779e4a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:14.227885 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b644ffa-1624-42b3-88ab-ae620779e4a8 service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:14.228166 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b644ffa-1624-42b3-88ab-ae620779e4a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:14.228442 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b644ffa-1624-42b3-88ab-ae620779e4a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:14.236159 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b644ffa-1624-42b3-88ab-ae620779e4a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:14.237779 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b644ffa-1624-42b3-88ab-ae620779e4a8 service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:14.246560 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1382/2761] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:16:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 19:16:14.252930 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4be2b-2eca-4d2b-98c5-db0ef16d094d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:14.254417 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4be2b-2eca-4d2b-98c5-db0ef16d094d service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:14.263508 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1380/2762] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:16:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:16:15.783045 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b644ffa-1624-42b3-88ab-ae620779e4a8 service nova] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:15.792534 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b644ffa-1624-42b3-88ab-ae620779e4a8 service nova] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:15.796430 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175ae9a-6aa2-402a-accd-6ad3988d2eb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:15.797076 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175ae9a-6aa2-402a-accd-6ad3988d2eb1 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:15.797356 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175ae9a-6aa2-402a-accd-6ad3988d2eb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:15.797656 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175ae9a-6aa2-402a-accd-6ad3988d2eb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:15.857316 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175ae9a-6aa2-402a-accd-6ad3988d2eb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:15.858833 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175ae9a-6aa2-402a-accd-6ad3988d2eb1 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:15.869187 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1383/2763] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:16:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:16:17.184331 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4be2b-2eca-4d2b-98c5-db0ef16d094d service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:17.193258 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4be2b-2eca-4d2b-98c5-db0ef16d094d service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:17.197788 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0151c4-ea52-470f-a6de-7fe9315aeaec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:17.198436 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0151c4-ea52-470f-a6de-7fe9315aeaec service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:17.198715 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0151c4-ea52-470f-a6de-7fe9315aeaec service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:17.198988 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0151c4-ea52-470f-a6de-7fe9315aeaec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:17.213901 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0151c4-ea52-470f-a6de-7fe9315aeaec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:17.216435 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0151c4-ea52-470f-a6de-7fe9315aeaec service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:17.231591 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1381/2764] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:16:17 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:16:21.555067 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175ae9a-6aa2-402a-accd-6ad3988d2eb1 service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:21.614771 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175ae9a-6aa2-402a-accd-6ad3988d2eb1 service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:21.621016 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6bdfad-e6f7-413a-b142-9dd382fb6e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:21.621941 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6bdfad-e6f7-413a-b142-9dd382fb6e96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:21.622216 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6bdfad-e6f7-413a-b142-9dd382fb6e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:21.622519 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6bdfad-e6f7-413a-b142-9dd382fb6e96 admin admin] PATH_INFO: `/v3/users/5e317eec8c124eeaa373cdc1c4da1718` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:21.623756 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6bdfad-e6f7-413a-b142-9dd382fb6e96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e317eec8c124eeaa373cdc1c4da1718)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:21.625764 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6bdfad-e6f7-413a-b142-9dd382fb6e96 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:21.678139 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-6b6bdfad-e6f7-413a-b142-9dd382fb6e96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e317eec8c124eeaa373cdc1c4da1718'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:21.686808 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-6b6bdfad-e6f7-413a-b142-9dd382fb6e96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e317eec8c124eeaa373cdc1c4da1718'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:21.693510 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-6b6bdfad-e6f7-413a-b142-9dd382fb6e96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e317eec8c124eeaa373cdc1c4da1718'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:21.694173 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-6b6bdfad-e6f7-413a-b142-9dd382fb6e96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e317eec8c124eeaa373cdc1c4da1718'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:21.705541 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-6b6bdfad-e6f7-413a-b142-9dd382fb6e96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e317eec8c124eeaa373cdc1c4da1718'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:21.711797 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1384/2765] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:16:21 2022] DELETE /identity/v3/users/5e317eec8c124eeaa373cdc1c4da1718 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:16:21.716658 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0403d-a0c9-42c4-844e-5067007e824c None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:21.717139 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0403d-a0c9-42c4-844e-5067007e824c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:21.717238 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0403d-a0c9-42c4-844e-5067007e824c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:21.735382 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-34e0403d-a0c9-42c4-844e-5067007e824c None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:21.736579 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-34e0403d-a0c9-42c4-844e-5067007e824c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:21.796080 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1382/2766] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:16:21.807093 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6bdfad-e6f7-413a-b142-9dd382fb6e96 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:21.808671 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-6b6bdfad-e6f7-413a-b142-9dd382fb6e96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:21.874517 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6bdfad-e6f7-413a-b142-9dd382fb6e96 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:21.880642 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca55521-7a01-4748-8838-0b947301e121 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:21.881605 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca55521-7a01-4748-8838-0b947301e121 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:21.881937 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca55521-7a01-4748-8838-0b947301e121 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:21.882277 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca55521-7a01-4748-8838-0b947301e121 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:21.893890 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca55521-7a01-4748-8838-0b947301e121 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:21.895315 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca55521-7a01-4748-8838-0b947301e121 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:21.904572 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1385/2767] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:16:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:16:22.179484 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0403d-a0c9-42c4-844e-5067007e824c None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:22.181003 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-34e0403d-a0c9-42c4-844e-5067007e824c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:22.185872 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca55521-7a01-4748-8838-0b947301e121 service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:22.187647 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-cca55521-7a01-4748-8838-0b947301e121 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:22.193888 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0403d-a0c9-42c4-844e-5067007e824c None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:22.199282 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d514b25-6f95-4848-943f-992c0b23e957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:22.200184 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d514b25-6f95-4848-943f-992c0b23e957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:22.200504 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d514b25-6f95-4848-943f-992c0b23e957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:22.200777 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d514b25-6f95-4848-943f-992c0b23e957 admin admin] PATH_INFO: `/v3/users/7ab77340ecef4a609dede2b1a479c8bf` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:22.202034 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d514b25-6f95-4848-943f-992c0b23e957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ab77340ecef4a609dede2b1a479c8bf)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:22.203955 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d514b25-6f95-4848-943f-992c0b23e957 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:22.207616 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca55521-7a01-4748-8838-0b947301e121 service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:22.213657 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf770a1-ef4b-4309-91f7-4c3b0401dc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:22.214540 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf770a1-ef4b-4309-91f7-4c3b0401dc63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:22.214852 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf770a1-ef4b-4309-91f7-4c3b0401dc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:22.215148 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf770a1-ef4b-4309-91f7-4c3b0401dc63 admin admin] PATH_INFO: `/v3/projects/3e697bfab5ea482583276af140f451c2` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:22.216444 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf770a1-ef4b-4309-91f7-4c3b0401dc63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e697bfab5ea482583276af140f451c2)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:22.218305 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf770a1-ef4b-4309-91f7-4c3b0401dc63 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:22.252086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3d514b25-6f95-4848-943f-992c0b23e957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ab77340ecef4a609dede2b1a479c8bf'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:22.259467 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3d514b25-6f95-4848-943f-992c0b23e957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ab77340ecef4a609dede2b1a479c8bf'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:22.265624 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-aaf770a1-ef4b-4309-91f7-4c3b0401dc63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e697bfab5ea482583276af140f451c2', 'request_id': 'req-aaf770a1-ef4b-4309-91f7-4c3b0401dc63'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:22.268346 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3d514b25-6f95-4848-943f-992c0b23e957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ab77340ecef4a609dede2b1a479c8bf'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:22.271229 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-aaf770a1-ef4b-4309-91f7-4c3b0401dc63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e697bfab5ea482583276af140f451c2', 'request_id': 'req-aaf770a1-ef4b-4309-91f7-4c3b0401dc63'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:22.277937 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-aaf770a1-ef4b-4309-91f7-4c3b0401dc63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e697bfab5ea482583276af140f451c2', 'request_id': 'req-aaf770a1-ef4b-4309-91f7-4c3b0401dc63'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:22.280572 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3d514b25-6f95-4848-943f-992c0b23e957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ab77340ecef4a609dede2b1a479c8bf'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:22.281382 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3d514b25-6f95-4848-943f-992c0b23e957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ab77340ecef4a609dede2b1a479c8bf'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:22.288059 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1383/2768] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:16:22 2022] DELETE /identity/v3/users/7ab77340ecef4a609dede2b1a479c8bf => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:16:22.291945 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-aaf770a1-ef4b-4309-91f7-4c3b0401dc63 admin admin] The token cache is being invalidate because project 3e697bfab5ea482583276af140f451c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:16:22.292311 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-aaf770a1-ef4b-4309-91f7-4c3b0401dc63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:22.292534 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09138117-390c-4b88-b133-b50789166ac2 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:22.292817 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09138117-390c-4b88-b133-b50789166ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:22.292944 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-aaf770a1-ef4b-4309-91f7-4c3b0401dc63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:22.293139 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09138117-390c-4b88-b133-b50789166ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:22.294612 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1386/2769] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:16:22 2022] DELETE /identity/v3/projects/3e697bfab5ea482583276af140f451c2 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:16:22.299618 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a740e82-734e-4a67-82ad-0a6fc2a66448 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:22.299899 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a740e82-734e-4a67-82ad-0a6fc2a66448 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:22.300174 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a740e82-734e-4a67-82ad-0a6fc2a66448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:22.313224 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-09138117-390c-4b88-b133-b50789166ac2 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:22.314441 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-09138117-390c-4b88-b133-b50789166ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:22.318324 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-1a740e82-734e-4a67-82ad-0a6fc2a66448 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:22.319532 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-1a740e82-734e-4a67-82ad-0a6fc2a66448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:22.369916 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1384/2770] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:16:22.377750 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1387/2771] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:16:22.379593 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09138117-390c-4b88-b133-b50789166ac2 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:22.380991 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-09138117-390c-4b88-b133-b50789166ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:22.384969 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca9bfb-976c-4727-ab4e-fcb67521bd52 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:22.385253 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca9bfb-976c-4727-ab4e-fcb67521bd52 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:22.385521 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca9bfb-976c-4727-ab4e-fcb67521bd52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:22.403906 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-3fca9bfb-976c-4727-ab4e-fcb67521bd52 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:22.405054 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-3fca9bfb-976c-4727-ab4e-fcb67521bd52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:22.412879 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1388/2772] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:16:22.417077 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca9bfb-976c-4727-ab4e-fcb67521bd52 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:22.426076 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca9bfb-976c-4727-ab4e-fcb67521bd52 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:22.430985 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c7d44-23aa-41e1-a0af-8c9fe00ee5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:22.431611 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c7d44-23aa-41e1-a0af-8c9fe00ee5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:22.431888 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c7d44-23aa-41e1-a0af-8c9fe00ee5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:22.432144 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c7d44-23aa-41e1-a0af-8c9fe00ee5c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:22.432852 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9c7d44-23aa-41e1-a0af-8c9fe00ee5c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:16:22.433157 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9c7d44-23aa-41e1-a0af-8c9fe00ee5c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:22.434828 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9c7d44-23aa-41e1-a0af-8c9fe00ee5c0 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:22.437714 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09138117-390c-4b88-b133-b50789166ac2 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:22.441485 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bef650-3b20-4d82-88b8-a18b61caea8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:22.442152 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bef650-3b20-4d82-88b8-a18b61caea8a service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:22.442429 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bef650-3b20-4d82-88b8-a18b61caea8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:22.442696 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bef650-3b20-4d82-88b8-a18b61caea8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:22.446134 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1389/2773] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:16:22.450134 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c7d44-23aa-41e1-a0af-8c9fe00ee5c0 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:22.451876 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bef650-3b20-4d82-88b8-a18b61caea8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:22.453320 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bef650-3b20-4d82-88b8-a18b61caea8a service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:22.459533 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c7d44-23aa-41e1-a0af-8c9fe00ee5c0 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:22.462992 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1385/2774] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:16:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:16:22.464170 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df4d91-eb6f-42f4-a201-f396b13e4b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:22.464868 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df4d91-eb6f-42f4-a201-f396b13e4b01 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:22.465153 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df4d91-eb6f-42f4-a201-f396b13e4b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:22.465429 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df4d91-eb6f-42f4-a201-f396b13e4b01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:22.466158 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df4d91-eb6f-42f4-a201-f396b13e4b01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:22.468048 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df4d91-eb6f-42f4-a201-f396b13e4b01 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:22.497190 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1390/2775] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:16:22 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:16:22.502434 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bef650-3b20-4d82-88b8-a18b61caea8a service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:22.512454 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bef650-3b20-4d82-88b8-a18b61caea8a service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:22.569791 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b54d4-1e7b-4c0f-a5c1-f4dc96f297b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:22.570613 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b54d4-1e7b-4c0f-a5c1-f4dc96f297b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:22.570990 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b54d4-1e7b-4c0f-a5c1-f4dc96f297b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:22.571390 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b54d4-1e7b-4c0f-a5c1-f4dc96f297b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:22.572194 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b54d4-1e7b-4c0f-a5c1-f4dc96f297b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:22.574294 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b54d4-1e7b-4c0f-a5c1-f4dc96f297b4 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:22.594400 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1386/2776] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:16:22 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:16:22.598277 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df4d91-eb6f-42f4-a201-f396b13e4b01 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:22.608954 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df4d91-eb6f-42f4-a201-f396b13e4b01 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:22.614197 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edaedea-5f1d-4848-be15-30334beb8e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:22.614958 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edaedea-5f1d-4848-be15-30334beb8e03 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:22.615282 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edaedea-5f1d-4848-be15-30334beb8e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:22.615749 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edaedea-5f1d-4848-be15-30334beb8e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:22.616639 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edaedea-5f1d-4848-be15-30334beb8e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:22.618571 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edaedea-5f1d-4848-be15-30334beb8e03 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:22.628763 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1391/2777] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:16:22.632868 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b54d4-1e7b-4c0f-a5c1-f4dc96f297b4 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:22.643594 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b54d4-1e7b-4c0f-a5c1-f4dc96f297b4 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:22.648410 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f00f4-6e4e-4d7a-92ff-f86614a206df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:22.649078 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f00f4-6e4e-4d7a-92ff-f86614a206df admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:22.649424 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f00f4-6e4e-4d7a-92ff-f86614a206df admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:22.649692 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f00f4-6e4e-4d7a-92ff-f86614a206df admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:22.650493 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f00f4-6e4e-4d7a-92ff-f86614a206df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:22.652161 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f00f4-6e4e-4d7a-92ff-f86614a206df admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:22.662271 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1387/2778] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:16:22.666461 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edaedea-5f1d-4848-be15-30334beb8e03 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:22.676392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edaedea-5f1d-4848-be15-30334beb8e03 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:22.680974 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75632fa9-499f-4917-a14a-e4c657cf27d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:22.681893 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75632fa9-499f-4917-a14a-e4c657cf27d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:22.682172 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75632fa9-499f-4917-a14a-e4c657cf27d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:22.682437 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75632fa9-499f-4917-a14a-e4c657cf27d9 admin admin] PATH_INFO: `/v3/projects/9671884943cf42bf9541d827ecc2e42c/users/0feaeb1c2f0148988cb4ad5f10a7b958/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:22.696754 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75632fa9-499f-4917-a14a-e4c657cf27d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9671884943cf42bf9541d827ecc2e42c, user_id=0feaeb1c2f0148988cb4ad5f10a7b958, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:22.699499 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75632fa9-499f-4917-a14a-e4c657cf27d9 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:22.718185 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1392/2779] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:16:22 2022] PUT /identity/v3/projects/9671884943cf42bf9541d827ecc2e42c/users/0feaeb1c2f0148988cb4ad5f10a7b958/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:16:22.730166 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c669e-b261-45b0-bc90-2576dcab6821 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:22.730622 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c669e-b261-45b0-bc90-2576dcab6821 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:22.730622 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c669e-b261-45b0-bc90-2576dcab6821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:22.738386 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75632fa9-499f-4917-a14a-e4c657cf27d9 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:22.741690 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-75632fa9-499f-4917-a14a-e4c657cf27d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:22.759870 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-b15c669e-b261-45b0-bc90-2576dcab6821 None None] MFA Rules not processed for user `0feaeb1c2f0148988cb4ad5f10a7b958`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:22.761115 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b15c669e-b261-45b0-bc90-2576dcab6821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:22.808390 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75632fa9-499f-4917-a14a-e4c657cf27d9 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:22.813404 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985e275-7502-44c5-aa3a-105b35599e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:22.814239 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985e275-7502-44c5-aa3a-105b35599e23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:22.814547 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985e275-7502-44c5-aa3a-105b35599e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:22.814819 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985e275-7502-44c5-aa3a-105b35599e23 admin admin] PATH_INFO: `/v3/projects/69aeb06d65c84d5bb3a75abeb91681b6` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:22.815964 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7985e275-7502-44c5-aa3a-105b35599e23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69aeb06d65c84d5bb3a75abeb91681b6)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:22.817941 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7985e275-7502-44c5-aa3a-105b35599e23 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:22.826772 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1388/2780] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:16:22.838640 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c669e-b261-45b0-bc90-2576dcab6821 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:22.840005 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b15c669e-b261-45b0-bc90-2576dcab6821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:22.862156 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-7985e275-7502-44c5-aa3a-105b35599e23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69aeb06d65c84d5bb3a75abeb91681b6', 'request_id': 'req-7985e275-7502-44c5-aa3a-105b35599e23'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:22.867323 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-7985e275-7502-44c5-aa3a-105b35599e23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69aeb06d65c84d5bb3a75abeb91681b6', 'request_id': 'req-7985e275-7502-44c5-aa3a-105b35599e23'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:22.873497 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-7985e275-7502-44c5-aa3a-105b35599e23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69aeb06d65c84d5bb3a75abeb91681b6', 'request_id': 'req-7985e275-7502-44c5-aa3a-105b35599e23'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:22.885927 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-7985e275-7502-44c5-aa3a-105b35599e23 admin admin] The token cache is being invalidate because project 69aeb06d65c84d5bb3a75abeb91681b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:16:22.886213 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-7985e275-7502-44c5-aa3a-105b35599e23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:22.886844 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-7985e275-7502-44c5-aa3a-105b35599e23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:22.888570 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1393/2781] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:16:22 2022] DELETE /identity/v3/projects/69aeb06d65c84d5bb3a75abeb91681b6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:16:22.892836 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985e275-7502-44c5-aa3a-105b35599e23 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:22.894399 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-7985e275-7502-44c5-aa3a-105b35599e23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:22.910794 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c669e-b261-45b0-bc90-2576dcab6821 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:22.955128 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985e275-7502-44c5-aa3a-105b35599e23 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:22.959736 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b802f56-816a-43d7-8c63-3baff95a1ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:22.960625 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b802f56-816a-43d7-8c63-3baff95a1ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:22.960904 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b802f56-816a-43d7-8c63-3baff95a1ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:22.961175 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b802f56-816a-43d7-8c63-3baff95a1ed8 admin admin] PATH_INFO: `/v3/users/a2e19616bd474bb49cb5a62932ebd9ad` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:22.962628 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b802f56-816a-43d7-8c63-3baff95a1ed8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2e19616bd474bb49cb5a62932ebd9ad)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:22.964551 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b802f56-816a-43d7-8c63-3baff95a1ed8 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:22.971972 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327afc09-a302-4d23-978b-0733b36734b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:22.972673 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327afc09-a302-4d23-978b-0733b36734b3 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:22.972951 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327afc09-a302-4d23-978b-0733b36734b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:22.973224 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327afc09-a302-4d23-978b-0733b36734b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:22.975083 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-327afc09-a302-4d23-978b-0733b36734b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:23.009524 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-2b802f56-816a-43d7-8c63-3baff95a1ed8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2e19616bd474bb49cb5a62932ebd9ad'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:23.018591 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-2b802f56-816a-43d7-8c63-3baff95a1ed8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2e19616bd474bb49cb5a62932ebd9ad'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:23.025928 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-2b802f56-816a-43d7-8c63-3baff95a1ed8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2e19616bd474bb49cb5a62932ebd9ad'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:23.026579 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-2b802f56-816a-43d7-8c63-3baff95a1ed8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2e19616bd474bb49cb5a62932ebd9ad'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:23.031685 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327afc09-a302-4d23-978b-0733b36734b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:23.033312 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327afc09-a302-4d23-978b-0733b36734b3 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:23.038038 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-2b802f56-816a-43d7-8c63-3baff95a1ed8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2e19616bd474bb49cb5a62932ebd9ad'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:23.042501 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1389/2782] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:16:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 19:16:23.044006 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1394/2783] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:16:22 2022] DELETE /identity/v3/users/a2e19616bd474bb49cb5a62932ebd9ad => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:16:23.281055 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327afc09-a302-4d23-978b-0733b36734b3 service nova] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:23.282571 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-327afc09-a302-4d23-978b-0733b36734b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:23.295908 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327afc09-a302-4d23-978b-0733b36734b3 service nova] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:23.352619 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b802f56-816a-43d7-8c63-3baff95a1ed8 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:23.354099 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-2b802f56-816a-43d7-8c63-3baff95a1ed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:23.358055 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95510455-17e8-4f53-9be9-73047dc81772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:23.359147 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95510455-17e8-4f53-9be9-73047dc81772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:23.359434 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95510455-17e8-4f53-9be9-73047dc81772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:23.359708 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95510455-17e8-4f53-9be9-73047dc81772 admin admin] PATH_INFO: `/v3/users/0feaeb1c2f0148988cb4ad5f10a7b958` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:23.360945 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95510455-17e8-4f53-9be9-73047dc81772 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0feaeb1c2f0148988cb4ad5f10a7b958)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:23.362956 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95510455-17e8-4f53-9be9-73047dc81772 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:23.373168 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b802f56-816a-43d7-8c63-3baff95a1ed8 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:23.378803 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a4ab6-3644-46ec-926f-c19c485c7474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:23.379659 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a4ab6-3644-46ec-926f-c19c485c7474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:23.380040 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a4ab6-3644-46ec-926f-c19c485c7474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:23.380206 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a4ab6-3644-46ec-926f-c19c485c7474 admin admin] PATH_INFO: `/v3/projects/b9692869c62845efb9427e5b2ab722e6` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:23.381996 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83a4ab6-3644-46ec-926f-c19c485c7474 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9692869c62845efb9427e5b2ab722e6)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:23.383963 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83a4ab6-3644-46ec-926f-c19c485c7474 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:23.412545 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-95510455-17e8-4f53-9be9-73047dc81772 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0feaeb1c2f0148988cb4ad5f10a7b958'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:23.420052 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-95510455-17e8-4f53-9be9-73047dc81772 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0feaeb1c2f0148988cb4ad5f10a7b958'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:23.427306 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-95510455-17e8-4f53-9be9-73047dc81772 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0feaeb1c2f0148988cb4ad5f10a7b958'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:23.431220 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e83a4ab6-3644-46ec-926f-c19c485c7474 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9692869c62845efb9427e5b2ab722e6', 'request_id': 'req-e83a4ab6-3644-46ec-926f-c19c485c7474'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:23.436588 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e83a4ab6-3644-46ec-926f-c19c485c7474 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9692869c62845efb9427e5b2ab722e6', 'request_id': 'req-e83a4ab6-3644-46ec-926f-c19c485c7474'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:23.438603 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-95510455-17e8-4f53-9be9-73047dc81772 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0feaeb1c2f0148988cb4ad5f10a7b958'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:23.439242 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-95510455-17e8-4f53-9be9-73047dc81772 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0feaeb1c2f0148988cb4ad5f10a7b958'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:23.443541 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e83a4ab6-3644-46ec-926f-c19c485c7474 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9692869c62845efb9427e5b2ab722e6', 'request_id': 'req-e83a4ab6-3644-46ec-926f-c19c485c7474'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:23.445332 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1390/2784] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:16:23 2022] DELETE /identity/v3/users/0feaeb1c2f0148988cb4ad5f10a7b958 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:16:23.450365 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5146422-16e5-4145-b920-980dc7a745f4 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:23.450697 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5146422-16e5-4145-b920-980dc7a745f4 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:23.451244 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5146422-16e5-4145-b920-980dc7a745f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:23.456537 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e83a4ab6-3644-46ec-926f-c19c485c7474 admin admin] The token cache is being invalidate because project b9692869c62845efb9427e5b2ab722e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:16:23.456831 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e83a4ab6-3644-46ec-926f-c19c485c7474 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:23.457439 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e83a4ab6-3644-46ec-926f-c19c485c7474 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:23.459188 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1395/2785] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:16:23 2022] DELETE /identity/v3/projects/b9692869c62845efb9427e5b2ab722e6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:16:23.462785 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a4ab6-3644-46ec-926f-c19c485c7474 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:23.464161 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-e83a4ab6-3644-46ec-926f-c19c485c7474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:23.468891 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-f5146422-16e5-4145-b920-980dc7a745f4 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:23.470089 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f5146422-16e5-4145-b920-980dc7a745f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:23.524382 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a4ab6-3644-46ec-926f-c19c485c7474 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:23.526842 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1391/2786] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:16:23.531953 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f93ba-3bb0-4b83-84ff-be663149b591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:23.532847 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f93ba-3bb0-4b83-84ff-be663149b591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:23.533124 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f93ba-3bb0-4b83-84ff-be663149b591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:23.533393 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f93ba-3bb0-4b83-84ff-be663149b591 admin admin] PATH_INFO: `/v3/users/ff65dc2147874de0b898d49e2d0c36da` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:23.534640 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f93ba-3bb0-4b83-84ff-be663149b591 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff65dc2147874de0b898d49e2d0c36da)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:23.536663 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f93ba-3bb0-4b83-84ff-be663149b591 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:23.537299 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5146422-16e5-4145-b920-980dc7a745f4 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:23.538703 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f5146422-16e5-4145-b920-980dc7a745f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:23.584872 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-376f93ba-3bb0-4b83-84ff-be663149b591 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff65dc2147874de0b898d49e2d0c36da'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:23.592859 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-376f93ba-3bb0-4b83-84ff-be663149b591 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff65dc2147874de0b898d49e2d0c36da'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:23.599785 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-376f93ba-3bb0-4b83-84ff-be663149b591 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff65dc2147874de0b898d49e2d0c36da'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:23.600411 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-376f93ba-3bb0-4b83-84ff-be663149b591 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff65dc2147874de0b898d49e2d0c36da'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:23.603780 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5146422-16e5-4145-b920-980dc7a745f4 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:23.608603 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b7460-f828-4525-87c6-656328bedc49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:23.609290 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b7460-f828-4525-87c6-656328bedc49 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:23.609603 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b7460-f828-4525-87c6-656328bedc49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:23.609907 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b7460-f828-4525-87c6-656328bedc49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:23.611714 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f27b7460-f828-4525-87c6-656328bedc49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:23.612615 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-376f93ba-3bb0-4b83-84ff-be663149b591 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff65dc2147874de0b898d49e2d0c36da'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:23.618642 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1396/2787] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:16:23 2022] DELETE /identity/v3/users/ff65dc2147874de0b898d49e2d0c36da => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:16:23.624071 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b7460-f828-4525-87c6-656328bedc49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:23.625523 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b7460-f828-4525-87c6-656328bedc49 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:23.635266 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1392/2788] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:16:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 19:16:23.899112 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f93ba-3bb0-4b83-84ff-be663149b591 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:23.901014 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-376f93ba-3bb0-4b83-84ff-be663149b591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:23.924792 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b7460-f828-4525-87c6-656328bedc49 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:23.926931 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f27b7460-f828-4525-87c6-656328bedc49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:23.940048 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b7460-f828-4525-87c6-656328bedc49 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:23.970125 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f93ba-3bb0-4b83-84ff-be663149b591 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:23.975132 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36447ad9-219c-4a67-8d7e-832b0e4a6f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:23.976086 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36447ad9-219c-4a67-8d7e-832b0e4a6f75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:23.976363 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36447ad9-219c-4a67-8d7e-832b0e4a6f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:23.976631 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36447ad9-219c-4a67-8d7e-832b0e4a6f75 admin admin] PATH_INFO: `/v3/projects/fa41c7d0b3de45cda07b7522855e7987` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:23.978031 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36447ad9-219c-4a67-8d7e-832b0e4a6f75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa41c7d0b3de45cda07b7522855e7987)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:23.979998 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36447ad9-219c-4a67-8d7e-832b0e4a6f75 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:24.008053 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a045a6d-96e1-4066-9827-b7ac3fb668d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:24.009109 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a045a6d-96e1-4066-9827-b7ac3fb668d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:24.009387 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a045a6d-96e1-4066-9827-b7ac3fb668d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:24.009709 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a045a6d-96e1-4066-9827-b7ac3fb668d0 admin admin] PATH_INFO: `/v3/projects/9671884943cf42bf9541d827ecc2e42c` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:24.010901 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a045a6d-96e1-4066-9827-b7ac3fb668d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9671884943cf42bf9541d827ecc2e42c)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:24.013166 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a045a6d-96e1-4066-9827-b7ac3fb668d0 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:24.045896 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-36447ad9-219c-4a67-8d7e-832b0e4a6f75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa41c7d0b3de45cda07b7522855e7987', 'request_id': 'req-36447ad9-219c-4a67-8d7e-832b0e4a6f75'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:24.051407 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-36447ad9-219c-4a67-8d7e-832b0e4a6f75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa41c7d0b3de45cda07b7522855e7987', 'request_id': 'req-36447ad9-219c-4a67-8d7e-832b0e4a6f75'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:24.057760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-36447ad9-219c-4a67-8d7e-832b0e4a6f75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa41c7d0b3de45cda07b7522855e7987', 'request_id': 'req-36447ad9-219c-4a67-8d7e-832b0e4a6f75'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:24.065497 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1a045a6d-96e1-4066-9827-b7ac3fb668d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9671884943cf42bf9541d827ecc2e42c', 'request_id': 'req-1a045a6d-96e1-4066-9827-b7ac3fb668d0'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:24.072355 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-36447ad9-219c-4a67-8d7e-832b0e4a6f75 admin admin] The token cache is being invalidate because project fa41c7d0b3de45cda07b7522855e7987 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:16:24.072621 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-36447ad9-219c-4a67-8d7e-832b0e4a6f75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:24.073629 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-36447ad9-219c-4a67-8d7e-832b0e4a6f75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:24.076653 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1a045a6d-96e1-4066-9827-b7ac3fb668d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9671884943cf42bf9541d827ecc2e42c', 'request_id': 'req-1a045a6d-96e1-4066-9827-b7ac3fb668d0'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:24.081984 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1397/2789] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:16:23 2022] DELETE /identity/v3/projects/fa41c7d0b3de45cda07b7522855e7987 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:16:24.083401 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eeba75-17a3-4f48-bd9b-4389a4f6c69d None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:24.083836 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eeba75-17a3-4f48-bd9b-4389a4f6c69d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:24.084171 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eeba75-17a3-4f48-bd9b-4389a4f6c69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:24.084690 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1a045a6d-96e1-4066-9827-b7ac3fb668d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9671884943cf42bf9541d827ecc2e42c', 'request_id': 'req-1a045a6d-96e1-4066-9827-b7ac3fb668d0'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:24.096477 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1a045a6d-96e1-4066-9827-b7ac3fb668d0 admin admin] The token cache is being invalidate because project 9671884943cf42bf9541d827ecc2e42c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:16:24.096765 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1a045a6d-96e1-4066-9827-b7ac3fb668d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:24.097446 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1a045a6d-96e1-4066-9827-b7ac3fb668d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:24.099067 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1393/2790] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:16:23 2022] DELETE /identity/v3/projects/9671884943cf42bf9541d827ecc2e42c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:16:24.102876 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-f5eeba75-17a3-4f48-bd9b-4389a4f6c69d None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:24.103639 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363fd83-ca27-465b-ac9c-14b059f6a879 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:24.103920 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363fd83-ca27-465b-ac9c-14b059f6a879 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:24.104162 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f5eeba75-17a3-4f48-bd9b-4389a4f6c69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:24.104281 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363fd83-ca27-465b-ac9c-14b059f6a879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:24.121769 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-d363fd83-ca27-465b-ac9c-14b059f6a879 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:24.123033 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d363fd83-ca27-465b-ac9c-14b059f6a879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:24.168999 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1398/2791] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:16:24.176678 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667bab0-a3c5-4192-9687-c5bd6761bfe3 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:24.176963 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667bab0-a3c5-4192-9687-c5bd6761bfe3 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:24.177234 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667bab0-a3c5-4192-9687-c5bd6761bfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:24.180782 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1394/2792] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:16:24.188604 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c587d-cd7d-406a-b8a2-b7b3a38312f5 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:24.188882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c587d-cd7d-406a-b8a2-b7b3a38312f5 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:24.189153 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c587d-cd7d-406a-b8a2-b7b3a38312f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:24.195010 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-d667bab0-a3c5-4192-9687-c5bd6761bfe3 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:24.196207 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-d667bab0-a3c5-4192-9687-c5bd6761bfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:24.204175 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1399/2793] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:16:24.208342 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667bab0-a3c5-4192-9687-c5bd6761bfe3 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:24.208643 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-b41c587d-cd7d-406a-b8a2-b7b3a38312f5 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:24.209876 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b41c587d-cd7d-406a-b8a2-b7b3a38312f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:24.217013 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667bab0-a3c5-4192-9687-c5bd6761bfe3 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:24.218517 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1395/2794] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:16:24.221732 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c507c-4c9b-48a7-bf72-dba168f31c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:24.222382 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c507c-4c9b-48a7-bf72-dba168f31c01 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:24.222526 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c587d-cd7d-406a-b8a2-b7b3a38312f5 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:24.222640 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c507c-4c9b-48a7-bf72-dba168f31c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:24.222919 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c507c-4c9b-48a7-bf72-dba168f31c01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:24.223650 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c507c-4c9b-48a7-bf72-dba168f31c01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:16:24.223991 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c507c-4c9b-48a7-bf72-dba168f31c01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:24.225617 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c507c-4c9b-48a7-bf72-dba168f31c01 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:24.231460 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c587d-cd7d-406a-b8a2-b7b3a38312f5 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:24.236448 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f6c20-8d49-437b-9193-eb2ecdd8b602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:24.237091 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f6c20-8d49-437b-9193-eb2ecdd8b602 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:24.237267 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1400/2795] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 19:16:24.237365 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f6c20-8d49-437b-9193-eb2ecdd8b602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:24.237719 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f6c20-8d49-437b-9193-eb2ecdd8b602 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:24.238499 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f6c20-8d49-437b-9193-eb2ecdd8b602 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:16:24.238807 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f6c20-8d49-437b-9193-eb2ecdd8b602 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:24.240525 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f6c20-8d49-437b-9193-eb2ecdd8b602 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:24.241560 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c507c-4c9b-48a7-bf72-dba168f31c01 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:24.251035 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c507c-4c9b-48a7-bf72-dba168f31c01 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:24.252903 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1396/2796] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 19:16:24.256209 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d51d5-586e-4445-ab4c-d4ee4648ad61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:24.256862 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d51d5-586e-4445-ab4c-d4ee4648ad61 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:24.257148 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d51d5-586e-4445-ab4c-d4ee4648ad61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:24.257259 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f6c20-8d49-437b-9193-eb2ecdd8b602 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:24.257425 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d51d5-586e-4445-ab4c-d4ee4648ad61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:24.258305 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d51d5-586e-4445-ab4c-d4ee4648ad61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:24.260250 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d51d5-586e-4445-ab4c-d4ee4648ad61 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:24.266744 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f6c20-8d49-437b-9193-eb2ecdd8b602 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:24.271420 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007af85-50e8-484e-9477-6a05bce2cb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:24.272042 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007af85-50e8-484e-9477-6a05bce2cb9d admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:24.272341 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007af85-50e8-484e-9477-6a05bce2cb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:24.272608 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007af85-50e8-484e-9477-6a05bce2cb9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:24.273274 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007af85-50e8-484e-9477-6a05bce2cb9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:24.275162 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007af85-50e8-484e-9477-6a05bce2cb9d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:24.287203 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1401/2797] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:16:24 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:16:24.291439 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d51d5-586e-4445-ab4c-d4ee4648ad61 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:24.301349 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1397/2798] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:16:24 2022] POST /identity/v3/projects => generated 403 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:16:24.304967 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007af85-50e8-484e-9477-6a05bce2cb9d admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:24.351021 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d51d5-586e-4445-ab4c-d4ee4648ad61 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:24.364659 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007af85-50e8-484e-9477-6a05bce2cb9d admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:24.369075 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4793f84-3138-4036-9f3e-52df47018840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:24.369766 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4793f84-3138-4036-9f3e-52df47018840 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:24.370045 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4793f84-3138-4036-9f3e-52df47018840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:24.370321 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4793f84-3138-4036-9f3e-52df47018840 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:24.371005 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4793f84-3138-4036-9f3e-52df47018840 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:24.373019 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4793f84-3138-4036-9f3e-52df47018840 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:24.395450 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1398/2799] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:16:24 2022] POST /identity/v3/users => generated 302 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:16:24.396517 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4793f84-3138-4036-9f3e-52df47018840 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:24.405678 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4793f84-3138-4036-9f3e-52df47018840 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:24.408413 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677369e7-994b-4224-afaa-cc11098406c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:24.409063 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677369e7-994b-4224-afaa-cc11098406c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:24.409342 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677369e7-994b-4224-afaa-cc11098406c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:24.409727 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677369e7-994b-4224-afaa-cc11098406c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:24.410427 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677369e7-994b-4224-afaa-cc11098406c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:24.410731 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978abbb9-9e1c-4714-9ef8-eb630afed3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:24.411381 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978abbb9-9e1c-4714-9ef8-eb630afed3ec admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:24.411660 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978abbb9-9e1c-4714-9ef8-eb630afed3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:24.411931 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978abbb9-9e1c-4714-9ef8-eb630afed3ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:24.412358 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677369e7-994b-4224-afaa-cc11098406c7 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:24.412649 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978abbb9-9e1c-4714-9ef8-eb630afed3ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:24.414323 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978abbb9-9e1c-4714-9ef8-eb630afed3ec admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:24.424138 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1399/2800] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:16:24.428191 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978abbb9-9e1c-4714-9ef8-eb630afed3ec admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:24.435988 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1402/2801] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:16:24 2022] POST /identity/v3/users => generated 282 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:16:24.437674 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978abbb9-9e1c-4714-9ef8-eb630afed3ec admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:24.439576 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677369e7-994b-4224-afaa-cc11098406c7 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:24.442444 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be69ea-f9eb-4307-823a-b20013a61263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:24.443086 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be69ea-f9eb-4307-823a-b20013a61263 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:24.443380 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be69ea-f9eb-4307-823a-b20013a61263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:24.443636 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be69ea-f9eb-4307-823a-b20013a61263 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:24.444365 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be69ea-f9eb-4307-823a-b20013a61263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:24.445985 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be69ea-f9eb-4307-823a-b20013a61263 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:24.449368 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677369e7-994b-4224-afaa-cc11098406c7 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:24.454595 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107f3a1-467a-4aa8-bd28-a99fd455857c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:24.455295 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107f3a1-467a-4aa8-bd28-a99fd455857c admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:24.455576 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107f3a1-467a-4aa8-bd28-a99fd455857c admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:24.455848 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107f3a1-467a-4aa8-bd28-a99fd455857c admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:24.456421 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1400/2802] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 19:16:24.456569 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107f3a1-467a-4aa8-bd28-a99fd455857c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:24.458299 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107f3a1-467a-4aa8-bd28-a99fd455857c admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:24.460239 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be69ea-f9eb-4307-823a-b20013a61263 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:24.468896 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1403/2803] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:16:24.469322 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be69ea-f9eb-4307-823a-b20013a61263 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:24.472557 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107f3a1-467a-4aa8-bd28-a99fd455857c admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:24.474260 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d7558-5646-41b6-88dc-029b8a3c83dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:24.475123 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d7558-5646-41b6-88dc-029b8a3c83dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:24.475407 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d7558-5646-41b6-88dc-029b8a3c83dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:24.475667 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d7558-5646-41b6-88dc-029b8a3c83dd admin admin] PATH_INFO: `/v3/projects/23c390c3228c4b31adb4340b1b477ccc/users/cdb51a216a2640b19813a75da0f42819/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:24.482222 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107f3a1-467a-4aa8-bd28-a99fd455857c admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:24.487586 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca81dbf-6ea5-46d6-837b-a9bfb77d7f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:24.488297 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca81dbf-6ea5-46d6-837b-a9bfb77d7f7f admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:24.488620 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca81dbf-6ea5-46d6-837b-a9bfb77d7f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:24.488839 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca81dbf-6ea5-46d6-837b-a9bfb77d7f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:24.489575 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca81dbf-6ea5-46d6-837b-a9bfb77d7f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:24.489898 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d7558-5646-41b6-88dc-029b8a3c83dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=23c390c3228c4b31adb4340b1b477ccc, user_id=cdb51a216a2640b19813a75da0f42819, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:24.491167 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca81dbf-6ea5-46d6-837b-a9bfb77d7f7f admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:24.492536 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d7558-5646-41b6-88dc-029b8a3c83dd admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:24.504680 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1404/2804] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:16:24.505737 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca81dbf-6ea5-46d6-837b-a9bfb77d7f7f admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:24.506960 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1401/2805] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:16:24 2022] PUT /identity/v3/projects/23c390c3228c4b31adb4340b1b477ccc/users/cdb51a216a2640b19813a75da0f42819/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:16:24.511710 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c22c5-f8b2-436b-99e7-e80f3c51fcd6 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:24.512006 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c22c5-f8b2-436b-99e7-e80f3c51fcd6 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:24.512303 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c22c5-f8b2-436b-99e7-e80f3c51fcd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:24.515874 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca81dbf-6ea5-46d6-837b-a9bfb77d7f7f admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:24.529238 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-0b4c22c5-f8b2-436b-99e7-e80f3c51fcd6 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:24.530483 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0b4c22c5-f8b2-436b-99e7-e80f3c51fcd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:24.568667 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a22cda-851b-4d9f-8f7e-d06945f7d34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:24.569597 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a22cda-851b-4d9f-8f7e-d06945f7d34c admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:24.569899 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a22cda-851b-4d9f-8f7e-d06945f7d34c admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:24.570169 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a22cda-851b-4d9f-8f7e-d06945f7d34c admin admin] PATH_INFO: `/v3/projects/3f52bae4e4584aaabf1ab928c13a727a/users/72f93b2c676c4774896076e110d4adcd/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:24.587322 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a22cda-851b-4d9f-8f7e-d06945f7d34c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f52bae4e4584aaabf1ab928c13a727a, user_id=72f93b2c676c4774896076e110d4adcd, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:24.587864 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1402/2806] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:16:24.590094 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a22cda-851b-4d9f-8f7e-d06945f7d34c admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:24.598183 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c22c5-f8b2-436b-99e7-e80f3c51fcd6 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:24.599917 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0b4c22c5-f8b2-436b-99e7-e80f3c51fcd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:24.604211 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1405/2807] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:16:24 2022] PUT /identity/v3/projects/3f52bae4e4584aaabf1ab928c13a727a/users/72f93b2c676c4774896076e110d4adcd/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:16:24.614579 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c394d2-29f4-481e-81c7-1c963e85718f None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:24.614918 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c394d2-29f4-481e-81c7-1c963e85718f None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:24.615141 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c394d2-29f4-481e-81c7-1c963e85718f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:24.640992 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-63c394d2-29f4-481e-81c7-1c963e85718f None None] MFA Rules not processed for user `72f93b2c676c4774896076e110d4adcd`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:24.642394 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-63c394d2-29f4-481e-81c7-1c963e85718f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:24.656475 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c22c5-f8b2-436b-99e7-e80f3c51fcd6 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:24.706756 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b032bc-6377-4e77-8c8e-b7422aefd76d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:24.707657 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1406/2808] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:24 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:16:24.707807 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b032bc-6377-4e77-8c8e-b7422aefd76d service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:24.708193 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b032bc-6377-4e77-8c8e-b7422aefd76d service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:24.708560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b032bc-6377-4e77-8c8e-b7422aefd76d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:24.719690 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c394d2-29f4-481e-81c7-1c963e85718f None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:24.721082 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-63c394d2-29f4-481e-81c7-1c963e85718f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:24.773859 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b032bc-6377-4e77-8c8e-b7422aefd76d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:24.775670 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b032bc-6377-4e77-8c8e-b7422aefd76d service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:24.786117 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1403/2809] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:16:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 19:16:24.786343 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c394d2-29f4-481e-81c7-1c963e85718f None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:24.790136 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a36b73-c902-4ac3-bc04-934babb7a817 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:24.791620 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a36b73-c902-4ac3-bc04-934babb7a817 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:24.791620 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a36b73-c902-4ac3-bc04-934babb7a817 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:24.791620 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a36b73-c902-4ac3-bc04-934babb7a817 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:24.800919 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a36b73-c902-4ac3-bc04-934babb7a817 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:24.802973 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a36b73-c902-4ac3-bc04-934babb7a817 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:24.813159 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1407/2810] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:16:24 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 19:16:25.407720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517d2d2-7c8f-4d4e-8024-5de8bebb91c3 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:25.408265 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517d2d2-7c8f-4d4e-8024-5de8bebb91c3 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:25.408388 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517d2d2-7c8f-4d4e-8024-5de8bebb91c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:25.434749 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-6517d2d2-7c8f-4d4e-8024-5de8bebb91c3 None None] MFA Rules not processed for user `cdb51a216a2640b19813a75da0f42819`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:25.435953 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6517d2d2-7c8f-4d4e-8024-5de8bebb91c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:25.503189 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1404/2811] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:16:25.507506 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a36b73-c902-4ac3-bc04-934babb7a817 service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:25.518742 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a36b73-c902-4ac3-bc04-934babb7a817 service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:25.523204 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec74f4c-065b-4482-a631-8018a460641d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:25.523865 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec74f4c-065b-4482-a631-8018a460641d admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:25.524146 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec74f4c-065b-4482-a631-8018a460641d admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:25.524420 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec74f4c-065b-4482-a631-8018a460641d admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:25.525111 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec74f4c-065b-4482-a631-8018a460641d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:25.527071 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec74f4c-065b-4482-a631-8018a460641d admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:25.554505 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1408/2812] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:16:25 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:16:25.558517 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517d2d2-7c8f-4d4e-8024-5de8bebb91c3 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:25.568895 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517d2d2-7c8f-4d4e-8024-5de8bebb91c3 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:25.624649 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f220ab-bdc6-4b73-9126-7454ae94107e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:25.625355 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f220ab-bdc6-4b73-9126-7454ae94107e admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:25.625671 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f220ab-bdc6-4b73-9126-7454ae94107e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:25.625943 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f220ab-bdc6-4b73-9126-7454ae94107e admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:25.626642 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f220ab-bdc6-4b73-9126-7454ae94107e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:25.628603 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f220ab-bdc6-4b73-9126-7454ae94107e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:25.653841 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1405/2813] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:16:25 2022] POST /identity/v3/users => generated 309 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 19:16:25.658220 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec74f4c-065b-4482-a631-8018a460641d admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:25.669237 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec74f4c-065b-4482-a631-8018a460641d admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:25.675002 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07588a-211a-46af-bb35-1ad2b1c6f93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:25.675676 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07588a-211a-46af-bb35-1ad2b1c6f93c admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:25.675958 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07588a-211a-46af-bb35-1ad2b1c6f93c admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:25.676225 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07588a-211a-46af-bb35-1ad2b1c6f93c admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:25.676957 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d07588a-211a-46af-bb35-1ad2b1c6f93c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:25.678614 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d07588a-211a-46af-bb35-1ad2b1c6f93c admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:25.689110 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1409/2814] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:16:25.693098 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f220ab-bdc6-4b73-9126-7454ae94107e admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:25.703076 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f220ab-bdc6-4b73-9126-7454ae94107e admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:25.708429 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b585a-841a-4c85-ab96-6ebc7f682a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:25.709315 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b585a-841a-4c85-ab96-6ebc7f682a81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:25.709627 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b585a-841a-4c85-ab96-6ebc7f682a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:25.709898 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b585a-841a-4c85-ab96-6ebc7f682a81 admin admin] PATH_INFO: `/v3/projects/92e3cf0cbdd745f1b84d0194213d543d/users/3f1e5581e54544acb369c14a38a7a260/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:25.725588 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b585a-841a-4c85-ab96-6ebc7f682a81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92e3cf0cbdd745f1b84d0194213d543d, user_id=3f1e5581e54544acb369c14a38a7a260, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:25.728273 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b585a-841a-4c85-ab96-6ebc7f682a81 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:25.742755 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1406/2815] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:16:25 2022] PUT /identity/v3/projects/92e3cf0cbdd745f1b84d0194213d543d/users/3f1e5581e54544acb369c14a38a7a260/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:16:25.746750 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07588a-211a-46af-bb35-1ad2b1c6f93c admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:25.756849 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07588a-211a-46af-bb35-1ad2b1c6f93c admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:25.818938 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac88be-ab9c-4679-b728-fb0e79d308d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:25.819641 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac88be-ab9c-4679-b728-fb0e79d308d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:25.819918 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac88be-ab9c-4679-b728-fb0e79d308d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:25.820191 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac88be-ab9c-4679-b728-fb0e79d308d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:25.820920 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac88be-ab9c-4679-b728-fb0e79d308d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:25.822565 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac88be-ab9c-4679-b728-fb0e79d308d3 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:25.832811 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1410/2816] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:16:25.837414 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b585a-841a-4c85-ab96-6ebc7f682a81 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:25.848270 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b585a-841a-4c85-ab96-6ebc7f682a81 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:25.853893 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081eb18f-56d2-4c9b-9fad-a02de077ae9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:25.854785 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081eb18f-56d2-4c9b-9fad-a02de077ae9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:25.855061 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081eb18f-56d2-4c9b-9fad-a02de077ae9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:25.855330 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081eb18f-56d2-4c9b-9fad-a02de077ae9e admin admin] PATH_INFO: `/v3/projects/92e3cf0cbdd745f1b84d0194213d543d/users/3f1e5581e54544acb369c14a38a7a260/roles/5a6e54e81bb24eceb618d9ffa67f488e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:25.857644 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081eb18f-56d2-4c9b-9fad-a02de077ae9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=92e3cf0cbdd745f1b84d0194213d543d, user_id=3f1e5581e54544acb369c14a38a7a260, role_id=5a6e54e81bb24eceb618d9ffa67f488e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:25.860305 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081eb18f-56d2-4c9b-9fad-a02de077ae9e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:25.870979 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1407/2817] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:16:25 2022] PUT /identity/v3/projects/92e3cf0cbdd745f1b84d0194213d543d/users/3f1e5581e54544acb369c14a38a7a260/roles/5a6e54e81bb24eceb618d9ffa67f488e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:16:26.491754 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d4570-5d92-4a5c-8d4e-26db617af59d None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:26.492414 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d4570-5d92-4a5c-8d4e-26db617af59d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:26.492898 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d4570-5d92-4a5c-8d4e-26db617af59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:26.524891 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-691d4570-5d92-4a5c-8d4e-26db617af59d None None] MFA Rules not processed for user `3f1e5581e54544acb369c14a38a7a260`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:26.526180 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-691d4570-5d92-4a5c-8d4e-26db617af59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:26.600000 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1411/2818] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:26 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:16:27.615399 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081eb18f-56d2-4c9b-9fad-a02de077ae9e admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:27.677022 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081eb18f-56d2-4c9b-9fad-a02de077ae9e admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:27.681467 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465dafd7-1f97-440a-babe-4777110b8924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:27.682371 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465dafd7-1f97-440a-babe-4777110b8924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:27.682649 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465dafd7-1f97-440a-babe-4777110b8924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:27.682917 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465dafd7-1f97-440a-babe-4777110b8924 admin admin] PATH_INFO: `/v3/users/cdb51a216a2640b19813a75da0f42819` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:27.684077 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465dafd7-1f97-440a-babe-4777110b8924 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdb51a216a2640b19813a75da0f42819)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:27.686023 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465dafd7-1f97-440a-babe-4777110b8924 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:27.740106 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-465dafd7-1f97-440a-babe-4777110b8924 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdb51a216a2640b19813a75da0f42819'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:27.748095 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-465dafd7-1f97-440a-babe-4777110b8924 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdb51a216a2640b19813a75da0f42819'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:27.756143 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-465dafd7-1f97-440a-babe-4777110b8924 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdb51a216a2640b19813a75da0f42819'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:27.769255 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-465dafd7-1f97-440a-babe-4777110b8924 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdb51a216a2640b19813a75da0f42819'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:27.770068 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-465dafd7-1f97-440a-babe-4777110b8924 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdb51a216a2640b19813a75da0f42819'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:27.776819 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1408/2819] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:16:27 2022] DELETE /identity/v3/users/cdb51a216a2640b19813a75da0f42819 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:16:27.979385 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d4570-5d92-4a5c-8d4e-26db617af59d None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:27.990100 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d4570-5d92-4a5c-8d4e-26db617af59d None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:28.051592 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893af52-192b-4296-887c-d406e3e7eda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:28.052495 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893af52-192b-4296-887c-d406e3e7eda9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:28.052777 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893af52-192b-4296-887c-d406e3e7eda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:28.053059 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893af52-192b-4296-887c-d406e3e7eda9 admin admin] PATH_INFO: `/v3/projects/23c390c3228c4b31adb4340b1b477ccc` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:28.056448 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1893af52-192b-4296-887c-d406e3e7eda9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23c390c3228c4b31adb4340b1b477ccc)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:28.058092 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1893af52-192b-4296-887c-d406e3e7eda9 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:28.103649 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-1893af52-192b-4296-887c-d406e3e7eda9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23c390c3228c4b31adb4340b1b477ccc', 'request_id': 'req-1893af52-192b-4296-887c-d406e3e7eda9'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:28.109073 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-1893af52-192b-4296-887c-d406e3e7eda9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23c390c3228c4b31adb4340b1b477ccc', 'request_id': 'req-1893af52-192b-4296-887c-d406e3e7eda9'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:28.115197 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-1893af52-192b-4296-887c-d406e3e7eda9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23c390c3228c4b31adb4340b1b477ccc', 'request_id': 'req-1893af52-192b-4296-887c-d406e3e7eda9'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:28.129463 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-1893af52-192b-4296-887c-d406e3e7eda9 admin admin] The token cache is being invalidate because project 23c390c3228c4b31adb4340b1b477ccc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:16:28.129783 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-1893af52-192b-4296-887c-d406e3e7eda9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:28.130390 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-1893af52-192b-4296-887c-d406e3e7eda9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:28.131987 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1412/2820] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:16:27 2022] DELETE /identity/v3/projects/23c390c3228c4b31adb4340b1b477ccc => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:16:28.136058 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465dafd7-1f97-440a-babe-4777110b8924 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:28.137491 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-465dafd7-1f97-440a-babe-4777110b8924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:28.150726 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465dafd7-1f97-440a-babe-4777110b8924 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:28.206885 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe780a-c644-4c95-9070-2989ee83d5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:28.207773 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe780a-c644-4c95-9070-2989ee83d5dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:28.208048 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe780a-c644-4c95-9070-2989ee83d5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:28.208324 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe780a-c644-4c95-9070-2989ee83d5dc admin admin] PATH_INFO: `/v3/users/3f1e5581e54544acb369c14a38a7a260` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:28.209570 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe780a-c644-4c95-9070-2989ee83d5dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f1e5581e54544acb369c14a38a7a260)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:28.211542 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe780a-c644-4c95-9070-2989ee83d5dc admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:28.266677 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fabe780a-c644-4c95-9070-2989ee83d5dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f1e5581e54544acb369c14a38a7a260'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:28.274769 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fabe780a-c644-4c95-9070-2989ee83d5dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f1e5581e54544acb369c14a38a7a260'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:28.285986 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fabe780a-c644-4c95-9070-2989ee83d5dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f1e5581e54544acb369c14a38a7a260'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:28.298003 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fabe780a-c644-4c95-9070-2989ee83d5dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f1e5581e54544acb369c14a38a7a260'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:28.298696 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fabe780a-c644-4c95-9070-2989ee83d5dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f1e5581e54544acb369c14a38a7a260'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:28.304863 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1409/2821] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:16:28 2022] DELETE /identity/v3/users/3f1e5581e54544acb369c14a38a7a260 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:16:28.493029 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893af52-192b-4296-887c-d406e3e7eda9 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:28.494550 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-1893af52-192b-4296-887c-d406e3e7eda9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:28.507287 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893af52-192b-4296-887c-d406e3e7eda9 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:28.563259 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df507f-1857-4280-be06-aeee479871d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:28.564064 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df507f-1857-4280-be06-aeee479871d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:28.564340 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df507f-1857-4280-be06-aeee479871d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:28.564612 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df507f-1857-4280-be06-aeee479871d8 admin admin] PATH_INFO: `/v3/projects/92e3cf0cbdd745f1b84d0194213d543d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:28.565830 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1df507f-1857-4280-be06-aeee479871d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92e3cf0cbdd745f1b84d0194213d543d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:28.567772 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1df507f-1857-4280-be06-aeee479871d8 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:28.627715 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e1df507f-1857-4280-be06-aeee479871d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92e3cf0cbdd745f1b84d0194213d543d', 'request_id': 'req-e1df507f-1857-4280-be06-aeee479871d8'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:28.634231 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e1df507f-1857-4280-be06-aeee479871d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92e3cf0cbdd745f1b84d0194213d543d', 'request_id': 'req-e1df507f-1857-4280-be06-aeee479871d8'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:28.644624 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e1df507f-1857-4280-be06-aeee479871d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92e3cf0cbdd745f1b84d0194213d543d', 'request_id': 'req-e1df507f-1857-4280-be06-aeee479871d8'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:28.660758 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e1df507f-1857-4280-be06-aeee479871d8 admin admin] The token cache is being invalidate because project 92e3cf0cbdd745f1b84d0194213d543d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:16:28.661142 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e1df507f-1857-4280-be06-aeee479871d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:28.661920 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e1df507f-1857-4280-be06-aeee479871d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:28.663542 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1413/2822] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:16:28 2022] DELETE /identity/v3/projects/92e3cf0cbdd745f1b84d0194213d543d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:16:28.670234 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80523013-008e-4f1a-9b63-8b5a382e13d7 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:28.670727 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80523013-008e-4f1a-9b63-8b5a382e13d7 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:28.670824 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80523013-008e-4f1a-9b63-8b5a382e13d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:28.688855 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-80523013-008e-4f1a-9b63-8b5a382e13d7 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:28.690061 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-80523013-008e-4f1a-9b63-8b5a382e13d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:28.748454 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1410/2823] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:16:28.756493 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077b9f7-f715-41d9-b3ae-40c1f4d17e9f None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:28.756765 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077b9f7-f715-41d9-b3ae-40c1f4d17e9f None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:28.757034 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077b9f7-f715-41d9-b3ae-40c1f4d17e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:28.776916 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-0077b9f7-f715-41d9-b3ae-40c1f4d17e9f None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:28.778319 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-0077b9f7-f715-41d9-b3ae-40c1f4d17e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:28.786517 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1414/2824] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:16:28.791219 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80523013-008e-4f1a-9b63-8b5a382e13d7 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:28.806137 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80523013-008e-4f1a-9b63-8b5a382e13d7 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:28.813724 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd5c21-439e-4306-8aac-243620a4f5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:28.814320 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd5c21-439e-4306-8aac-243620a4f5b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:28.814597 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd5c21-439e-4306-8aac-243620a4f5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:28.814871 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd5c21-439e-4306-8aac-243620a4f5b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:28.815607 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd5c21-439e-4306-8aac-243620a4f5b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:16:28.815915 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd5c21-439e-4306-8aac-243620a4f5b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:28.817555 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd5c21-439e-4306-8aac-243620a4f5b4 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:28.828936 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1411/2825] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:16:28.832876 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0077b9f7-f715-41d9-b3ae-40c1f4d17e9f None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:28.842196 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0077b9f7-f715-41d9-b3ae-40c1f4d17e9f None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:28.847233 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff254c9-3203-4c5e-ba40-b0b71e0ad1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:28.847872 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff254c9-3203-4c5e-ba40-b0b71e0ad1db admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:28.848133 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff254c9-3203-4c5e-ba40-b0b71e0ad1db admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:28.848398 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff254c9-3203-4c5e-ba40-b0b71e0ad1db admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:28.849092 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff254c9-3203-4c5e-ba40-b0b71e0ad1db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:28.850998 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff254c9-3203-4c5e-ba40-b0b71e0ad1db admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:28.877351 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1415/2826] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:16:28 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:16:28.881897 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd5c21-439e-4306-8aac-243620a4f5b4 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:28.892421 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd5c21-439e-4306-8aac-243620a4f5b4 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:28.950191 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217c17a-e0fc-45d0-955d-f77b2af69547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:28.950859 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217c17a-e0fc-45d0-955d-f77b2af69547 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:28.951136 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217c17a-e0fc-45d0-955d-f77b2af69547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:28.951407 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217c17a-e0fc-45d0-955d-f77b2af69547 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:28.952104 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217c17a-e0fc-45d0-955d-f77b2af69547 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:28.954235 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217c17a-e0fc-45d0-955d-f77b2af69547 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:28.982645 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1412/2827] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:16:28 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:16:28.983901 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff254c9-3203-4c5e-ba40-b0b71e0ad1db admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:28.994496 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff254c9-3203-4c5e-ba40-b0b71e0ad1db admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:28.999205 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d6839-4b99-4a65-b1af-9676d6a08031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:28.999921 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d6839-4b99-4a65-b1af-9676d6a08031 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:29.000199 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d6839-4b99-4a65-b1af-9676d6a08031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:29.000474 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d6839-4b99-4a65-b1af-9676d6a08031 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:29.005704 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d6839-4b99-4a65-b1af-9676d6a08031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:29.005704 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d6839-4b99-4a65-b1af-9676d6a08031 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:29.014874 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1416/2828] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:16:29.019166 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217c17a-e0fc-45d0-955d-f77b2af69547 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:29.029973 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217c17a-e0fc-45d0-955d-f77b2af69547 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:29.035432 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a39b46-7535-48e0-9189-fa5f50157614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:29.036149 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a39b46-7535-48e0-9189-fa5f50157614 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:29.036419 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a39b46-7535-48e0-9189-fa5f50157614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:29.036685 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a39b46-7535-48e0-9189-fa5f50157614 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:29.037405 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a39b46-7535-48e0-9189-fa5f50157614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:29.039024 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a39b46-7535-48e0-9189-fa5f50157614 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:29.049036 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1413/2829] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:16:29.053237 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d6839-4b99-4a65-b1af-9676d6a08031 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:29.063562 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d6839-4b99-4a65-b1af-9676d6a08031 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:29.068783 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11740007-ea1c-472a-9ab7-b180439618fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:29.069646 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11740007-ea1c-472a-9ab7-b180439618fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:29.069941 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11740007-ea1c-472a-9ab7-b180439618fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:29.070214 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11740007-ea1c-472a-9ab7-b180439618fe admin admin] PATH_INFO: `/v3/projects/5bc30f3c340d419a954611711ff2b195/users/37cc4530defc41bba404ccf04b20731d/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:29.085044 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11740007-ea1c-472a-9ab7-b180439618fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bc30f3c340d419a954611711ff2b195, user_id=37cc4530defc41bba404ccf04b20731d, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:29.087783 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11740007-ea1c-472a-9ab7-b180439618fe admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:29.102291 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1417/2830] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:16:29 2022] PUT /identity/v3/projects/5bc30f3c340d419a954611711ff2b195/users/37cc4530defc41bba404ccf04b20731d/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:16:29.112883 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6768e7-e835-457a-b224-bdb576a6a3f9 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:29.113183 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6768e7-e835-457a-b224-bdb576a6a3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:29.113447 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6768e7-e835-457a-b224-bdb576a6a3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:29.146357 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-5c6768e7-e835-457a-b224-bdb576a6a3f9 None None] MFA Rules not processed for user `37cc4530defc41bba404ccf04b20731d`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:29.147831 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5c6768e7-e835-457a-b224-bdb576a6a3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:29.215812 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1414/2831] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:16:29.227534 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11740007-ea1c-472a-9ab7-b180439618fe admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:29.229382 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-11740007-ea1c-472a-9ab7-b180439618fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:29.295348 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11740007-ea1c-472a-9ab7-b180439618fe admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:29.299048 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bdf614-4fca-45a5-90b3-3b3773d5dbab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:29.299701 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdf614-4fca-45a5-90b3-3b3773d5dbab service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:29.300338 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdf614-4fca-45a5-90b3-3b3773d5dbab service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:29.300612 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdf614-4fca-45a5-90b3-3b3773d5dbab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:29.309205 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bdf614-4fca-45a5-90b3-3b3773d5dbab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:29.310829 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bdf614-4fca-45a5-90b3-3b3773d5dbab service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:29.322482 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1418/2832] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:16:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:16:29.342238 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6768e7-e835-457a-b224-bdb576a6a3f9 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:29.403793 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6768e7-e835-457a-b224-bdb576a6a3f9 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:29.408406 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fc2e3-845e-40bb-99c9-437b09f4a6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:29.409289 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fc2e3-845e-40bb-99c9-437b09f4a6eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:29.409602 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fc2e3-845e-40bb-99c9-437b09f4a6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:29.409880 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fc2e3-845e-40bb-99c9-437b09f4a6eb admin admin] PATH_INFO: `/v3/users/37cc4530defc41bba404ccf04b20731d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:29.411077 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566fc2e3-845e-40bb-99c9-437b09f4a6eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=37cc4530defc41bba404ccf04b20731d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:29.413011 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566fc2e3-845e-40bb-99c9-437b09f4a6eb admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:29.460029 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-566fc2e3-845e-40bb-99c9-437b09f4a6eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37cc4530defc41bba404ccf04b20731d'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:29.466781 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-566fc2e3-845e-40bb-99c9-437b09f4a6eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37cc4530defc41bba404ccf04b20731d'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:29.475889 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-566fc2e3-845e-40bb-99c9-437b09f4a6eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37cc4530defc41bba404ccf04b20731d'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:29.487014 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-566fc2e3-845e-40bb-99c9-437b09f4a6eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37cc4530defc41bba404ccf04b20731d'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:29.487676 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-566fc2e3-845e-40bb-99c9-437b09f4a6eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37cc4530defc41bba404ccf04b20731d'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:29.493394 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1415/2833] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:16:29 2022] DELETE /identity/v3/users/37cc4530defc41bba404ccf04b20731d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:16:29.498112 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7476e-059d-42c0-880d-59e82d6b5fea None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:29.498398 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7476e-059d-42c0-880d-59e82d6b5fea None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:29.498671 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7476e-059d-42c0-880d-59e82d6b5fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:29.516324 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-fcd7476e-059d-42c0-880d-59e82d6b5fea None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:29.517512 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-fcd7476e-059d-42c0-880d-59e82d6b5fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:29.584788 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1419/2834] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:16:29.594948 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fc2e3-845e-40bb-99c9-437b09f4a6eb admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:29.596496 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-566fc2e3-845e-40bb-99c9-437b09f4a6eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:29.656125 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fc2e3-845e-40bb-99c9-437b09f4a6eb admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:29.660326 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad5e33-086c-4523-859e-115cd436ea3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:29.660981 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad5e33-086c-4523-859e-115cd436ea3d service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:29.661259 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad5e33-086c-4523-859e-115cd436ea3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:29.661554 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad5e33-086c-4523-859e-115cd436ea3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:29.671102 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad5e33-086c-4523-859e-115cd436ea3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:29.672564 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad5e33-086c-4523-859e-115cd436ea3d service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:29.681966 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1416/2835] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:16:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:16:29.959122 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7476e-059d-42c0-880d-59e82d6b5fea None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:29.960713 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-fcd7476e-059d-42c0-880d-59e82d6b5fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:29.974411 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7476e-059d-42c0-880d-59e82d6b5fea None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:29.979525 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195af43e-8bfc-4abb-a11f-d6150ed53238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:29.981050 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195af43e-8bfc-4abb-a11f-d6150ed53238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:29.981341 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195af43e-8bfc-4abb-a11f-d6150ed53238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:29.981646 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195af43e-8bfc-4abb-a11f-d6150ed53238 admin admin] PATH_INFO: `/v3/projects/5bc30f3c340d419a954611711ff2b195` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:29.983034 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195af43e-8bfc-4abb-a11f-d6150ed53238 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bc30f3c340d419a954611711ff2b195)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:29.985034 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195af43e-8bfc-4abb-a11f-d6150ed53238 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:30.033243 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-195af43e-8bfc-4abb-a11f-d6150ed53238 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bc30f3c340d419a954611711ff2b195', 'request_id': 'req-195af43e-8bfc-4abb-a11f-d6150ed53238'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:30.039188 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-195af43e-8bfc-4abb-a11f-d6150ed53238 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bc30f3c340d419a954611711ff2b195', 'request_id': 'req-195af43e-8bfc-4abb-a11f-d6150ed53238'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:30.045661 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-195af43e-8bfc-4abb-a11f-d6150ed53238 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bc30f3c340d419a954611711ff2b195', 'request_id': 'req-195af43e-8bfc-4abb-a11f-d6150ed53238'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:30.059549 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-195af43e-8bfc-4abb-a11f-d6150ed53238 admin admin] The token cache is being invalidate because project 5bc30f3c340d419a954611711ff2b195 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:16:30.059839 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-195af43e-8bfc-4abb-a11f-d6150ed53238 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:30.060560 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-195af43e-8bfc-4abb-a11f-d6150ed53238 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:30.062253 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1420/2836] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:16:29 2022] DELETE /identity/v3/projects/5bc30f3c340d419a954611711ff2b195 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:16:30.067339 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61762a-1393-4401-9504-6fe40364dbcf None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:30.067723 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61762a-1393-4401-9504-6fe40364dbcf None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:30.068076 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61762a-1393-4401-9504-6fe40364dbcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:30.087986 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-0e61762a-1393-4401-9504-6fe40364dbcf None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:30.089099 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0e61762a-1393-4401-9504-6fe40364dbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:30.147563 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1417/2837] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:16:30.156870 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c188cad-b0e3-4458-b9df-a99481feb95d None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:30.157159 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c188cad-b0e3-4458-b9df-a99481feb95d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:30.157457 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c188cad-b0e3-4458-b9df-a99481feb95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:30.178719 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-4c188cad-b0e3-4458-b9df-a99481feb95d None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:30.179918 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-4c188cad-b0e3-4458-b9df-a99481feb95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:30.188005 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1421/2838] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:16:30.192543 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61762a-1393-4401-9504-6fe40364dbcf None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:30.202679 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61762a-1393-4401-9504-6fe40364dbcf None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:30.208009 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dee409-3d0f-4fc7-88da-3892563b5621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:30.208691 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dee409-3d0f-4fc7-88da-3892563b5621 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:30.208954 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dee409-3d0f-4fc7-88da-3892563b5621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:30.209227 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dee409-3d0f-4fc7-88da-3892563b5621 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:30.209995 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dee409-3d0f-4fc7-88da-3892563b5621 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:16:30.210305 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dee409-3d0f-4fc7-88da-3892563b5621 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:30.211912 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dee409-3d0f-4fc7-88da-3892563b5621 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:30.224545 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1418/2839] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:16:30.229332 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c188cad-b0e3-4458-b9df-a99481feb95d None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:30.239437 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c188cad-b0e3-4458-b9df-a99481feb95d None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:30.244455 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb540d-6905-46c1-82cb-3789197affe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:30.245125 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb540d-6905-46c1-82cb-3789197affe5 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:30.245433 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb540d-6905-46c1-82cb-3789197affe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:30.245797 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb540d-6905-46c1-82cb-3789197affe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:30.246392 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb540d-6905-46c1-82cb-3789197affe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:30.257027 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb540d-6905-46c1-82cb-3789197affe5 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:30.279503 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1422/2840] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:16:30 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:16:30.280589 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dee409-3d0f-4fc7-88da-3892563b5621 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:30.291600 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dee409-3d0f-4fc7-88da-3892563b5621 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:30.350749 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f99eb4-543b-48c6-8f7b-ffee4fd01d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:30.351492 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f99eb4-543b-48c6-8f7b-ffee4fd01d10 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:30.351773 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f99eb4-543b-48c6-8f7b-ffee4fd01d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:30.352046 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f99eb4-543b-48c6-8f7b-ffee4fd01d10 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:30.352753 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f99eb4-543b-48c6-8f7b-ffee4fd01d10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:30.354783 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f99eb4-543b-48c6-8f7b-ffee4fd01d10 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:30.378348 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1419/2841] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:16:30 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:16:30.379728 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb540d-6905-46c1-82cb-3789197affe5 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:30.390228 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb540d-6905-46c1-82cb-3789197affe5 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:30.394838 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5b489-5c39-46b5-a6ee-5d7326633d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:30.395501 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5b489-5c39-46b5-a6ee-5d7326633d42 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:30.395797 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5b489-5c39-46b5-a6ee-5d7326633d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:30.396068 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5b489-5c39-46b5-a6ee-5d7326633d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:30.396793 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb5b489-5c39-46b5-a6ee-5d7326633d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:30.398487 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb5b489-5c39-46b5-a6ee-5d7326633d42 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:30.408794 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1423/2842] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:16:30.412686 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f99eb4-543b-48c6-8f7b-ffee4fd01d10 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:30.422929 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f99eb4-543b-48c6-8f7b-ffee4fd01d10 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:30.429388 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625d825-61fc-43b1-860b-2e323a7a09f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:30.430089 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625d825-61fc-43b1-860b-2e323a7a09f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:30.430367 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625d825-61fc-43b1-860b-2e323a7a09f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:30.430636 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625d825-61fc-43b1-860b-2e323a7a09f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:30.431362 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c625d825-61fc-43b1-860b-2e323a7a09f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:30.433059 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c625d825-61fc-43b1-860b-2e323a7a09f2 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:30.443663 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1420/2843] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:16:30.448063 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5b489-5c39-46b5-a6ee-5d7326633d42 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:30.459765 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5b489-5c39-46b5-a6ee-5d7326633d42 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:30.465245 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43e351-07ba-42f5-9cde-981cb04dc158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:30.466307 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43e351-07ba-42f5-9cde-981cb04dc158 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:30.466590 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43e351-07ba-42f5-9cde-981cb04dc158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:30.466854 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43e351-07ba-42f5-9cde-981cb04dc158 admin admin] PATH_INFO: `/v3/projects/8bff3ff1f69a40b583a3d92332a9eb53/users/4105a9ca19074ebd9ba211cf5e7a926f/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:30.482596 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac43e351-07ba-42f5-9cde-981cb04dc158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bff3ff1f69a40b583a3d92332a9eb53, user_id=4105a9ca19074ebd9ba211cf5e7a926f, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:30.485374 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac43e351-07ba-42f5-9cde-981cb04dc158 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:30.500045 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1424/2844] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:16:30 2022] PUT /identity/v3/projects/8bff3ff1f69a40b583a3d92332a9eb53/users/4105a9ca19074ebd9ba211cf5e7a926f/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:16:30.510659 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad4508-bf45-409a-81f2-87bc8bc414de None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:30.510959 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad4508-bf45-409a-81f2-87bc8bc414de None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:30.511385 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad4508-bf45-409a-81f2-87bc8bc414de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:30.538721 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-2cad4508-bf45-409a-81f2-87bc8bc414de None None] MFA Rules not processed for user `4105a9ca19074ebd9ba211cf5e7a926f`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:30.539925 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2cad4508-bf45-409a-81f2-87bc8bc414de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:30.605346 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1421/2845] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:16:30.616930 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43e351-07ba-42f5-9cde-981cb04dc158 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:30.618745 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-ac43e351-07ba-42f5-9cde-981cb04dc158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:30.677243 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43e351-07ba-42f5-9cde-981cb04dc158 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:30.681735 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95839d32-859c-4762-a801-ebc567895b85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:30.682394 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95839d32-859c-4762-a801-ebc567895b85 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:30.682678 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95839d32-859c-4762-a801-ebc567895b85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:30.682950 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95839d32-859c-4762-a801-ebc567895b85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:30.691696 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95839d32-859c-4762-a801-ebc567895b85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:30.693166 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95839d32-859c-4762-a801-ebc567895b85 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:30.702527 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1425/2846] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:16:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:16:32.031016 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad4508-bf45-409a-81f2-87bc8bc414de None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:32.032650 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2cad4508-bf45-409a-81f2-87bc8bc414de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:32.248100 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad4508-bf45-409a-81f2-87bc8bc414de None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:32.253138 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0cf775-f7e2-4859-922d-f96a69129eef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '629742b135b2447898e8291d9a360295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:32.253834 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0cf775-f7e2-4859-922d-f96a69129eef service placement] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:32.254170 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0cf775-f7e2-4859-922d-f96a69129eef service placement] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:32.254450 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0cf775-f7e2-4859-922d-f96a69129eef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:32.256226 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1a0cf775-f7e2-4859-922d-f96a69129eef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:32.268458 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0cf775-f7e2-4859-922d-f96a69129eef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:32.270085 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0cf775-f7e2-4859-922d-f96a69129eef service placement] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:32.279852 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1422/2847] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:16:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:16:34.995505 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fe35a-8d77-4a82-813a-ad5b50530250 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:34.995996 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fe35a-8d77-4a82-813a-ad5b50530250 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:34.996103 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fe35a-8d77-4a82-813a-ad5b50530250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:35.014690 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-e12fe35a-8d77-4a82-813a-ad5b50530250 None None] MFA Rules not processed for user `64634c902a884b84a8bd2d3c10ce6270`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:35.015936 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-e12fe35a-8d77-4a82-813a-ad5b50530250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:35.077026 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1426/2848] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:16:35.367339 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0cf775-f7e2-4859-922d-f96a69129eef service placement] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:35.431562 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0cf775-f7e2-4859-922d-f96a69129eef service placement] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:35.436673 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6da17-35ca-4319-924b-f7d5201f79c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:35.437573 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6da17-35ca-4319-924b-f7d5201f79c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:35.437845 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6da17-35ca-4319-924b-f7d5201f79c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:35.438118 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6da17-35ca-4319-924b-f7d5201f79c3 admin admin] PATH_INFO: `/v3/users/4105a9ca19074ebd9ba211cf5e7a926f` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:35.439411 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6da17-35ca-4319-924b-f7d5201f79c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4105a9ca19074ebd9ba211cf5e7a926f)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:35.441373 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6da17-35ca-4319-924b-f7d5201f79c3 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:35.488744 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d1b6da17-35ca-4319-924b-f7d5201f79c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4105a9ca19074ebd9ba211cf5e7a926f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:35.495157 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d1b6da17-35ca-4319-924b-f7d5201f79c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4105a9ca19074ebd9ba211cf5e7a926f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:35.502987 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d1b6da17-35ca-4319-924b-f7d5201f79c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4105a9ca19074ebd9ba211cf5e7a926f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:35.515535 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d1b6da17-35ca-4319-924b-f7d5201f79c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4105a9ca19074ebd9ba211cf5e7a926f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:35.516207 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d1b6da17-35ca-4319-924b-f7d5201f79c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4105a9ca19074ebd9ba211cf5e7a926f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:35.522248 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1423/2849] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:16:35 2022] DELETE /identity/v3/users/4105a9ca19074ebd9ba211cf5e7a926f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:16:35.526911 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d7cf3-7485-4cd0-b5ae-c0391f7fa8a2 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:35.527274 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d7cf3-7485-4cd0-b5ae-c0391f7fa8a2 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:35.527647 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d7cf3-7485-4cd0-b5ae-c0391f7fa8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:35.545314 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-b68d7cf3-7485-4cd0-b5ae-c0391f7fa8a2 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:35.546546 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-b68d7cf3-7485-4cd0-b5ae-c0391f7fa8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:35.603565 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1427/2850] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:16:35.613682 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6da17-35ca-4319-924b-f7d5201f79c3 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:35.615088 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d1b6da17-35ca-4319-924b-f7d5201f79c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:35.672012 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6da17-35ca-4319-924b-f7d5201f79c3 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:35.675829 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd6e5b-d984-458d-a2b3-691fd216adef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:35.676485 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd6e5b-d984-458d-a2b3-691fd216adef service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:35.676764 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd6e5b-d984-458d-a2b3-691fd216adef service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:35.677036 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd6e5b-d984-458d-a2b3-691fd216adef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:35.686335 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd6e5b-d984-458d-a2b3-691fd216adef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:35.687777 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd6e5b-d984-458d-a2b3-691fd216adef service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:35.698083 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1424/2851] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:16:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:16:35.990215 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d7cf3-7485-4cd0-b5ae-c0391f7fa8a2 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:35.992120 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-b68d7cf3-7485-4cd0-b5ae-c0391f7fa8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:36.006718 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d7cf3-7485-4cd0-b5ae-c0391f7fa8a2 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:36.018634 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2623e-cb1d-425b-a801-98b601d9a7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:36.035109 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2623e-cb1d-425b-a801-98b601d9a7d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:36.038046 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2623e-cb1d-425b-a801-98b601d9a7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:36.038878 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2623e-cb1d-425b-a801-98b601d9a7d0 admin admin] PATH_INFO: `/v3/projects/8bff3ff1f69a40b583a3d92332a9eb53` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:36.039851 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2623e-cb1d-425b-a801-98b601d9a7d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bff3ff1f69a40b583a3d92332a9eb53)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:36.041937 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2623e-cb1d-425b-a801-98b601d9a7d0 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:36.103006 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a5a2623e-cb1d-425b-a801-98b601d9a7d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bff3ff1f69a40b583a3d92332a9eb53', 'request_id': 'req-a5a2623e-cb1d-425b-a801-98b601d9a7d0'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:36.110357 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a5a2623e-cb1d-425b-a801-98b601d9a7d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bff3ff1f69a40b583a3d92332a9eb53', 'request_id': 'req-a5a2623e-cb1d-425b-a801-98b601d9a7d0'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:36.120178 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a5a2623e-cb1d-425b-a801-98b601d9a7d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bff3ff1f69a40b583a3d92332a9eb53', 'request_id': 'req-a5a2623e-cb1d-425b-a801-98b601d9a7d0'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:36.134866 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a5a2623e-cb1d-425b-a801-98b601d9a7d0 admin admin] The token cache is being invalidate because project 8bff3ff1f69a40b583a3d92332a9eb53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:16:36.135758 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a5a2623e-cb1d-425b-a801-98b601d9a7d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:36.136760 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a5a2623e-cb1d-425b-a801-98b601d9a7d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:36.141612 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1428/2852] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:16:35 2022] DELETE /identity/v3/projects/8bff3ff1f69a40b583a3d92332a9eb53 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:16:36.144294 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d80924-ee7a-4e5d-b29d-6ec39a34b80c None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:36.144604 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d80924-ee7a-4e5d-b29d-6ec39a34b80c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:36.145014 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d80924-ee7a-4e5d-b29d-6ec39a34b80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:36.166211 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-c4d80924-ee7a-4e5d-b29d-6ec39a34b80c None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:36.167472 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c4d80924-ee7a-4e5d-b29d-6ec39a34b80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:36.229344 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1425/2853] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:16:36.237595 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c759956-f43a-4471-81cc-8ad1f994f04d None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:36.238074 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c759956-f43a-4471-81cc-8ad1f994f04d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:36.238368 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c759956-f43a-4471-81cc-8ad1f994f04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:36.257708 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-9c759956-f43a-4471-81cc-8ad1f994f04d None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:36.258925 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-9c759956-f43a-4471-81cc-8ad1f994f04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:36.268417 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1429/2854] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:16:36.272901 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d80924-ee7a-4e5d-b29d-6ec39a34b80c None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:36.282989 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d80924-ee7a-4e5d-b29d-6ec39a34b80c None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:36.287961 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833efbb7-8f0c-4394-a481-f2de82d85a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:36.288639 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833efbb7-8f0c-4394-a481-f2de82d85a0f admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:36.288920 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833efbb7-8f0c-4394-a481-f2de82d85a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:36.289283 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833efbb7-8f0c-4394-a481-f2de82d85a0f admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:36.289959 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833efbb7-8f0c-4394-a481-f2de82d85a0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:16:36.290267 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833efbb7-8f0c-4394-a481-f2de82d85a0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:36.291881 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833efbb7-8f0c-4394-a481-f2de82d85a0f admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:36.304209 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1426/2855] 10.222.0.24 () {58 vars in 1152 bytes} [Mon May 16 19:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:16:36.309024 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c759956-f43a-4471-81cc-8ad1f994f04d None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:36.320718 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c759956-f43a-4471-81cc-8ad1f994f04d None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:36.325567 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d19d8-6390-430a-b331-394a27040643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:36.326451 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d19d8-6390-430a-b331-394a27040643 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:36.326735 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d19d8-6390-430a-b331-394a27040643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:36.327026 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d19d8-6390-430a-b331-394a27040643 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:36.327792 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7d19d8-6390-430a-b331-394a27040643 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:36.330131 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7d19d8-6390-430a-b331-394a27040643 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:36.361965 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1430/2856] 10.222.0.24 () {60 vars in 1152 bytes} [Mon May 16 19:16:36 2022] POST /identity/v3/projects => generated 395 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:16:36.363104 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833efbb7-8f0c-4394-a481-f2de82d85a0f admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:36.375426 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833efbb7-8f0c-4394-a481-f2de82d85a0f admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:36.444391 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7f05d-b2f9-484a-af4b-a825ab7a0c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:36.445350 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7f05d-b2f9-484a-af4b-a825ab7a0c98 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:36.445934 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7f05d-b2f9-484a-af4b-a825ab7a0c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:36.446738 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7f05d-b2f9-484a-af4b-a825ab7a0c98 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:36.447635 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa7f05d-b2f9-484a-af4b-a825ab7a0c98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:36.449830 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa7f05d-b2f9-484a-af4b-a825ab7a0c98 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:36.477885 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1427/2857] 10.222.0.24 () {60 vars in 1143 bytes} [Mon May 16 19:16:36 2022] POST /identity/v3/users => generated 298 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:16:36.481839 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d19d8-6390-430a-b331-394a27040643 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:36.492002 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d19d8-6390-430a-b331-394a27040643 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:36.496587 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8ff45-48fc-4243-99e1-62f12e801352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:36.497263 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8ff45-48fc-4243-99e1-62f12e801352 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:36.497552 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8ff45-48fc-4243-99e1-62f12e801352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:36.497853 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8ff45-48fc-4243-99e1-62f12e801352 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:36.498703 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e8ff45-48fc-4243-99e1-62f12e801352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:36.500358 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e8ff45-48fc-4243-99e1-62f12e801352 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:36.511544 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1431/2858] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:16:36.515848 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7f05d-b2f9-484a-af4b-a825ab7a0c98 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:36.526122 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7f05d-b2f9-484a-af4b-a825ab7a0c98 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:36.531270 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca46aab-7fed-4777-9aeb-9d6d759927cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:36.531942 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca46aab-7fed-4777-9aeb-9d6d759927cf admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:36.532353 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca46aab-7fed-4777-9aeb-9d6d759927cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:36.532633 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca46aab-7fed-4777-9aeb-9d6d759927cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:36.533430 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca46aab-7fed-4777-9aeb-9d6d759927cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:36.535158 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca46aab-7fed-4777-9aeb-9d6d759927cf admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:36.549048 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1428/2859] 10.222.0.24 () {58 vars in 1121 bytes} [Mon May 16 19:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 19:16:36.550299 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8ff45-48fc-4243-99e1-62f12e801352 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:36.560813 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8ff45-48fc-4243-99e1-62f12e801352 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:36.565747 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7571f-b615-482d-ad5d-1d5d3b1060b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:36.566645 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7571f-b615-482d-ad5d-1d5d3b1060b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:36.566927 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7571f-b615-482d-ad5d-1d5d3b1060b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:36.567201 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7571f-b615-482d-ad5d-1d5d3b1060b2 admin admin] PATH_INFO: `/v3/projects/73efcd158656481384d61d37491b6cba/users/cb62f061bbf2400a985889e8fd64d563/roles/b0e5c5e3b5f54789a5a5c4c51220c97e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:36.582203 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7571f-b615-482d-ad5d-1d5d3b1060b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73efcd158656481384d61d37491b6cba, user_id=cb62f061bbf2400a985889e8fd64d563, role_id=b0e5c5e3b5f54789a5a5c4c51220c97e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:36.584960 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7571f-b615-482d-ad5d-1d5d3b1060b2 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:36.599407 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1432/2860] 10.222.0.24 () {60 vars in 1482 bytes} [Mon May 16 19:16:36 2022] PUT /identity/v3/projects/73efcd158656481384d61d37491b6cba/users/cb62f061bbf2400a985889e8fd64d563/roles/b0e5c5e3b5f54789a5a5c4c51220c97e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:16:36.611003 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb06bb-cec1-469a-aa61-12ba2d8733c9 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:36.611313 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb06bb-cec1-469a-aa61-12ba2d8733c9 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:36.611607 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb06bb-cec1-469a-aa61-12ba2d8733c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:36.638381 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-b4cb06bb-cec1-469a-aa61-12ba2d8733c9 None None] MFA Rules not processed for user `cb62f061bbf2400a985889e8fd64d563`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:36.639924 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b4cb06bb-cec1-469a-aa61-12ba2d8733c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:36.710282 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1429/2861] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:16:36.725191 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7571f-b615-482d-ad5d-1d5d3b1060b2 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:36.727286 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-0bf7571f-b615-482d-ad5d-1d5d3b1060b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:36.788143 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7571f-b615-482d-ad5d-1d5d3b1060b2 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:36.792596 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815b900-1b84-44f8-9611-0b13ba2cbabf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:36.793236 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815b900-1b84-44f8-9611-0b13ba2cbabf service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:36.793520 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815b900-1b84-44f8-9611-0b13ba2cbabf service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:36.793823 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815b900-1b84-44f8-9611-0b13ba2cbabf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:36.802958 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815b900-1b84-44f8-9611-0b13ba2cbabf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:36.804415 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815b900-1b84-44f8-9611-0b13ba2cbabf service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:36.814493 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1433/2862] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:16:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 19:16:43.905398 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb06bb-cec1-469a-aa61-12ba2d8733c9 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:43.983697 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb06bb-cec1-469a-aa61-12ba2d8733c9 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:43.989373 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e0e3a-8747-4a5a-a9f8-e13a15c23413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:43.990274 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e0e3a-8747-4a5a-a9f8-e13a15c23413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:43.990560 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e0e3a-8747-4a5a-a9f8-e13a15c23413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:43.990820 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e0e3a-8747-4a5a-a9f8-e13a15c23413 admin admin] PATH_INFO: `/v3/users/cb62f061bbf2400a985889e8fd64d563` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:43.992072 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e0e3a-8747-4a5a-a9f8-e13a15c23413 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb62f061bbf2400a985889e8fd64d563)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:43.994024 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e0e3a-8747-4a5a-a9f8-e13a15c23413 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:44.057720 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1f0e0e3a-8747-4a5a-a9f8-e13a15c23413 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb62f061bbf2400a985889e8fd64d563'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:44.064438 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1f0e0e3a-8747-4a5a-a9f8-e13a15c23413 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb62f061bbf2400a985889e8fd64d563'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:44.072312 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1f0e0e3a-8747-4a5a-a9f8-e13a15c23413 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb62f061bbf2400a985889e8fd64d563'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:44.084593 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1f0e0e3a-8747-4a5a-a9f8-e13a15c23413 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb62f061bbf2400a985889e8fd64d563'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:44.085362 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1f0e0e3a-8747-4a5a-a9f8-e13a15c23413 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb62f061bbf2400a985889e8fd64d563'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:44.091293 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1430/2863] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:16:43 2022] DELETE /identity/v3/users/cb62f061bbf2400a985889e8fd64d563 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:16:44.095938 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e178b-a15d-49ae-a948-a06c5420509a None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:44.096451 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e178b-a15d-49ae-a948-a06c5420509a None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:44.096617 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e178b-a15d-49ae-a948-a06c5420509a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:44.114193 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-1b6e178b-a15d-49ae-a948-a06c5420509a None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:16:44.116146 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-1b6e178b-a15d-49ae-a948-a06c5420509a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:44.188819 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1434/2864] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:16:44.199104 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e0e3a-8747-4a5a-a9f8-e13a15c23413 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:44.200675 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1f0e0e3a-8747-4a5a-a9f8-e13a15c23413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:44.281713 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e0e3a-8747-4a5a-a9f8-e13a15c23413 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:44.287269 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0923d5-a038-45f7-a5a8-9b53d4d5bd42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:44.287952 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0923d5-a038-45f7-a5a8-9b53d4d5bd42 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:44.288200 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0923d5-a038-45f7-a5a8-9b53d4d5bd42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:44.288492 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0923d5-a038-45f7-a5a8-9b53d4d5bd42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:44.300788 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0923d5-a038-45f7-a5a8-9b53d4d5bd42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:44.302300 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0923d5-a038-45f7-a5a8-9b53d4d5bd42 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:44.312054 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1431/2865] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:16:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:16:44.608096 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e178b-a15d-49ae-a948-a06c5420509a None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:16:44.609747 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-1b6e178b-a15d-49ae-a948-a06c5420509a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:16:44.621690 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e178b-a15d-49ae-a948-a06c5420509a None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:16:44.626573 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa4561-7c07-4ef6-a44d-ccb929faaa37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:16:44.627452 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa4561-7c07-4ef6-a44d-ccb929faaa37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:16:44.627731 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa4561-7c07-4ef6-a44d-ccb929faaa37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:16:44.628063 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa4561-7c07-4ef6-a44d-ccb929faaa37 admin admin] PATH_INFO: `/v3/projects/73efcd158656481384d61d37491b6cba` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:16:44.629270 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa4561-7c07-4ef6-a44d-ccb929faaa37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73efcd158656481384d61d37491b6cba)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:16:44.631251 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa4561-7c07-4ef6-a44d-ccb929faaa37 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:16:44.680555 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-fdfa4561-7c07-4ef6-a44d-ccb929faaa37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73efcd158656481384d61d37491b6cba', 'request_id': 'req-fdfa4561-7c07-4ef6-a44d-ccb929faaa37'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:44.685889 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-fdfa4561-7c07-4ef6-a44d-ccb929faaa37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73efcd158656481384d61d37491b6cba', 'request_id': 'req-fdfa4561-7c07-4ef6-a44d-ccb929faaa37'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:44.692732 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-fdfa4561-7c07-4ef6-a44d-ccb929faaa37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73efcd158656481384d61d37491b6cba', 'request_id': 'req-fdfa4561-7c07-4ef6-a44d-ccb929faaa37'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:44.708776 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-fdfa4561-7c07-4ef6-a44d-ccb929faaa37 admin admin] The token cache is being invalidate because project 73efcd158656481384d61d37491b6cba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:16:44.708992 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-fdfa4561-7c07-4ef6-a44d-ccb929faaa37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:44.709618 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-fdfa4561-7c07-4ef6-a44d-ccb929faaa37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:16:44.711184 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1435/2866] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:16:44 2022] DELETE /identity/v3/projects/73efcd158656481384d61d37491b6cba => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:17:01.979323 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0923d5-a038-45f7-a5a8-9b53d4d5bd42 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:17:01.991876 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0923d5-a038-45f7-a5a8-9b53d4d5bd42 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:17:02.044961 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd61fa-0a8b-4b25-9541-84f587ae172a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:17:02.045596 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd61fa-0a8b-4b25-9541-84f587ae172a service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:17:02.045894 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd61fa-0a8b-4b25-9541-84f587ae172a service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:17:02.046160 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd61fa-0a8b-4b25-9541-84f587ae172a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:17:02.048405 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c0bd61fa-0a8b-4b25-9541-84f587ae172a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:17:02.117586 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd61fa-0a8b-4b25-9541-84f587ae172a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:17:02.118979 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd61fa-0a8b-4b25-9541-84f587ae172a service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:17:02.132764 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1432/2867] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:17:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:17:02.186931 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa4561-7c07-4ef6-a44d-ccb929faaa37 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:17:02.188590 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-fdfa4561-7c07-4ef6-a44d-ccb929faaa37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:17:02.253724 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa4561-7c07-4ef6-a44d-ccb929faaa37 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:17:02.258250 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c825920-5793-402c-8fac-7bd385f54ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:17:02.259144 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c825920-5793-402c-8fac-7bd385f54ca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:17:02.259461 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c825920-5793-402c-8fac-7bd385f54ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:17:02.259698 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c825920-5793-402c-8fac-7bd385f54ca8 admin admin] PATH_INFO: `/v3/users/72f93b2c676c4774896076e110d4adcd` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:17:02.260913 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c825920-5793-402c-8fac-7bd385f54ca8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72f93b2c676c4774896076e110d4adcd)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:17:02.263315 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c825920-5793-402c-8fac-7bd385f54ca8 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:17:02.312681 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-5c825920-5793-402c-8fac-7bd385f54ca8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72f93b2c676c4774896076e110d4adcd'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:17:02.320172 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-5c825920-5793-402c-8fac-7bd385f54ca8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72f93b2c676c4774896076e110d4adcd'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:17:02.327623 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-5c825920-5793-402c-8fac-7bd385f54ca8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72f93b2c676c4774896076e110d4adcd'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:17:02.327892 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-5c825920-5793-402c-8fac-7bd385f54ca8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72f93b2c676c4774896076e110d4adcd'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:17:02.339985 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-5c825920-5793-402c-8fac-7bd385f54ca8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72f93b2c676c4774896076e110d4adcd'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:17:02.346729 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1436/2868] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:17:02 2022] DELETE /identity/v3/users/72f93b2c676c4774896076e110d4adcd => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:17:02.352120 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3b34c-c3ce-44f5-bead-242141b3f5b3 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:17:02.352406 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3b34c-c3ce-44f5-bead-242141b3f5b3 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:17:02.352687 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3b34c-c3ce-44f5-bead-242141b3f5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:17:02.370640 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-f9a3b34c-c3ce-44f5-bead-242141b3f5b3 None None] MFA Rules not processed for user `e70b26bfebd8410b8d3b2aa16cacd530`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:17:02.371810 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f9a3b34c-c3ce-44f5-bead-242141b3f5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:17:02.431456 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1433/2869] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:17:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:17:02.441485 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c825920-5793-402c-8fac-7bd385f54ca8 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:17:02.442969 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-5c825920-5793-402c-8fac-7bd385f54ca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:17:02.500348 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c825920-5793-402c-8fac-7bd385f54ca8 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:17:02.504785 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810724bf-82d5-4c8f-80dd-01b333d1d5d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:17:02.505381 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810724bf-82d5-4c8f-80dd-01b333d1d5d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:17:02.505691 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810724bf-82d5-4c8f-80dd-01b333d1d5d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:17:02.505991 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810724bf-82d5-4c8f-80dd-01b333d1d5d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:17:02.516352 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810724bf-82d5-4c8f-80dd-01b333d1d5d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:17:02.517911 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810724bf-82d5-4c8f-80dd-01b333d1d5d7 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:17:02.527966 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1437/2870] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:17:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:17:02.797551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3b34c-c3ce-44f5-bead-242141b3f5b3 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:17:02.799012 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f9a3b34c-c3ce-44f5-bead-242141b3f5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:17:02.817129 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3b34c-c3ce-44f5-bead-242141b3f5b3 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:17:02.824399 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dbbdb8-6f24-4afe-89ae-38d25b5c7c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:17:02.825507 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbbdb8-6f24-4afe-89ae-38d25b5c7c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:17:02.825937 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbbdb8-6f24-4afe-89ae-38d25b5c7c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:17:02.826197 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbbdb8-6f24-4afe-89ae-38d25b5c7c17 admin admin] PATH_INFO: `/v3/projects/3f52bae4e4584aaabf1ab928c13a727a` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:17:02.827370 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dbbdb8-6f24-4afe-89ae-38d25b5c7c17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f52bae4e4584aaabf1ab928c13a727a)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:17:02.829311 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dbbdb8-6f24-4afe-89ae-38d25b5c7c17 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:17:02.875351 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a7dbbdb8-6f24-4afe-89ae-38d25b5c7c17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f52bae4e4584aaabf1ab928c13a727a', 'request_id': 'req-a7dbbdb8-6f24-4afe-89ae-38d25b5c7c17'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:17:02.882539 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a7dbbdb8-6f24-4afe-89ae-38d25b5c7c17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f52bae4e4584aaabf1ab928c13a727a', 'request_id': 'req-a7dbbdb8-6f24-4afe-89ae-38d25b5c7c17'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:17:02.888456 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a7dbbdb8-6f24-4afe-89ae-38d25b5c7c17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f52bae4e4584aaabf1ab928c13a727a', 'request_id': 'req-a7dbbdb8-6f24-4afe-89ae-38d25b5c7c17'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:17:02.900275 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a7dbbdb8-6f24-4afe-89ae-38d25b5c7c17 admin admin] The token cache is being invalidate because project 3f52bae4e4584aaabf1ab928c13a727a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:17:02.900516 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a7dbbdb8-6f24-4afe-89ae-38d25b5c7c17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:17:02.901186 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a7dbbdb8-6f24-4afe-89ae-38d25b5c7c17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:17:02.902762 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1434/2871] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:17:02 2022] DELETE /identity/v3/projects/3f52bae4e4584aaabf1ab928c13a727a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:17:06.857325 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810724bf-82d5-4c8f-80dd-01b333d1d5d7 service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:17:06.866912 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810724bf-82d5-4c8f-80dd-01b333d1d5d7 service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:17:06.915141 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588fd63-0285-4b3c-9ec4-5c840fca01ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:17:06.915784 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588fd63-0285-4b3c-9ec4-5c840fca01ad service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:17:06.916064 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588fd63-0285-4b3c-9ec4-5c840fca01ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:17:06.916338 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588fd63-0285-4b3c-9ec4-5c840fca01ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:17:06.918171 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f588fd63-0285-4b3c-9ec4-5c840fca01ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:17:06.986357 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f588fd63-0285-4b3c-9ec4-5c840fca01ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:17:06.987770 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f588fd63-0285-4b3c-9ec4-5c840fca01ad service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:17:06.997685 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1438/2872] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:17:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:17:13.596185 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dbbdb8-6f24-4afe-89ae-38d25b5c7c17 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:17:13.597738 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a7dbbdb8-6f24-4afe-89ae-38d25b5c7c17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:17:13.610605 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dbbdb8-6f24-4afe-89ae-38d25b5c7c17 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:17:13.615803 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d1b80-5633-4e7f-a236-e6b879b66d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:17:13.616701 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d1b80-5633-4e7f-a236-e6b879b66d6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:17:13.616982 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d1b80-5633-4e7f-a236-e6b879b66d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:17:13.617256 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d1b80-5633-4e7f-a236-e6b879b66d6e admin admin] PATH_INFO: `/v3/users/16afce4f51384e37b381171cbc2e0a82` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:17:13.618498 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d1b80-5633-4e7f-a236-e6b879b66d6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=16afce4f51384e37b381171cbc2e0a82)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:17:13.620551 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d1b80-5633-4e7f-a236-e6b879b66d6e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:17:13.670946 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-198d1b80-5633-4e7f-a236-e6b879b66d6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16afce4f51384e37b381171cbc2e0a82'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:17:13.677727 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-198d1b80-5633-4e7f-a236-e6b879b66d6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16afce4f51384e37b381171cbc2e0a82'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:17:13.687987 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-198d1b80-5633-4e7f-a236-e6b879b66d6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16afce4f51384e37b381171cbc2e0a82'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:17:13.701340 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-198d1b80-5633-4e7f-a236-e6b879b66d6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16afce4f51384e37b381171cbc2e0a82'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:17:13.702106 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-198d1b80-5633-4e7f-a236-e6b879b66d6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16afce4f51384e37b381171cbc2e0a82'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:17:13.708595 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1435/2873] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:17:13 2022] DELETE /identity/v3/users/16afce4f51384e37b381171cbc2e0a82 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:17:13.890148 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588fd63-0285-4b3c-9ec4-5c840fca01ad service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:17:13.900529 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588fd63-0285-4b3c-9ec4-5c840fca01ad service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:17:13.959378 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d9740-3e3d-4e87-969d-6464de7e9153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:17:13.960639 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d9740-3e3d-4e87-969d-6464de7e9153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:17:13.960943 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d9740-3e3d-4e87-969d-6464de7e9153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:17:13.961226 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d9740-3e3d-4e87-969d-6464de7e9153 admin admin] PATH_INFO: `/v3/projects/5e758da8d71142bdbac8765efccefde8` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:17:13.962532 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d9740-3e3d-4e87-969d-6464de7e9153 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e758da8d71142bdbac8765efccefde8)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:17:13.964848 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d9740-3e3d-4e87-969d-6464de7e9153 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:17:14.022328 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-448d9740-3e3d-4e87-969d-6464de7e9153 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e758da8d71142bdbac8765efccefde8', 'request_id': 'req-448d9740-3e3d-4e87-969d-6464de7e9153'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:17:14.027820 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-448d9740-3e3d-4e87-969d-6464de7e9153 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e758da8d71142bdbac8765efccefde8', 'request_id': 'req-448d9740-3e3d-4e87-969d-6464de7e9153'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:17:14.034510 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-448d9740-3e3d-4e87-969d-6464de7e9153 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e758da8d71142bdbac8765efccefde8', 'request_id': 'req-448d9740-3e3d-4e87-969d-6464de7e9153'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:17:14.055920 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-448d9740-3e3d-4e87-969d-6464de7e9153 admin admin] The token cache is being invalidate because project 5e758da8d71142bdbac8765efccefde8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:17:14.056108 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-448d9740-3e3d-4e87-969d-6464de7e9153 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:17:14.056886 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-448d9740-3e3d-4e87-969d-6464de7e9153 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:17:14.058593 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1439/2874] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:17:13 2022] DELETE /identity/v3/projects/5e758da8d71142bdbac8765efccefde8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:17:14.062732 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d1b80-5633-4e7f-a236-e6b879b66d6e admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:17:14.064113 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-198d1b80-5633-4e7f-a236-e6b879b66d6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:17:14.077117 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d1b80-5633-4e7f-a236-e6b879b66d6e admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:17:14.141823 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd79ee-f5ac-4847-8501-d3abcfce7b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:17:14.143057 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd79ee-f5ac-4847-8501-d3abcfce7b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:17:14.143454 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd79ee-f5ac-4847-8501-d3abcfce7b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:17:14.143848 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd79ee-f5ac-4847-8501-d3abcfce7b69 admin admin] PATH_INFO: `/v3/users/254bc90f1c7a4fa6b9e593fef63f44cf` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:17:14.145473 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd79ee-f5ac-4847-8501-d3abcfce7b69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=254bc90f1c7a4fa6b9e593fef63f44cf)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:17:14.147455 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd79ee-f5ac-4847-8501-d3abcfce7b69 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:17:14.202505 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4dcd79ee-f5ac-4847-8501-d3abcfce7b69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '254bc90f1c7a4fa6b9e593fef63f44cf'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:17:14.211305 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4dcd79ee-f5ac-4847-8501-d3abcfce7b69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '254bc90f1c7a4fa6b9e593fef63f44cf'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:17:14.220045 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4dcd79ee-f5ac-4847-8501-d3abcfce7b69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '254bc90f1c7a4fa6b9e593fef63f44cf'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:17:14.233190 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4dcd79ee-f5ac-4847-8501-d3abcfce7b69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '254bc90f1c7a4fa6b9e593fef63f44cf'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:17:14.233873 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4dcd79ee-f5ac-4847-8501-d3abcfce7b69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '254bc90f1c7a4fa6b9e593fef63f44cf'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:17:14.239932 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1436/2875] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:17:14 2022] DELETE /identity/v3/users/254bc90f1c7a4fa6b9e593fef63f44cf => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:17:14.440687 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d9740-3e3d-4e87-969d-6464de7e9153 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:17:14.442282 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-448d9740-3e3d-4e87-969d-6464de7e9153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:17:14.455226 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d9740-3e3d-4e87-969d-6464de7e9153 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:17:14.515909 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3fbe6-a008-40a3-9f7c-89a458b67913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:17:14.516788 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3fbe6-a008-40a3-9f7c-89a458b67913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:17:14.517070 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3fbe6-a008-40a3-9f7c-89a458b67913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:17:14.517339 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3fbe6-a008-40a3-9f7c-89a458b67913 admin admin] PATH_INFO: `/v3/projects/83f09aa01b714c549f44f03f652089bd` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:17:14.518721 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3fbe6-a008-40a3-9f7c-89a458b67913 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83f09aa01b714c549f44f03f652089bd)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:17:14.520674 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3fbe6-a008-40a3-9f7c-89a458b67913 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:17:14.568323 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-18b3fbe6-a008-40a3-9f7c-89a458b67913 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83f09aa01b714c549f44f03f652089bd', 'request_id': 'req-18b3fbe6-a008-40a3-9f7c-89a458b67913'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:17:14.573621 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-18b3fbe6-a008-40a3-9f7c-89a458b67913 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83f09aa01b714c549f44f03f652089bd', 'request_id': 'req-18b3fbe6-a008-40a3-9f7c-89a458b67913'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:17:14.579555 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-18b3fbe6-a008-40a3-9f7c-89a458b67913 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83f09aa01b714c549f44f03f652089bd', 'request_id': 'req-18b3fbe6-a008-40a3-9f7c-89a458b67913'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:17:14.594771 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-18b3fbe6-a008-40a3-9f7c-89a458b67913 admin admin] The token cache is being invalidate because project 83f09aa01b714c549f44f03f652089bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:17:14.595105 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-18b3fbe6-a008-40a3-9f7c-89a458b67913 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:17:14.595878 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-18b3fbe6-a008-40a3-9f7c-89a458b67913 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:17:14.597757 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1440/2876] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:17:14 2022] DELETE /identity/v3/projects/83f09aa01b714c549f44f03f652089bd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:18:40.481396 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87147a-c86d-4cd6-9e39-86fb096390a8 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:18:40.482401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87147a-c86d-4cd6-9e39-86fb096390a8 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:18:40.482401 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87147a-c86d-4cd6-9e39-86fb096390a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:18:40.507592 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-1e87147a-c86d-4cd6-9e39-86fb096390a8 None None] MFA Rules not processed for user `64634c902a884b84a8bd2d3c10ce6270`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:18:40.508808 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1e87147a-c86d-4cd6-9e39-86fb096390a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:18:40.570605 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1437/2877] 10.222.0.24 () {58 vars in 957 bytes} [Mon May 16 19:18:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:18:40.615124 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3fbe6-a008-40a3-9f7c-89a458b67913 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:18:40.616648 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-18b3fbe6-a008-40a3-9f7c-89a458b67913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:18:40.675862 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3fbe6-a008-40a3-9f7c-89a458b67913 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:18:40.679718 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c0447-717a-4354-96f3-e158a5632a23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:18:40.680398 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c0447-717a-4354-96f3-e158a5632a23 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:18:40.680681 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c0447-717a-4354-96f3-e158a5632a23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:18:40.680959 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c0447-717a-4354-96f3-e158a5632a23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:18:40.683002 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-b62c0447-717a-4354-96f3-e158a5632a23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:18:40.753779 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c0447-717a-4354-96f3-e158a5632a23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:18:40.755239 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c0447-717a-4354-96f3-e158a5632a23 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:18:40.766921 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1441/2878] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:18:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:18:41.319871 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87147a-c86d-4cd6-9e39-86fb096390a8 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:18:41.321355 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1e87147a-c86d-4cd6-9e39-86fb096390a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:18:41.334312 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87147a-c86d-4cd6-9e39-86fb096390a8 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:18:41.338688 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f98216-5f33-442f-84a4-abc3dac154eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36439df302854b158c85f4fbb5bcb7d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:18:41.339321 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f98216-5f33-442f-84a4-abc3dac154eb service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:18:41.339609 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f98216-5f33-442f-84a4-abc3dac154eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:18:41.339868 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f98216-5f33-442f-84a4-abc3dac154eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:18:41.341909 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-99f98216-5f33-442f-84a4-abc3dac154eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:18:41.352976 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f98216-5f33-442f-84a4-abc3dac154eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:18:41.354427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f98216-5f33-442f-84a4-abc3dac154eb service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:18:41.363359 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1438/2879] 10.222.0.24 () {60 vars in 1396 bytes} [Mon May 16 19:18:41 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3246 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:18:41.565853 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c0447-717a-4354-96f3-e158a5632a23 service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:18:41.567515 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-b62c0447-717a-4354-96f3-e158a5632a23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:18:41.577427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f98216-5f33-442f-84a4-abc3dac154eb service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:18:41.578882 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-99f98216-5f33-442f-84a4-abc3dac154eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:18:41.638613 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c0447-717a-4354-96f3-e158a5632a23 service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:18:41.639298 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f98216-5f33-442f-84a4-abc3dac154eb service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:18:41.643427 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2155e2fc-0d21-4c48-9a72-dfcc967c7205 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:18:41.644116 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155e2fc-0d21-4c48-9a72-dfcc967c7205 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:18:41.644365 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155e2fc-0d21-4c48-9a72-dfcc967c7205 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:18:41.644652 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155e2fc-0d21-4c48-9a72-dfcc967c7205 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:18:41.645383 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686b0e0-aa1f-4bfc-b628-8a3ac189b712 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '629742b135b2447898e8291d9a360295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:18:41.646077 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686b0e0-aa1f-4bfc-b628-8a3ac189b712 service placement] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:18:41.646342 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686b0e0-aa1f-4bfc-b628-8a3ac189b712 service placement] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:18:41.646463 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2155e2fc-0d21-4c48-9a72-dfcc967c7205 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:18:41.646654 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686b0e0-aa1f-4bfc-b628-8a3ac189b712 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:18:41.648401 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f686b0e0-aa1f-4bfc-b628-8a3ac189b712 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:18:41.659785 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2155e2fc-0d21-4c48-9a72-dfcc967c7205 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:18:41.660513 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f686b0e0-aa1f-4bfc-b628-8a3ac189b712 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:18:41.661243 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2155e2fc-0d21-4c48-9a72-dfcc967c7205 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:18:41.662181 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f686b0e0-aa1f-4bfc-b628-8a3ac189b712 service placement] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:18:41.672336 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1439/2880] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:18:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 19:18:41.672482 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1442/2881] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:18:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:18:43.332739 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2155e2fc-0d21-4c48-9a72-dfcc967c7205 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:18:43.334369 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2155e2fc-0d21-4c48-9a72-dfcc967c7205 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:18:43.345314 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2155e2fc-0d21-4c48-9a72-dfcc967c7205 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:18:43.349319 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14bc638-b987-4235-a015-9a650fd2ae63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:18:43.350041 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bc638-b987-4235-a015-9a650fd2ae63 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:18:43.350321 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bc638-b987-4235-a015-9a650fd2ae63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:18:43.350593 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bc638-b987-4235-a015-9a650fd2ae63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:18:43.352376 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f14bc638-b987-4235-a015-9a650fd2ae63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:18:43.363090 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14bc638-b987-4235-a015-9a650fd2ae63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:18:43.364517 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14bc638-b987-4235-a015-9a650fd2ae63 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:18:43.373231 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1440/2882] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:18:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:18:44.015253 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686b0e0-aa1f-4bfc-b628-8a3ac189b712 service placement] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:18:44.017062 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f686b0e0-aa1f-4bfc-b628-8a3ac189b712 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:18:44.033449 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686b0e0-aa1f-4bfc-b628-8a3ac189b712 service placement] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:18:44.041850 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3862e7f-cba4-47a5-8475-5b4efc04eed9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:18:44.042543 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3862e7f-cba4-47a5-8475-5b4efc04eed9 service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:18:44.042849 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3862e7f-cba4-47a5-8475-5b4efc04eed9 service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:18:44.043176 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3862e7f-cba4-47a5-8475-5b4efc04eed9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:18:44.045132 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-c3862e7f-cba4-47a5-8475-5b4efc04eed9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:18:44.061060 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3862e7f-cba4-47a5-8475-5b4efc04eed9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:18:44.062815 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3862e7f-cba4-47a5-8475-5b4efc04eed9 service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:18:44.075953 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1443/2883] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:18:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:18:59.064096 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14bc638-b987-4235-a015-9a650fd2ae63 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:18:59.079496 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14bc638-b987-4235-a015-9a650fd2ae63 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:18:59.086425 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0632f4b2-2ffb-4be9-a4f8-4cea356b6f98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f03aa520ee14615b802cdbc3cd4f87d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:18:59.087069 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632f4b2-2ffb-4be9-a4f8-4cea356b6f98 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:18:59.087348 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632f4b2-2ffb-4be9-a4f8-4cea356b6f98 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:18:59.087616 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632f4b2-2ffb-4be9-a4f8-4cea356b6f98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:18:59.089496 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0632f4b2-2ffb-4be9-a4f8-4cea356b6f98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:18:59.101805 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0632f4b2-2ffb-4be9-a4f8-4cea356b6f98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:18:59.103368 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0632f4b2-2ffb-4be9-a4f8-4cea356b6f98 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:18:59.114257 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1441/2884] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:18:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:20:51.036119 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3862e7f-cba4-47a5-8475-5b4efc04eed9 service nova] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:20:51.074608 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3862e7f-cba4-47a5-8475-5b4efc04eed9 service nova] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:20:51.080069 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6f246-b76f-43a9-a821-7f51e1309990 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9e8d17cf1648e0b650df48b8f9487a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:20:51.080733 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6f246-b76f-43a9-a821-7f51e1309990 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:20:51.081015 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6f246-b76f-43a9-a821-7f51e1309990 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:20:51.081289 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6f246-b76f-43a9-a821-7f51e1309990 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:20:51.083497 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-85e6f246-b76f-43a9-a821-7f51e1309990 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:20:51.208566 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e6f246-b76f-43a9-a821-7f51e1309990 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:20:51.210077 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e6f246-b76f-43a9-a821-7f51e1309990 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:20:51.235842 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1444/2885] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:20:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:20:57.504532 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0632f4b2-2ffb-4be9-a4f8-4cea356b6f98 service nova] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:20:57.506019 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0632f4b2-2ffb-4be9-a4f8-4cea356b6f98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:20:57.554165 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0632f4b2-2ffb-4be9-a4f8-4cea356b6f98 service nova] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:20:57.559173 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7aef7-09a4-4c57-bca5-4a076efd4e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:20:57.560070 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7aef7-09a4-4c57-bca5-4a076efd4e9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:20:57.560346 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7aef7-09a4-4c57-bca5-4a076efd4e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:20:57.560615 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7aef7-09a4-4c57-bca5-4a076efd4e9a admin admin] PATH_INFO: `/v3/users/64634c902a884b84a8bd2d3c10ce6270` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:20:57.561829 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7aef7-09a4-4c57-bca5-4a076efd4e9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=64634c902a884b84a8bd2d3c10ce6270)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:20:57.563752 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7aef7-09a4-4c57-bca5-4a076efd4e9a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:20:57.616003 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-81c7aef7-09a4-4c57-bca5-4a076efd4e9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64634c902a884b84a8bd2d3c10ce6270'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:20:57.626055 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-81c7aef7-09a4-4c57-bca5-4a076efd4e9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64634c902a884b84a8bd2d3c10ce6270'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:20:57.634860 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-81c7aef7-09a4-4c57-bca5-4a076efd4e9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64634c902a884b84a8bd2d3c10ce6270'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:20:57.646383 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-81c7aef7-09a4-4c57-bca5-4a076efd4e9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64634c902a884b84a8bd2d3c10ce6270'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:20:57.646999 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-81c7aef7-09a4-4c57-bca5-4a076efd4e9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64634c902a884b84a8bd2d3c10ce6270'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:20:57.652636 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1442/2886] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:20:57 2022] DELETE /identity/v3/users/64634c902a884b84a8bd2d3c10ce6270 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:20:57.834335 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6f246-b76f-43a9-a821-7f51e1309990 service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:20:57.844988 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6f246-b76f-43a9-a821-7f51e1309990 service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:20:57.909774 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ddc58-73ab-46d2-b2e5-bc2e14b68448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:20:57.910655 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ddc58-73ab-46d2-b2e5-bc2e14b68448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:20:57.910936 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ddc58-73ab-46d2-b2e5-bc2e14b68448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:20:57.911211 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ddc58-73ab-46d2-b2e5-bc2e14b68448 admin admin] PATH_INFO: `/v3/projects/385ae3c7ea8347d7bfc346d8bc7fda4a` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:20:57.912400 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ddc58-73ab-46d2-b2e5-bc2e14b68448 admin admin] RBAC: Authorizing `identity:delete_project(project_id=385ae3c7ea8347d7bfc346d8bc7fda4a)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:20:57.914546 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ddc58-73ab-46d2-b2e5-bc2e14b68448 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:20:57.960544 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-633ddc58-73ab-46d2-b2e5-bc2e14b68448 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'request_id': 'req-633ddc58-73ab-46d2-b2e5-bc2e14b68448'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:20:57.965744 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-633ddc58-73ab-46d2-b2e5-bc2e14b68448 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'request_id': 'req-633ddc58-73ab-46d2-b2e5-bc2e14b68448'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:20:57.971664 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-633ddc58-73ab-46d2-b2e5-bc2e14b68448 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '385ae3c7ea8347d7bfc346d8bc7fda4a', 'request_id': 'req-633ddc58-73ab-46d2-b2e5-bc2e14b68448'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:20:57.984551 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-633ddc58-73ab-46d2-b2e5-bc2e14b68448 admin admin] The token cache is being invalidate because project 385ae3c7ea8347d7bfc346d8bc7fda4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:20:57.984825 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-633ddc58-73ab-46d2-b2e5-bc2e14b68448 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:20:57.985431 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-633ddc58-73ab-46d2-b2e5-bc2e14b68448 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:20:57.987088 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1445/2887] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:20:57 2022] DELETE /identity/v3/projects/385ae3c7ea8347d7bfc346d8bc7fda4a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:20:57.991254 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7aef7-09a4-4c57-bca5-4a076efd4e9a admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:20:57.992739 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-81c7aef7-09a4-4c57-bca5-4a076efd4e9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:20:58.006509 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7aef7-09a4-4c57-bca5-4a076efd4e9a admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:20:58.067055 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10903770-7328-41e8-b7a5-843aaa3bf7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:20:58.067933 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10903770-7328-41e8-b7a5-843aaa3bf7f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:20:58.068218 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10903770-7328-41e8-b7a5-843aaa3bf7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:20:58.068482 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10903770-7328-41e8-b7a5-843aaa3bf7f3 admin admin] PATH_INFO: `/v3/users/1a90500c178c491397a0ecf92ce90228` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:20:58.069724 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10903770-7328-41e8-b7a5-843aaa3bf7f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a90500c178c491397a0ecf92ce90228)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:20:58.071656 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10903770-7328-41e8-b7a5-843aaa3bf7f3 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:20:58.120975 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-10903770-7328-41e8-b7a5-843aaa3bf7f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a90500c178c491397a0ecf92ce90228'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:20:58.128180 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-10903770-7328-41e8-b7a5-843aaa3bf7f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a90500c178c491397a0ecf92ce90228'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:20:58.137167 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-10903770-7328-41e8-b7a5-843aaa3bf7f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a90500c178c491397a0ecf92ce90228'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:20:58.149800 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-10903770-7328-41e8-b7a5-843aaa3bf7f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a90500c178c491397a0ecf92ce90228'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:20:58.150498 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-10903770-7328-41e8-b7a5-843aaa3bf7f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a90500c178c491397a0ecf92ce90228'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:20:58.156694 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1443/2888] 10.222.0.24 () {58 vars in 1223 bytes} [Mon May 16 19:20:57 2022] DELETE /identity/v3/users/1a90500c178c491397a0ecf92ce90228 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:20:58.342143 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ddc58-73ab-46d2-b2e5-bc2e14b68448 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:20:58.343621 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-633ddc58-73ab-46d2-b2e5-bc2e14b68448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:20:58.356659 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ddc58-73ab-46d2-b2e5-bc2e14b68448 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:20:58.418138 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3999591-c688-463a-9d2d-01f35d5ce541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70b26bfebd8410b8d3b2aa16cacd530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f43cb24f4194077b63c058f20af8f90', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:20:58.419019 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3999591-c688-463a-9d2d-01f35d5ce541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:20:58.419297 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3999591-c688-463a-9d2d-01f35d5ce541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:20:58.419573 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3999591-c688-463a-9d2d-01f35d5ce541 admin admin] PATH_INFO: `/v3/projects/b578e7cebd13462290fbe5dd4dbf9415` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:20:58.420861 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3999591-c688-463a-9d2d-01f35d5ce541 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b578e7cebd13462290fbe5dd4dbf9415)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:20:58.422826 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3999591-c688-463a-9d2d-01f35d5ce541 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:20:58.469774 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e3999591-c688-463a-9d2d-01f35d5ce541 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b578e7cebd13462290fbe5dd4dbf9415', 'request_id': 'req-e3999591-c688-463a-9d2d-01f35d5ce541'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:20:58.475720 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e3999591-c688-463a-9d2d-01f35d5ce541 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b578e7cebd13462290fbe5dd4dbf9415', 'request_id': 'req-e3999591-c688-463a-9d2d-01f35d5ce541'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:20:58.481774 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e3999591-c688-463a-9d2d-01f35d5ce541 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b578e7cebd13462290fbe5dd4dbf9415', 'request_id': 'req-e3999591-c688-463a-9d2d-01f35d5ce541'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:20:58.495940 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e3999591-c688-463a-9d2d-01f35d5ce541 admin admin] The token cache is being invalidate because project b578e7cebd13462290fbe5dd4dbf9415 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:20:58.496229 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e3999591-c688-463a-9d2d-01f35d5ce541 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:20:58.496863 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e3999591-c688-463a-9d2d-01f35d5ce541 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:20:58.498544 dv-cinder-766064-6-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1446/2889] 10.222.0.24 () {58 vars in 1232 bytes} [Mon May 16 19:20:58 2022] DELETE /identity/v3/projects/b578e7cebd13462290fbe5dd4dbf9415 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:22:12.318249 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10903770-7328-41e8-b7a5-843aaa3bf7f3 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:22:12.320030 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-10903770-7328-41e8-b7a5-843aaa3bf7f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:22:12.415729 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10903770-7328-41e8-b7a5-843aaa3bf7f3 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:22:12.482372 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd3e4f-3328-4d4d-a7bf-b6b95f8434d4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '629742b135b2447898e8291d9a360295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '084e70bbad784892b195bb11a68bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:22:12.483381 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd3e4f-3328-4d4d-a7bf-b6b95f8434d4 service placement] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:22:12.483835 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd3e4f-3328-4d4d-a7bf-b6b95f8434d4 service placement] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:22:12.484284 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd3e4f-3328-4d4d-a7bf-b6b95f8434d4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:22:12.487631 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3abd3e4f-3328-4d4d-a7bf-b6b95f8434d4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:22:12.506640 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd3e4f-3328-4d4d-a7bf-b6b95f8434d4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:22:12.508532 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd3e4f-3328-4d4d-a7bf-b6b95f8434d4 service placement] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:22:12.518584 dv-cinder-766064-6-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1444/2890] 10.222.0.24 () {60 vars in 1365 bytes} [Mon May 16 19:22:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)